Am I wrong if I stop being in contact with my family even if they are good towards me?

It is ultimately up to you to decide whether or not you want to maintain contact with your family. If you feel that being in contact with them is causing you more harm than good, then it is not wrong for you to distance yourself from them. It is important to prioritize your own mental and emotional well-being. However, it may also be helpful to communicate your feelings and reasons for wanting to limit contact with your family to avoid misunderstandings or hurt feelings.