The advantage of growing up is that you gain control of your own choices, and one of those choices is what to do with the negative influences you experienced while growing up.
So make a choice to shove them in the garbage and no longer be defined by the past.
I'm not going to say the process is easy or comfortable, but people go through it every day and eventually emerge happier and stronger. I went into adult life with a lot of dating handicaps myself, which created some, um *interesting* experiences, but each time I learned and grew and by the time I married my husband at 36 I think I had finally dealt with most of the things I needed to.
Some people go through the process on their own; some find professional assistance helpful.
Either way, the first step is to make a choice.
_________________
Mom to an amazing young adult AS son, plus an also amazing non-AS daughter. Most likely part of the "Broader Autism Phenotype" (some traits).