I would say that it is possible your ASD shows in the way you interact with the people in the world around you.
Now, not everyone in the world knows how to spot ASD or the symptoms that are associated with it.
Some may sense that their is something not quiet "normal" in the way you (we) are.
And that may alert them, others may reject us because it confuses them, others may victimise us,
as people who are prone to bullying usually hone in anything that is abnormal perceiving it as a vulnerability or something to pick on.
Body language can be one aspect of ASD that people pick up on. Not looking in people's eyes, the way we stand.
The way we communicate can also be, for example quiet a few people with ASD have a tendency to be very tangential in their communication which is very unusual for normal people to keep track of or make sense of.
The various types of anxiety also often shows in a person which can also be picked up upon.
The end of the day, we all just can do our best.
If people reject us, we just have to move on and do our best to fit in or be happy.
Some ASD are prone to isolate themselves, either due to being sick of being mistreated, or because they enjoy the time on their own for what ever reasons as well as a good way to reduce stress levels in those of us who experience sensory overload.
The world is full of different people, all with their own history, their own values and their own preferences.
No one gets on with everyone, so my best advice is to simply try and find some people who you can get on with, who you fall out with the least and focus on them.
Don't worry about the rest, just try and focus on making a life for yourself that you can enjoy and maintain with least amount of stress.
We are an exotic fruit, rarer than the norm run of mill fruit. So to speak.
Hope this advice helps.