I can’t be sure if this is relevant to you, but my own experience is that a minority of people are basically herd animals, and react instinctively. This means you’ll probably never get a definitive answer to your question. Being autistic, it’s clear I give off some kind of vibe that marks me out as an individual, not a herd animal, probably a combination of many things (way of dressing, gait, lack of eye contact, facial expression, way of talking…) which to the herd animals makes me an object of suspicion and loathing. It doesn’t always happen (most people are more evolved, and have some control over their instincts) and when it does it may take a while. I’ve noticed that, talking to most women, it can go on for a while before they start looking at me oddly, when they’ve noticed I don’t think as they do. With some women, and with most people in general, it never happens, so I have options, and find it easy to just avoid the herd animals. There’s no point trying to change things as those who let their hormones do their thinking for them, cannot be reasoned with.