I relate - I've been trying to explain this to my two close friends of late, trying to "come out of the Aspie closet" so to speak.
I think if you're fortunate and get the "high IQ" that seems to be fairly common with high-function, then you've got the ability to teach yourself how deal with routine and "casual" interaction - like not melting down when someone tries to strike up a conversation in an elevator, or being able to hold your own when you're 100% focused (like in a job interview). But maintaining a state of high-social-alertness is exhausting, and you can't keep it up indefinitely. In a new job I can manage for a few months, but inevitably I slip up, and then co-workers turn on me - they sense weakness or opportunity, or simply want to offload their stress onto an obvious victim.
I had that happen so badly once that I had to get litigious with an employer who decided to demote me from my senior position into a "back room" job - they wanted my "big huge brain" but they couldn't put up with my social ineptitude (to be fair, I made some pretty callous remarks, but that was just me being my good-'ol-blunt-self - funny that it never seemed to occur to them that I'd have a problem with being stripped of my seniority and shoved in a closet).
At any rate, my close friends refuse to believe that I have Asperger's. They're not really interested enough to try and understand AS, but they're fully prepared to assert that I don't have it - I'm just "socially awkward". Frustrated, I asked them for advice on a social situation I've been obsessing about, and both of them (in a sort of eerie "damn, that's so NT" way) used the phrase "you'll just know" in regards to the other person's possible reaction to my position...
"You'll just know..."
That's the problem, isn't it. There are a lot of different secondary symptoms with AS, but the core issue is not being able to recognize/interpret non-verbal communication from other human beings. The 98+% of the population who "get it" can't even begin to conceive that there are folks out here who don't.
At the moment, I'm trying to frame a response to my friends, though it's certainly hard to do so in an "un-dramatic" fashion.
What I want to say is - "So, if you were in this position, and you were *blind*, then how would you see how the other person is reacting? Tone of voice? What if you were blind and deaf?" But while I think that is a fairly accurate description of what it's like to be AS in an intense social situation, nobody who's NT is ever going to grasp it - we have eyes and ears that apparently work, so it's simply impossible that we can't "see" how someone else is reacting to us.
Perhaps it's more like "emotional color-blindness" - sorry, I can't see "boredom" or "disrespect" or "disdain", and I can't tell the difference between someone who is genuinely interested and someone who is simply trying to be polite (and probably thinking "how the hell to I get out of this freakin' conversation with this loon").
In many ways, being physically disabled is *easier* (though the idea of being pitied for my neurological "malfunction" offends me greatly). A person who succeeds in any aspect of life with a visible disability is given at least some respect for that accomplishment (though I accept that most average folk would still feel uncomfortable socializing with someone who was missing a limb). A person who succeeds in functioning in the "normal" world with an invisible neurological disability is treated pretty damn poorly, and if we take the risk of asking others to help us overcome our own shortcomings it seems to be met with disbelief and (to my experience) disdain.
I wish I had something really positive to say about life in AS-Land at the moment - I mean, I honestly don't want to be anyone other than myself, but I really regret that the folks who don't have to live with this are so prepared to power-wash it under their chrome-steel-carpets.
Nick