I'm generally more comfortable around people with developmental disabilities in general. And actually less tired than I am around nondisabled people, who are harder to predict and more likely to do condescending things.
However, if it were impossible for me to be annoyed by some people, I would be a saint. Every group of people contains people who are really annoying.
Also, I am more comfortable around one subgroup (and surrounding subgroups) of autistic people than among others. The hyperverbal hyperrational kind can wear me out in conversation, because of both the intensity and precision of their words, and the precision they seem to want me to give them in return.
_________________
"In my world it's a place of patterns and feel. In my world it's a haven for what is real. It's my world, nobody can steal it, but people like me, we live in the shadows." -Donna Williams