I have experienced being regarded as selfish, yet I am a very giving persojn. The fact is that the Aspie function leads me to wander in my mental landscape - a socially selfish response to being in a group setting. It isn't something personal, most NTs just can't hold my attention. I actually socialize better with music, television, or video games to co-occupy the minds of NTs. The distraction of another stimulus closely reflects what my mind does for/to me, so we're all on equal footing, so to speak.
I do see how selfishness can be perceived in my behavior, but I would say it has more to do with my mind not being stimulated by the topics of social conversation - I don't care what so-and-so has been doing or talking about, and I think less of the other person for wanting to tell me about it. People who talk about subjects of inquiry rather than gossip do not think I am selfish.
Other things about which I am "selfish" are my taste in food, my love of NPR, and my refusal to answer the phone when I don't want to talk to someone. As a child, I was very possessive of the things I had that I liked, but I was okay with letting others use it provided my ownership was acknowledged. I got into a lot of fights because most kids accepted ownership as a fact of life, like I didn't trust them or like them because I wanted a clear verbal acknowledgement of my ownership. Looking back, it was an inability to read social cues on my part, but I don't think I could have explained it to other kids even if I had known it was symptomatic of AS.
_________________
q/p