I have faced plenty of situations like that and I have no problem inviting people on the spectrum or with disabilities. Yet, if an NT is invited, they refuse.
One example was the housewarming party, which I have talked about before in which no one from my old job acknowledged or attended. This situation breaks my heart and it makes me feel angry.
On the other hand, I have had people attend my parties out of obligation. On such case is an ex-friend who came to my gatherings and didn't want to be there and faked it the whole time. She was extremely self-absorbed and so anything involving her life was way more important. This was though she kept telling me, "I love you like a sister."
During the same housewarming party that my co-workers snubbed, she had agreed to help me get set up and be with me throughout the day. At the last minute, she decided to run off and buy her wedding dress before showing up late. She and her husband, along with another friend only stayed for an hour. Then when they were leaving, I saw them sneaking out. She looked like she was happy to be leaving too. When I asked her about it, "My fiancee wanted to leave and we wanted to pay my dad back for the dress" I confronted her for breaking her promise. "I needed to be with my fiancee."