I hate it when people just "pop in", and it happens all the time with my family - they're very much 'the more, the merrier' kind of people and I'm distinctly not.
I don't know many Aspies who look forward to and enjoy unplanned social interaction. Take it easy on yourself. You made the effort to go out there and you deserve a cookie. 
_________________
~MissChess