In social events at pubs, restaurants and the like, yes I do tend to drift off. Hard to think of a situation that highlights my AS traits more negatively. Lack of common interests, compared to what 'most' people are likely to talk about on a night out e.g. sport, music, movies, showbiz makes my conversation very, very, very, very limited. Usually I find I've virtually nothing to contribute. And of course there's communication difficulties, exacerbated in the complex dynamic of conversations this way and that. On top of that, these conversations will always be full of banter. I find banter particularly difficult. And there's the interactional side, I always get on with some people but not so much with some others.
I have a friend (who first picked up on my AS) I meet regularly for lunches, we go to pubs/restaurants but that's almost the only time I go to such establishments these days.