I'm not an expert though I think it may well have to do with social anxiety as well as with AS.
People make noises, like standing up or moving their feet on the floor, some even comment on the scenes (me

) and this may well have something to do with sensory issues, on the other hand there is also a social component in watching tv or listening to music in company which is based on body language and potential comments on what is going on, so a sort of pressure on your passive performance or analysis ability.
My social anxiety has always been the main problem with my interacting with others because I just don't understand how some people need to organise their time and stick to a regulated schedule every day or maybe I just got depressed and stressed out from worrying about it. I've never been given the care and support of my elders or from those in a dedicated position as they are instantly at odds with the world that includes us in it.