It's probably part of ASD; failure to understand humour is one of the symptoms you often see listed. Aversion to loud noise is also on that list.
Personally I don't have a problem with sarcasm, puns or obvious jokes, but I do have problems with banter. I can't always tell that it is banter or a wind-up, and I certainly don't know how to respond to it like-for-like. Usually people have to tell me they were just joking, and then I laugh embarrassedly.