I find many accents to be very hard on my ears and other parts of my body (sometimes I actually get chest or stomach pains!) and it's terrible because it makes me look like a horrible bigot, and I'm not.
I have a hard time listening to accents that sound really sing-song, bouncy, guttural, nasally, gravelly, or uses a lot of slang words not normally spoken except with that dialect. In Nova Scotia people are known for the cheerful greeting, "How she goin, cousin? What's goin' on? What's your fadder's name?" For some reason I speak with quite a neutral accent (which many people outside of Canada would call an "American" accent, which drives me crazy). When I was younger a kid once thought I was from New York because he was from New York and said I sounded like him. I don't think I sound like I'm from any part of New York (city or state) but I used to often speak too loud.
There are some accents I do like, however, and enjoy imitating as well (when no one else is around).