For me, it's more like I feel peripherally bad. I don't care so much day-to-day, but I hate having to go to couple-y things alone (weddings, parties, dinner parties). I always get treated as though I'm trying to steal other people's men, even though I'm very, very careful with my interactions. Or else people pity me or don't really know how to interact with me, since most of the banter is couple-y.
Also, I'm of an age (in my 40's) where most people are coupled up, so my singleness especially sticks out. I don't like attention being drawn to me, no matter what.