Pff, this is really annoying. I know exactly what you're talking about!
I've decided to shut everything out, period. If I even start to think about what others might be gossiping about, I go nuts.
Don't feel too bad. Everybody talks. It's just talk. It's not God (or Oprah or whoever you believe rules the world
giving you a final judgement.