I have no problem at all at the moment with public transportation. However, until a few years ago, I feared buses because I didn't trust the bus driver to stop at the right place or to follow the right route (no problem with the metro). Now, I'm OK.
From about 14 years old, I have almost always had music to listen, so there are no sound problems. I don't really mind the noise anyway, especially in the metro; it's quite soothing, really, so long as nobody is talking. However, I do dislike the crowdedness at rush hour. Also, I generally just read, so I don't have a problem with looking at things. In any case, if I don't read, it's time lost, and losing time is inefficient.
Actually, I positively like to take public transportation. Sometimes, I go out of my way to take the bus, or even go out just for a bus ride, with some excuse destination (e.g. "I need to buy pens!").