Yes, I definitely have trouble with faces. There are probably loads of people who think I'm a jerk because I didn't acknowledge them in passing. I often don't recognise people out of their normal context. Once, my mother invited me to lunch. My brother, whom I hadn't seen in about 4 years, was going to be there, but I didn't know. It was to be a surprise. I followed my mother towards a table, and there was a man blocking my path. I thought, "Why is this guy standing right in front of me? What does he want?" Then he said, "Hi sis". Awkward. 
_________________
“It is no measure of health to be well adjusted to a profoundly sick society”
Jiddu Krishnamurti