I too struggle with implication, especially regarding relationships.
I think that 'people like us' sometimes need an explicit answer, this creates confusion when the person is uncomfortable giving a straight yes or no answer, which leaves me unsure of what they want me to do.
Then there is sarcasm, so straight answers arn't necessarily true. I once asked a lady if she was a lesbian, possibly I did this at a socially inappropriate moment. She said yes, so for the next few weeks, I assumed that she was, until at a party she told me that she was slightly disturbed by the question and had been sarcastic.