I used to have a lot more problems with being touched by strangers than I do now. Pats on shoulders, grabbing my arm, and especially kissing (on goodbyes, or festive days) were no-nos for me, sometimes even if it concerned my relatives.
But now, I've grown mostly indifferent to physical touch by others. I tend to keep a certain distance from most people, so it doesn't actually happen very often that anyone is in a position to touch me a lot.
But then, of course, there are the people who I let 'into my zone' so to speak, and I don't mind touch from them at all, although I myself am unlikely to do much touching (like hugging, shoulder pats, etc.) at all.
Now, where it concerns romance and attraction, it's actually a combination of the 2 above paragraphs. As long as the person is not 'in my zone', I myself would not be comfortable being touched by them (or touching them)- because I'd still be in the getting-to-know-them mode, which for me is more about an exchanging of ideas/information. Then after a while when we'd be a bit more comfortable with each other, I'll no longer mind the touching.
_________________
clarity of thought before rashness of action