Yes, if they just wade in and interrupt something I'm trying to concentrate on, because I find it annoys me to have to suddenly drop my thoughts. Even when my thoughts weren't particularly important, I seem to need to finish them before I can turn my attention to theirs. And I can have a lot of trouble resuming after such an uncontrolled interruption.
It's not their fault, I don't see how else they can easily talk to me. I can't seem to just sit there doing nothing on the off-chance they'll approach me, I have to keep my mind occupied. It's like an alarm going off, even when I've set it myself, it always rings when I'm halfway through a thought and I want to smash the clock.
They often talk faster than I can take it in as well, I'm a slow thinker, so it soon addles my brain. But if they approach me with some warning, look at me to assess whether I seem busy, start at an appropriate juncture and speak slowly, clearly and not too aggressively, then it can be a pleasure to listen to them.
It's not 100% that way. I can and do compromise a lot.