Kind of sounds like neither of you are on the same page with each other, could be its not meant to be.
I had to break up with my first boyfriend who I had in high-school for similar reasons, he was just too clingy and always wanted to be touching. Also ended up seeming like the only real things we had in common were both being socially awkward and not having many friends....turned out we didn't actually have a ton of interests in common, and I found we disagreed a lot on our perspectives of various things so there wasn't a lot of other compatability to make up for the overly clingyness.
Also he'd get sort of moody at me and we'd sometimes go a day or two without talking and just giving each other mildly angry letters about what are grievances were towards each other. Looking back I still feel kind of bad about the whole thing as he was pretty upset about breaking up but it was either that or grudgingly stringing him along till I just couldn't fake it anymore which I feel would have been even more heart breaking.
_________________
Tis the time to melt the Ice.