MikeH106, I doubt you have much to complain about. 6.5 is actually a decent score. It's not great, but much better than I could ever get. When I tried HotOrNot, you want to know what I got? 3.4 for one picture, and 4.1 for another. I deleted the account shortly afterwards. It felt pointless to have that thrown in my face; I already knew I looked bad. But at least I had proof.
Anyway, I don't know where those 1's and 2's came from, but they clearly weren't honest opinions. I'm sure other guys gave them to you just to "beat the competition". If you want to get a more honest average, drop the two highest and two lowest numbers, and do the math of what's left. (In statistics, extreme values are known as "outliers", and they're sometimes dropped from the calculations.)
As for the picture itself, you could make some changes. Other people might have already said it, but I'll mention it anyway.
* Change the angle, so you're facing the viewer as an equal. The downward angle makes it look unnecessarily intimidating.
* Smile more. Make it a confident "hey, this rocks" smile.
* Wear a more casual shirt, and without the popped collar. You'll look more fashionable that way.