I find clothes to change my appearance to a great extent as well.
If you don't like the attention with using contacts, try wearing more "drab" clothes.
Your wallet will like it as well.
Although, the advantages of being attractive far outweigh the negatives.
I suggest you wait it out, and maybe experiment with new beauty/care techniques.
I think that people are complimenting you because they like your new look, not because they envy you. (Don't know for sure at all, not there)
_________________
Music is the language of the world.
Math is the language of the universe.