He may have been teasing you, like it's obvious that you have oddball interests and are different from other people but not necessarily that you come off as creepy or "special".
If he wasn't just teasing you then he's being a jerk. I have know way of knowing of how weird you may seem in person, but if you are self-aware enough to be thinking about it then I'm sure there are little things you could do to seem more "normal", if you want to. Just try to make a conscious effort to be aware of your behavior. Try to pass it off as quirkiness if you can, but don't try to act completely normal because it will probably look phony and there's really no reason to anyway, IMO. As long as you are comfortable with yourself then others should be too. If they aren't, screw 'em. They aren't the people who really matter.