One moment while I go get my crystal ball out of the cupboard ….
Not knowing your brother, and not being a mind reader, I can only guess.
He's saying he thinks you blame society for it's reaction to you. Which is fairly common for ASpies, we have a tendency to feel 'singled out and picked on'. Which is a bad thing society does. Look at the videos people have posted of actors pretending to be ASpies for laughs. It's like they're saying "oh aren't ASpies funny, look at them." Which is actually quite childish, when you get down to it.
If you have Aspergers, it's not a "problem", it's just that you're wired differently than most people. As people on these boards have pointed out, most famous artists have some trait or another of AS. Reference Syd Barrett, or Alan Turing.
_________________
I wake to sleep, and take my waking slow. I feel my fate in what I cannot fear. I learn by going where I have to go. ~Theodore Roethke