I've thought the same thing.
Almost contradicts the notion, huh? Not really, though. Since I'm NT and you're Aspie, my "world" is still very different from yours.
Another thing I've thought is that sometimes it doesn't matter how many differences they are, if they can even be quantified, when it comes to things like communication and getting along; it's where those differences are that can make or break interactions.