The puzzle ribbon fits the bill perfectly. It's probably the most universally recognized symbol, and is small and easy to wear.
An employee who works in the same building as me wears the puzzle ribbon sometimes. At first I thought she was just rude, but now that I know she's autistic, I'm nicer to her, and more forgiving.