OMG - another Aspie trait I have!
I sometimes remember businesses to be on the opposite side of the street than they actually are, and am dumbfounded when I return there the next time to find the business has "moved".
In order to learn a place's location and directions to get there I have to drive it each day for a month, then I won't forget. If I did it just once each month I would never remember how to get there, what lane to be in to not be forced the wrong direction (like on highways and in cities with one-way streets where you are forced to go in a certain direction if you are in the wrong lane, etc.)
I have a sister who can go to a place once and remember forever. She doesn't understand why I can't remember (so tell me something new), yet I can cite the major facets of certain composers' lives, tell you when their major pieces were written and who they influenced.
I am hopeless in directions: you could blindfold me, spin me around, the sun could still be shining and I could absolutely guess North about 25% of the time correctly, not even better than chance.
My rule of thumb is, if there is a turn to get wrong on the way, I will make ALL of the wrong turns! I have to double my travel time, which is why nowadays I use public transportation a lot - I just can't take the frustration of being wrong all the time.
I particularly have to have the map and the direction I'm going in agree on N-S orientation. I cannot go to the East if the map
says that East is "up" on the paper.
I cracked up my biology professor in college once, who said: "You're the only person to memorize all the various parts right in the frog dissection, only you labeled 75% of them in the wrong place!! !" I knew that three things were associated, just could not orient them in the exact sequence from north to south. How bizarre is that?