I didn't get my license until I was 21 because I struggled with it immensely too. You may have a visual tracking or processing problem. I have a bifocal vision dysfunction which means my eyes don't track things together; depending on whether I'm looking side to side or up and down, one or the other of my eyes bounces around and flits all over the place rather than moving in a smooth, straight line. This affects my processing speed, or my ability to take in information and respond to it in a timely manner, and is commonly associated with difficulty with visual tasks such as reading and driving.
If you can, I would recommend looking for a developmental optometrist who will be able to perform tests to see how well your eyes work together and if there are any issues.
_________________
"Survival is insufficient" - Seven of Nine
Diagnosed with ASD level 1 on the 10th of April, 2014
Rediagnosed with ASD level 2 on the 4th of May, 2019
Thanks to Olympiadis for my fantastic avatar!