I made it through, and I was of the average age.
However, it was hard - not the coursework, but keeping track of things and some social issues. I had lots and lots of meltdowns, and I lived in a constant state of frustration and being annoyed by everything and everyone. I did not know then what my problem was or how I needed to care for myself. Neither did I know how to properly communicate with my professors to explain to them my difficulties. I became overwhelmed with keeping track of deadlines and "overdoing" projects. My perfectionist tendencies were a big, big problem. Also, while I was a good student and did not procrastinate, certain weeks were complete overload, and I had difficulty deciding what I needed to focus on and what to skip. I probably picked the wrong things often.
I lived at home and had the support of my parents, and my future husband. Other people were also urging me to continue on, push, through and finish. My last year, I lived in the dorms - I wish I had not done so. That contributed to some sensory overload. The kids in the next rooms were very noisy or wanted to talk all hours of the night. Some kids slept through their alarms or forget to turn them off and the beeping could be heard through the wall for hours.
There were several times I wanted to quit. My parents were paying for my schooling and basically gave me an ultimatum that if I didn't go straight through, that was it: no more money for school. I might have even have been required to pay them back for the semesters I went. That, and their communication of extreme disappointment, was pretty strong motivation to finish.
I have read elsewhere that it is difficult for Aspies to go straight through college, if they graduate at all.
I did enjoy most of my classes, even if they weren't in my major, because I generally got to choose ones of interest to me. I found college much better than high school, all around. It was much more interesting, and being able to choose my own schedule was great. Maybe going part-time would be easier. I don't know if that is so doable for music majors, though.