From where I came from, yes and no.
Yes, it'll likely be people who cannot cope well with the modern standards of living.
Maybe people with nowhere to go except hide, likely with ruined past lives.
Also no. There are really people who lives in the mountains alone.
Some are rumored to be witches or shamans, usually in rural places, likely as someone who would choose to commune with nature.
Some are actually displaced tribespeople and actually know too little of the modern world to function there.
Some are actually been born up there...
I can see the appeal though.
But it's not necessarily about AS.
I acknowledge the fact that some of us are asocial, some of us are social, and some of us cannot handle being in overwhelming places regardless of the desire for solitude, and some of us simply can do with stressfully hostile environments.