You're not alone, and I've been reflecting on these matters for quite a while.
One relevant factor is the well-noted trend where autistics will tend to work out what works for them in life, while having a reduced tendency to pick up and conform to the expectations of the majority.
Sometimes I think we see this expressed in differences of the lgbtiq variety.
There is also the sense, particularly for people without access to the explanations afforded by diagnosis, that they are different from others and struggle to relate to many others. They may then look for other explanations.
In the wild-west days of late 1990's, online, I found like-minded people in various chat rooms. On reflection, a significant proportion of those would seem to display autistic traits.
Being autistic does not equate to partaking of any paraphilias. It may, however, predict an increased openness or susceptibility to such.