My sensitivity is more to heat; if it's too hot I become physically ill. However, once I become chilled, I'm really chilled, and it takes forever for me to warm up (I've got multiple problems besides ASD, so it may be entirely unrelated; I haven't always been like this).
Our home is 60 F/16 C this time of year. Heating costs money; wearing sweaters is free (at least, much cheaper and already paid for). We might heat one room temporarily, like for massage or sex. My mate likes a radiant heater at her back for meditation; I prefer to wrap up in a blanket.
Whenever ambient is >60 F, we open all of the doors & windows. In summer we use several fans. We only run the A/C in extremis; for just a few hours on a few days out of the year.