It happens the exact same way to me. I think it simply a relict from old kids time in the meaning of "I feel overloaded, so I want to be at a place, that is not like that." which was in earlier kiddietimes, simply my kids room, where I had the ability to be alone and for myself. Where I live now is as well technical my home, but its not that kids room feeling anymore, so I have responsibilities there, as well that I share it with my partner, that I cant simply throw out, when needing some time on my own. ^^ So sure my "grown up home" is as well my home, but its not that "being able to completely shut everything out home" anymore, that I had as kid, and that I´d like to have sometimes.