I don't know if this is caused by AS. I would've behaved the same as you and kept my arm raised forever. But nowadays, after lots of therapy and self-work to deal with past abuse, I know that the game / the leader is not worth my effort, so seeing he was counting up, and getting farther away from the time I went to bed, I would've just lowered my arm and forgotten about it. I think it's more connected with respecting yourself and your needs than with AS in this case.
_________________
So-called white lies are like fake jewelry. Adorn yourself with them if you must, but expect to look cheap to a connoisseur.