I really think you're in an abusive relationship right now. Here are the warning signs:
+ He doesn't want you out of the house;
+ He controls all of the finances - if you don't have any sort of money, even for emergency use, that's a problem;
+ You feel the need to ask him permission to get a job, which you shouldn't have to do because you're an adult and therefore have the right to do whatever you want [long as it's not harmful];
+ He's manipulating you, i.e. threatening to take your animals to the pound if you go and see your grandmother.
If I were you, I'd really re-think the relationship. At the very least, I'll talk to a domestic violence group about it and see what sort of advice they can give you. No-one should be allowed to have that much control over your life.
_________________
Said the apple to the orange,
"Oh, I wanted you to come
Close to me and
Kiss me to the core."
Think you're ASD? Get thee to a professional!