I have this problem, too. I don't think it's quite the fact you're in California, I've been in CT all my life, and my vocabulary is...different, I guess. I've even had a Pakistani guy think I wasn't even native born in the USA, just because my mannerisms and the way I talk. Also people tend to think I'm much older than I am sometimes for that reason, at 20 years old I've had people guess my age as 30, since I keep facial hair.
I too have the same problem of "where do you work, where do you go to school?" I do neither at the moment, and seemingly all I can say is "Yeah, I go ice skating and lift weights." Maybe with some more tact than that, but yeah. When they ask about work, sometimes I bring up my last job that's now about a year ago. Makes it look like you at least sorta kinda care about working and society and stuff. A way to spin your walking is say you like hiking a lot. Or you're an outdoor person and don't watch much TV. It makes you more interesting to say such things, but everyone else is boring, so yeah.
I can't relate as far as the signing thing, and got zero idea what to tell you there.
I guess my advice is, as far as friends, they're the people that are left, so to speak. The people that after you say "I don't work, I don't do ______" that still conversate with you regardless.