There is stigma attached, however you're already suffering, do you not think they way you're being treat currently is just as bad?
Employers are not allowed to bully you or hold your health problems against you - they are bullying you now, however they're not aware that it's bullying because from their perspective you're a person who isn't working as you're supposed to, they may consider you lazy or useless, if you were to tell them the situation they'd know this is not true and may be able to work with you so that you have your instructions written down (either you writing them or your employer and co-workers writing it down for you).
Reality check #1 - can you actually do the job?
Reality check #2 - employers, if prejudice, will find a way to be intolerant and even fire you...but they way you talk it seems as if you're headed for losing your job anyway, at least if they're informed you may have a leg to stand on legally if you are fired as a result. You don't want people treating you badly, but this is what's happening regardless, you need to consider taking a stand against that, and one way of doing that is informing them of what is going on and accepting the idea that you are entitled to support within the workplace.
It's hard, I've never disclosed that I'm AS simply because I've been unemployed during the time I've known I was AS - looking back at my last job my boss thought I was being indifferent, amongst some other issues she had with me, I don't think I'd have told them early on but by the time they were looking to get rid of me I think if I'd have been able to tell them I am AS it would have protected me a little.
_________________
Bloodheart
Good-looking girls break hearts, and goodhearted girls mend them.