There are places where math can help, and quite a lot of the theory of it is pretty much straight-up math. That said, the kind of math in the theory of it is often rather different from the sort of math you see in high school.
If you can code well, most people aren't going to worry about your math skills that much, or whether or not you have a college degree. I'd say the best way to see if you would be good at it is to do it and see if you like it. If you really like it, you'll probably be fine.
_________________
"A dead thing can go with the stream, but only a living thing can go against it." --G. K. Chesterton