It depends a lot on your interest and your job.
For me, working with my interest is absolutely perfect, because in this job I work from home, and the standard mode of communication is via email, so poor social skills does not matter as long as I can express myself through text.
For someone else I know, social skills are highly appreciated at her workplace, but not actually a demand. She is awful socially, but great at her job, so she is still a highly valued employee.
As for another person I know, it's a guy who's only way to work with his interest is by teaching, which demands good social skills. Unfortunately, him being absolutely fantastic at his interest does not make him a very good teacher. He knows all about it, but is not good at passing that knowledge onto others.