It's likely to be one of two things;
- Separation Anxiety
- Sensory Issues
Separation Anxiety
You need to consider leaving her alone with her father more often. Perhaps leave them alone in the house both sitting on the floor. Eventually she'll probably come to him. Certainly if you keep "rescuing" her, you're only increasing the anxiety. If you're breast feeding, consider expressing and allowing him to bottle feed. Some babies react to the absence of the smell of milk.
Sensory Issues
It could also be sensory related. If you haven't already, please have a look at Chynna T Laird's books. In particular, "Not just Spirited" talks about her sensory daughter's issues with her husband. I did a book review on it here.
Consider how your husband may seem different to you. Does he wear aftershave? The aftershave smell could be a factor?