Look with your head pointing at the other person but let your eyes look to the side of their head. I have done this trick for years. That way people do not notice. People get angry sometimes when one does not look at them when talking and I don't know why, so I learned to do this a long time ago as it keeps people happy.
Another trick I do is to take my eyes out of focus whilw looking so I can't see them but this can be tricky as if they move or walk away I will only see blurred shapes so they then can notice. The first suggestion works better in avoiding making eye contact to be honest.
_________________
.