Also larger fan can delivery the same air flow at lower rpm. If your case can fit bigger fans and is not tightly packed (lower rpm = lower air pressure), that can quiet it down too.
You can also replace the cpu cooler with better ones. Since it's a server, I assume that is where the noise from.