Sounds like an Ethernet mismatch. Check the Ethernet parameters on your e-mail server and your Ethernet switch. A speed or duplex mismatch can cause this kind of behaviour. In particular for Sun & Cisco this kind of slowness with duplex mismatch is too common.