So I had a hardware (onboard NIC) failure and had to change my network configuration. The darn OS (Debian Sarge) wouldn’t actually disable the onboard NIC so I had to give it a goofy address in order to make it work… but what I neglected to think about was how packets were going to get off the box. Since the ETH0 interface had a default gateway, I left it there… which was my mistake. I should have removed the gateway since the server thought it was multihomed, but instead I ended up finding the problem by dumping the ROUTE table and then removing the second default route. It only took me a bit more than an hour for a fix that should have been about 10 minutes.

Lessons: (1) I hate onboard equipment and (2) never forget your routing!