…is to walk away from it for about a month. In this case anyway.
We had a lot of legacy cruft in our network that has been and continues to be slowly phased out. We have recently replaced our content filter running Bordermanager with a Barracuda 610 web filter appliance…sort of. There is a legacy web based app which we have to run through the summer. When I cut everyone over to the Barracuda away from Bordermanager, it broke the web application. Right now, students go directly through the Barracuda, everyone else goes through the old proxy box which in turn goes through the Barracuda. That wasn’t really a large issue, but the proxy server has been locking up cold lately. The only thing that really changes on that box is the web cache processed by the proxy nlm. Maybe it was choking on something there…or I’m just grasping at straws. Either way, I don’t think it matters much, since ultimately that box needs to go away.
I finally got to spend a couple of minutes on the problem today. NSLookups on the hostname worked fine. But I couldn’t ping it from my test machine. I could ping it from my own machine without any issues. I figured out what was going on. The web app server is on the old legacy 10.0.0.0/8 network where my workstation and the proxy server all reside. So, routing is no issue there. The default gateway of the proxy and my machine is our core 4507. Unfortunatly, due to more legacy issues, the default gateway of the web app server is an old pfsense firewall connected hooked to our old ISP connection so it can’t have a proper gateway to the inside of the network. That goofy setup is only around because of DNS issues and the fact that Oracle application servers, at least our version, are incredibly stupid and need a complete reload if you want to change the hostname. There’s more to that story, but suffice it to say, we have to keep this setup until the summer.
To fix the whole mess, or rather duct tape it together, I just configured static routes into pfsense for the rest of the network. So, maybe walking away for an hour would have worked, I just chose a month. Also, this is a testament to keeping things simple.