BCDC1 firewall migration complete, and notes on Palo Alto service

This one covered one of our data centers, and while the firewall migration itself went fine, the act of migration unfortunately broke a few services that relied on remote storage. Some lessons learned from this will hopefully reduce the impact of our next data center migration.

Another item of maintenance on Tuesday was to replace one of our new border firewalls with a warranty replacement. On Saturday August 26th, the data plane spontaneously restarted on one of our units. There was a successful failover, so there was minimal impact, however, Palo Alto determined that we had a hardware fault and sent us a new unit NBD. The migration of configuration, licenses, and management settings was pretty straightforward. It perhaps took an hour of preparation the previous work day, and a 10 minute swap-out time Tuesday morning.

In contrast to that we have had a drive failure in one of our Panorama boxes used for management of the appliances, and replacing that has been a bit more vexing for TAC. They finally sent us a correct replacement drive this week and it was installed today.