Server Outage 5 July 2023

[Isaac Eiland-Hall]

In an apparent late celebration of Independence Day in the US, my datacenter lost primary and secondary power some time around 7:20am EDT 5 July 2023.

Power was restored around 8:30pm, give or take, but the server did not boot properly. Thanks to what I'm sure what high ticket volume and techs running around fixing many problems, the server was not up until perhaps as late as 3:30am 6 July 2023, although I'm not 100% sure on the timing.

The good news is that while we previously (late late year) had some instability, the last time the server experienced difficulties was in January. I don't count the datacenter power loss as server instability.

While I am not prepared immediately to jump and move servers... I have spun up a small server I'm running some experiments with - running NVME as that might give even better speeds than this server with its regular SSD. But that's a separate discussion and I mention it in passing.