Fileservers rebooted
To correct a potential kernel bug affecting the SCSI driver in the storage nodes we had to build patched Linux kernels and reboot into them today.
This should not have affected any running jobs or sessions, they would just have paused waiting for the NFS servers to come back.