Dormouse
Doesn't know that mice use holes.
Posts: 2,517
On the one hand, yes that tech screwed up. Although he probably was doing exactly what they told him to.
But more importantly, it really showed a huge hole in their processes, which is critical for them to have discovered and updated.
We ran into a similar situation [although much smaller] at my second to last job, when a car took out a power pole that ran the grid of our warehouse.
It turned out that:
1- The guy who created our RAID [before disappearing without notice or notes] wherein all customer records and transaction histories and listings and item databases had done so using some undocumented and completely unorthodox partitioning scheme.. and became corrupted during the failure.
2- All four of the UPS units attached to the RAID and backup servers failed and hadn't been tested in months.
3- The server which should have been making daily backups hadn't made one in over a week and nobody had thought to check that they had been being made.
Little say, after we spent a week manually re-entering all the records, my friend and I executed a coup and became the IT department and re-wired/configured the entire network from the ground-up.. and documented it! :p
Also, I can kill you with my brain.