Spent 3 yrs yanking drives before powering down, one client invoice taught me better
I used to pull SATA drives from a running box all the time, figured hot swap meant hot swap, no big deal. Then a client in Dayton brought in a NAS with a dead drive bay and a corrupted volume, and when I checked the logs the timestamps lined up with me yanking a drive while the array was still rebuilding. That job cost me 6 hours of recovery work and a $150 credit off the invoice, so I ate the loss. The thing that tipped me off was a SMART log showing 4 unsafe shutdowns in one week on a machine I'd serviced twice. Turns out the controller was fine, I was just yanking too early and the cache hadn't flushed. Now I shut down clean or use the proper eject in the array software, and I've had zero repeat issues in 8 months. Curious if anyone else got burned by assuming hot swap covers every situation, or was it just me?