Disk Woes
- Sep
- 10
- Posted by TKH Specialist
- Posted in System Administration, Workstation
I hope to never use this document again but thought it worth documenting in case someone else has need of the information. I powered my desktop off for a planned power outage. When I powered it back on the system failed to boot reporting either “Error 17” or “Error 25”, in short the software raid (mirrored disks) were corrupted… The timing of this event could not have been better. The power outage included our data center, so I had to power over 100 systems on without my desktop! Thank God for Live CDs!! Following the power on there were other issues to deal with so it was almost a week before I could deal with my failed desktop. Here is what I tried:
“sata to USB cable” since the drive was part of a raid pair this didn’t work and I didn’t waste a lot of time on it. What it did help me discover was which disk was bad.
Knowing which disk was bad I then confirmed the failed drive using the BIOS and boot sequence on my desktop. I confirmed it was /dev/sda that was failed. I was able to get a replacement disk on the same size from our desktop support team. With the new disk installed here is what I did and the results.
Boot the system to an Ubuntu Live CD
I don’t have time to add much description now but the commands and sequence should hopefully help for now. Feel free to post a question in the comments if you have any.
sudo mdadm --query --detail /dev/md/1 sudo mdadm --assemble --scan sudo mdadm --query --detail /dev/md/1 sudo mdadm --assemble sudo mdadm --assemble --scan sudo mdadm --query --detail /dev/md/1 sudo mdadm --query --detail /dev/md/0 sudo mdadm --query --detail /dev/md/2 sudo mdadm --query --detail /dev/md/3 sudo mdadm --stop /dev/md/0 sudo mdadm --stop /dev/md/1 sudo mdadm --stop /dev/md/2 sudo mdadm --stop /dev/md/3 sudo mdadm --query --detail /dev/md/0 sudo mdadm --query --detail /dev/md/1 sudo mdadm --query --detail /dev/md/2 sudo mdadm --stop /dev/md/2 sudo mdadm --query --detail /dev/md/3 sudo mdadm --stop /dev/md/3 sudo fdisk -l cat /proc/mdstat sudo mdadm --assemble --scan cat /proc/mdstat sudo mount /dev/md3 /mnt cat /proc/mdstat sudo mount /dev/sdb1 /mnt sudo fdisk -l sudo mdadm stop /dev/md/0n3 cat /proc/mdstat sudo mdadm --manage /dev/md0 --fail /dev/sda1 sudo mdadm --manage /dev/md0 --fail /dev/sda sudo mdadm --manage /dev/md1 --fail /dev/sda2 sudo mdadm --manage /dev/md2 --fail /dev/sda3 cat /proc/mdstat
sudo sfdisk -d /dev/sda > sda.out
sudo sfdisk -d /dev/sdb |sudo sfdisk /dev/sda sudo sfdisk -d /dev/sda > sda.out sudo fdisk -l sudo mdadm --manage /dev/md0 --add /dev/sda1 sudo mdadm --manage /dev/md1 --add /dev/sda2 sudo mdadm --manage /dev/md2 --add /dev/sda3 sudo mdadm --manage /dev/md3 --add /dev/sda5 cat /proc/mdstat watch cat /proc/mdstat Every 2.0s: cat /proc/mdstat Mon Aug 17 13:15:31 2015 Personalities : [raid1] md0 : active raid1 sda1[2] sdb1[1] 4093888 blocks super 1.1 [2/2] [UU] md1 : active raid1 sda2[2] sdb2[1] 819136 blocks super 1.0 [2/2] [UU] md3 : active raid1 sda5[2] sdb5[1] 278538048 blocks super 1.1 [2/1] [_U] [==============>......] recovery = 70.4% (196127360/278538048) finish=15.0min speed=91334K/sec bitmap: 0/3 pages [0KB], 65536KB chunk md2 : active raid1 sda3[2] sdb3[1] 204668800 blocks super 1.1 [2/2] [UU] bitmap: 0/2 pages [0KB], 65536KB chunk unused devices: <none>
Good Luck
Recent Comments
- Stefan on Flush This!
- Timestamping your Bash History | Matt's Entropy on Remember when you issued that command…?
- Matt Smith on Remember when you issued that command…?
- Ruan on Putting ‘lsof’ to use
- Dylan F. Marquis on External Mapping of LDAP attributes in CAS