Failed to RUN_ARRAY /dev/md/

etests · 7. Oktober 2014

Hey guys,

while rebuilding Raid 5 consisting of 4 discs (I replaced 1 disc) my server loose power connection, after reboot it hangs at ram disc message. I powered off and now I don't see this raid in OMV and got error at Filesystems. On startup it shows

Code

md/raid:md127: cannot start dirty degraded array.
md/raid:md127: failed to run raid set.
md: pers->run() failed ...


mdadm: failed to RUN_ARRAY /dev/md/datastore: input/outpu error
mdadm: Not enouth devices to start the array while not clean - consider --format
mdadm: /dev/md/daten has been startet with 4 drives
mdadm: no devices found for /dev/md/datastore

In OMV Webinterface I see all drives for this Raid "datastore" and I see second Raid5 "daten".

Any way to get my files back?

Looking forward to your ideas!

Thanks in advance.

EDIT:

Code

~# cat /proc/mdstat


Personalities : [raid6] [raid5] [raid4] 


md126 : active (auto-read-only) raid5 sdb[0] sdc[3] sdg[2] sdd[4]


      2930284032 blocks super 1.2 level 5, 512k chunk, algorithm 2 [4/4] [UUUU]


      


md127 : inactive sdh[1] sde[4] sdf[2]


      5860540680 blocks super 1.2


       


unused devices: <none>

Alles anzeigen

Code

~# fdisk -l


Disk /dev/sdc: 1000.2 GB, 1000204886016 bytes


255 heads, 63 sectors/track, 121601 cylinders, total 1953525168 sectors


Units = sectors of 1 * 512 = 512 bytes


Sector size (logical/physical): 512 bytes / 512 bytes


I/O size (minimum/optimal): 512 bytes / 512 bytes


Disk identifier: 0x00000000


Disk /dev/sdc doesn't contain a valid partition table


Disk /dev/sdb: 1000.2 GB, 1000204886016 bytes


255 heads, 63 sectors/track, 121601 cylinders, total 1953525168 sectors


Units = sectors of 1 * 512 = 512 bytes


Sector size (logical/physical): 512 bytes / 4096 bytes


I/O size (minimum/optimal): 4096 bytes / 4096 bytes


Disk identifier: 0x00000000


Disk /dev/sdb doesn't contain a valid partition table


Disk /dev/sda: 2004 MB, 2004516864 bytes


255 heads, 63 sectors/track, 243 cylinders, total 3915072 sectors


Units = sectors of 1 * 512 = 512 bytes


Sector size (logical/physical): 512 bytes / 512 bytes


I/O size (minimum/optimal): 512 bytes / 512 bytes


Disk identifier: 0x00028a80


   Device Boot      Start         End      Blocks   Id  System


/dev/sda1   *        2048     3647487     1822720   83  Linux


/dev/sda2         3649534     3913727      132097    5  Extended


/dev/sda5         3649536     3913727      132096   82  Linux swap / Solaris


Disk /dev/sdd: 1000.2 GB, 1000204886016 bytes


255 heads, 63 sectors/track, 121601 cylinders, total 1953525168 sectors


Units = sectors of 1 * 512 = 512 bytes


Sector size (logical/physical): 512 bytes / 512 bytes


I/O size (minimum/optimal): 512 bytes / 512 bytes


Disk identifier: 0x00000000


Disk /dev/sdd doesn't contain a valid partition table


Disk /dev/sde: 2000.4 GB, 2000398934016 bytes


255 heads, 63 sectors/track, 243201 cylinders, total 3907029168 sectors


Units = sectors of 1 * 512 = 512 bytes


Sector size (logical/physical): 512 bytes / 4096 bytes


I/O size (minimum/optimal): 4096 bytes / 4096 bytes


Disk identifier: 0x00000000


Disk /dev/sde doesn't contain a valid partition table


Disk /dev/sdf: 2000.4 GB, 2000398934016 bytes


255 heads, 63 sectors/track, 243201 cylinders, total 3907029168 sectors


Units = sectors of 1 * 512 = 512 bytes


Sector size (logical/physical): 512 bytes / 512 bytes


I/O size (minimum/optimal): 512 bytes / 512 bytes


Disk identifier: 0x00000000


Disk /dev/sdf doesn't contain a valid partition table


Disk /dev/sdg: 1000.2 GB, 1000204886016 bytes


255 heads, 63 sectors/track, 121601 cylinders, total 1953525168 sectors


Units = sectors of 1 * 512 = 512 bytes


Sector size (logical/physical): 512 bytes / 512 bytes


I/O size (minimum/optimal): 512 bytes / 512 bytes


Disk identifier: 0x00000000


Disk /dev/sdg doesn't contain a valid partition table


Disk /dev/sdh: 2000.4 GB, 2000398934016 bytes


255 heads, 63 sectors/track, 243201 cylinders, total 3907029168 sectors


Units = sectors of 1 * 512 = 512 bytes


Sector size (logical/physical): 512 bytes / 512 bytes


I/O size (minimum/optimal): 512 bytes / 512 bytes


Disk identifier: 0x00000000


Disk /dev/sdh doesn't contain a valid partition table


Disk /dev/sdi: 2000.4 GB, 2000398934016 bytes


255 heads, 63 sectors/track, 243201 cylinders, total 3907029168 sectors


Units = sectors of 1 * 512 = 512 bytes


Sector size (logical/physical): 512 bytes / 512 bytes


I/O size (minimum/optimal): 512 bytes / 512 bytes


Disk identifier: 0x00000000


Disk /dev/sdi doesn't contain a valid partition table


Disk /dev/md126: 3000.6 GB, 3000610848768 bytes


2 heads, 4 sectors/track, 732571008 cylinders, total 5860568064 sectors


Units = sectors of 1 * 512 = 512 bytes


Sector size (logical/physical): 512 bytes / 4096 bytes


I/O size (minimum/optimal): 524288 bytes / 1572864 bytes


Disk identifier: 0x00000000


Disk /dev/md126 doesn't contain a valid partition table

Alles anzeigen

Code

~# blkid


/dev/sdd: UUID="3ee96ac4-eb01-d42b-5e55-4de5f1a73ddb" UUID_SUB="475ed2a4-a76c-bd98-b1c6-6baea2da923d" LABEL="omv:daten" TYPE="linux_raid_member" 


/dev/sdc: UUID="3ee96ac4-eb01-d42b-5e55-4de5f1a73ddb" UUID_SUB="0a4e5f05-6a63-6f32-6471-dbbb03df551e" LABEL="omv:daten" TYPE="linux_raid_member" 


/dev/sdb: UUID="3ee96ac4-eb01-d42b-5e55-4de5f1a73ddb" UUID_SUB="f4c58713-a2e2-0c49-162a-f047d0338b2c" LABEL="omv:daten" TYPE="linux_raid_member" 


/dev/sde: UUID="d210ee85-0dd5-57f6-a9f5-67e14539b3b6" UUID_SUB="e48af4bf-6835-2f3e-df14-c6e1530e8474" LABEL="omv:datastore" TYPE="linux_raid_member" 


/dev/sdf: UUID="d210ee85-0dd5-57f6-a9f5-67e14539b3b6" UUID_SUB="5a122592-dabb-7e89-ff1d-7789aa11830e" LABEL="omv:datastore" TYPE="linux_raid_member" 


/dev/sdg: UUID="3ee96ac4-eb01-d42b-5e55-4de5f1a73ddb" UUID_SUB="d57effd0-49ec-660f-e575-92bb39773d6f" LABEL="omv:daten" TYPE="linux_raid_member" 


/dev/sdh: UUID="d210ee85-0dd5-57f6-a9f5-67e14539b3b6" UUID_SUB="ab90214c-dc02-d9cd-b99f-b4180d07321e" LABEL="omv:datastore" TYPE="linux_raid_member" 


/dev/md126: UUID="ZQDGSa-WC7t-1IEo-6O0t-jRQS-ecvZ-RG732K" TYPE="LVM2_member" 


/dev/sda1: UUID="a819428d-0b95-4a65-855a-5a00cd36e395" TYPE="ext4" 


/dev/sda5: UUID="2efaecf9-72b2-494a-b8e9-bc3e4ab6e963" TYPE="swap"

Alles anzeigen

etests · 7. Oktober 2014

Code

~# mdadm --examine /dev/sde


/dev/sde:


          Magic : a92b4efc


        Version : 1.2


    Feature Map : 0x0


     Array UUID : d210ee85:0dd557f6:a9f567e1:4539b3b6


           Name : omv:datastore  (local to host omv)


  Creation Time : Tue Jul 23 22:56:15 2013


     Raid Level : raid5


   Raid Devices : 4


 Avail Dev Size : 3907027120 (1863.02 GiB 2000.40 GB)


     Array Size : 5860538880 (5589.05 GiB 6001.19 GB)


  Used Dev Size : 3907025920 (1863.02 GiB 2000.40 GB)


    Data Offset : 2048 sectors


   Super Offset : 8 sectors


          State : active


    Device UUID : e48af4bf:68352f3e:df14c6e1:530e8474


    Update Time : Tue Oct  7 22:00:15 2014


       Checksum : 30bbcfc5 - correct


         Events : 40743


         Layout : left-symmetric


     Chunk Size : 512K


   Device Role : Active device 3


   Array State : .AAA ('A' == active, '.' == missing)


root@erde:~# mdadm --examine /dev/sdf


/dev/sdf:


          Magic : a92b4efc


        Version : 1.2


    Feature Map : 0x0


     Array UUID : d210ee85:0dd557f6:a9f567e1:4539b3b6


           Name : erde:datastore  (local to host omv)


  Creation Time : Tue Jul 23 22:56:15 2013


     Raid Level : raid5


   Raid Devices : 4


 Avail Dev Size : 3907027120 (1863.02 GiB 2000.40 GB)


     Array Size : 5860538880 (5589.05 GiB 6001.19 GB)


  Used Dev Size : 3907025920 (1863.02 GiB 2000.40 GB)


    Data Offset : 2048 sectors


   Super Offset : 8 sectors


          State : active


    Device UUID : 5a122592:dabb7e89:ff1d7789:aa11830e


    Update Time : Tue Oct  7 22:00:15 2014


       Checksum : 8febea21 - correct


         Events : 40743


         Layout : left-symmetric


     Chunk Size : 512K


   Device Role : Active device 2


   Array State : .AAA ('A' == active, '.' == missing)


root@erde:~# mdadm --examine /dev/sdh


/dev/sdh:


          Magic : a92b4efc


        Version : 1.2


    Feature Map : 0x0


     Array UUID : d210ee85:0dd557f6:a9f567e1:4539b3b6


           Name : erde:datastore  (local to host omv)


  Creation Time : Tue Jul 23 22:56:15 2013


     Raid Level : raid5


   Raid Devices : 4


 Avail Dev Size : 3907027120 (1863.02 GiB 2000.40 GB)


     Array Size : 5860538880 (5589.05 GiB 6001.19 GB)


  Used Dev Size : 3907025920 (1863.02 GiB 2000.40 GB)


    Data Offset : 2048 sectors


   Super Offset : 8 sectors


          State : active


    Device UUID : ab90214c:dc02d9cd:b99fb418:0d07321e


    Update Time : Tue Oct  7 22:00:15 2014


       Checksum : 2d2f2690 - correct


         Events : 40743


         Layout : left-symmetric


     Chunk Size : 512K


   Device Role : Active device 1


   Array State : .AAA ('A' == active, '.' == missing)


~#

Alles anzeigen

etests · 7. Oktober 2014

Code

~# mdadm --stop /dev/md127


mdadm: stopped /dev/md127


~# mdadm --assemble --scan


mdadm: /dev/md/datastore assembled from 3 drives - not enough to start the array while not clean - consider --force.

etests · 7. Oktober 2014

Code

~# mdadm --detail /dev/md127


/dev/md127:


        Version : 1.2


  Creation Time : Tue Jul 23 22:56:15 2013


     Raid Level : raid5


  Used Dev Size : 1953512960 (1863.02 GiB 2000.40 GB)


   Raid Devices : 4


  Total Devices : 3


    Persistence : Superblock is persistent


    Update Time : Tue Oct  7 22:00:15 2014


          State : active, degraded, Not Started 


 Active Devices : 3


Working Devices : 3


 Failed Devices : 0


  Spare Devices : 0


         Layout : left-symmetric


     Chunk Size : 512K


           Name : omv:datastore (local to host omv)


           UUID : d210ee85:0dd557f6:a9f567e1:4539b3b6


         Events : 40743


    Number   Major   Minor   RaidDevice State


       0       0        0        0      removed


       1       8      112        1      active sync   /dev/sdh


       2       8       80        2      active sync   /dev/sdf


       4       8       64        3      active sync   /dev/sde

Alles anzeigen

etests · 7. Oktober 2014

Solution

cat /proc/mdstat
mdadm --stop /dev/mdABC (The "Not started" from 1)
mdadm --assemble --force /dev/mdABC /dev/sdx /dev/sdy /dev/sdz
Start recover using OMV Webinterface with the 4. disc

Jetzt mitmachen!