RAID 5 is lost

Grabber66 · 3. Juni 2015

Hi,

i have a big Problem with my Raid 5.
I have just reboot my NAS, and it hangs on boot. So i have to make a hard shutdown.
After waiting a few seconds i restart the NAS. After booting my Raid 5 is lost.

Here are my first infos:

Code

root@openmediavault:/# cat /proc/mdstat
Personalities :
unused devices: <none>


root@openmediavault:/# blkid
/dev/sda1: UUID="b909f34d-e519-438e-89cb-d15d2d5e3ab7" TYPE="ext4"
/dev/sda5: UUID="c0883761-e515-4bd4-b10f-bf4566d07899" TYPE="swap"


root@openmediavault:/# fdisk -l


Disk /dev/sda: 60.0 GB, 60022480896 bytes
255 heads, 63 sectors/track, 7297 cylinders, total 117231408 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x000945a0


   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *        2048   112383999    56190976   83  Linux
/dev/sda2       112386046   117229567     2421761    5  Extended
/dev/sda5       112386048   117229567     2421760   82  Linux swap / Solaris


WARNING: GPT (GUID Partition Table) detected on '/dev/sdb'! The util fdisk doesn't support GPT. Use GNU Parted.


Disk /dev/sdb: 3000.6 GB, 3000592982016 bytes
256 heads, 63 sectors/track, 363376 cylinders, total 5860533168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disk identifier: 0x00000000


   Device Boot      Start         End      Blocks   Id  System
/dev/sdb1               1  4294967295  2147483647+  ee  GPT
Partition 1 does not start on physical sector boundary.


WARNING: GPT (GUID Partition Table) detected on '/dev/sdd'! The util fdisk doesn't support GPT. Use GNU Parted.


Disk /dev/sdd: 3000.6 GB, 3000592982016 bytes
256 heads, 63 sectors/track, 363376 cylinders, total 5860533168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disk identifier: 0x00000000


   Device Boot      Start         End      Blocks   Id  System
/dev/sdd1               1  4294967295  2147483647+  ee  GPT
Partition 1 does not start on physical sector boundary.


WARNING: GPT (GUID Partition Table) detected on '/dev/sdc'! The util fdisk doesn't support GPT. Use GNU Parted.


Disk /dev/sdc: 3000.6 GB, 3000592982016 bytes
256 heads, 63 sectors/track, 363376 cylinders, total 5860533168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disk identifier: 0x00000000


   Device Boot      Start         End      Blocks   Id  System
/dev/sdc1               1  4294967295  2147483647+  ee  GPT
Partition 1 does not start on physical sector boundary.
root@openmediavault:/#

Alles anzeigen

Can anyone help me. I have not Backup all Data

ryecoaaron · 3. Juni 2015

Try:

mdadm --assemble /dev/md127 /dev/sd[bcd] --verbose --force

Grabber66 · 3. Juni 2015

Thanks i will try and report.

Grabber66 · 3. Juni 2015

Seems not working.

Code

root@openmediavault:/# mdadm --assemble /dev/md127 /dev/sd[bcd] --verbose --force
mdadm: looking for devices for /dev/md127
mdadm: Cannot assemble mbr metadata on /dev/sdb
mdadm: /dev/sdb has no superblock - assembly aborted

Here are some more infos from webif

Code

================================================================================
= Linux Software RAID
================================================================================
Not used


================================================================================
= Block device attributes
================================================================================
/dev/sda1: UUID="b909f34d-e519-438e-89cb-d15d2d5e3ab7" TYPE="ext4"
/dev/sda5: UUID="c0883761-e515-4bd4-b10f-bf4566d07899" TYPE="swap"


================================================================================
= File system disk space usage
================================================================================
Dateisystem                                            Typ      1024-Blöcke Benutzt Verfügbar Kapazität Eingehängt auf
rootfs                                                 rootfs      55308692 8912228  43586916       17% /
udev                                                   devtmpfs       10240       0     10240        0% /dev
tmpfs                                                  tmpfs         376036     416    375620        1% /run
/dev/disk/by-uuid/b909f34d-e519-438e-89cb-d15d2d5e3ab7 ext4        55308692 8912228  43586916       17% /
tmpfs                                                  tmpfs           5120       0      5120        0% /run/lock
tmpfs                                                  tmpfs        1236400       0   1236400        0% /run/shm
tmpfs                                                  tmpfs        1880164   20876   1859288        2% /tmp


================================================================================
= Static information about the file systems
================================================================================
# /etc/fstab: static file system information.
#
# Use 'blkid' to print the universally unique identifier for a
# device; this may be used with UUID= as a more robust way to name devices
# that works even if disks are added and removed. See fstab(5).
#
# <file system> <mount point>   <type>  <options>       <dump>  <pass>
# / was on /dev/sda1 during installation
UUID=b909f34d-e519-438e-89cb-d15d2d5e3ab7 /               ext4    errors=remount-ro 0       1
# swap was on /dev/sda5 during installation
UUID=c0883761-e515-4bd4-b10f-bf4566d07899 none            swap    sw              0       0
# /dev/sdb1       /media/usb0     auto    rw,user,noauto  0       0
tmpfs           /tmp            tmpfs   defaults        0       0
# >>> [openmediavault]
UUID=9c27e02f-8f1b-4ce3-89b5-d9f24bbd045d /media/9c27e02f-8f1b-4ce3-89b5-d9f24bbd045d ext4 defaults,nofail,user_xattr,noexec,usrjquota=aquota.user,grpjquota=aquota.group,jqfmt=vfsv0,acl 0 2
/media/9c27e02f-8f1b-4ce3-89b5-d9f24bbd045d/video/ /export/video none bind 0 0
/media/9c27e02f-8f1b-4ce3-89b5-d9f24bbd045d/kinder/filme/ /export/kinderfilme none bind 0 0
/media/9c27e02f-8f1b-4ce3-89b5-d9f24bbd045d/kinder/serien/ /export/kinderserien none bind 0 0
/media/9c27e02f-8f1b-4ce3-89b5-d9f24bbd045d/kinder/audio/ /export/kinderaudio none bind 0 0
# <<< [openmediavault]


================================================================================
= Mount information
================================================================================
14 20 0:13 / /sys rw,nosuid,nodev,noexec,relatime - sysfs sysfs rw
15 20 0:3 / /proc rw,nosuid,nodev,noexec,relatime - proc proc rw
16 20 0:5 / /dev rw,relatime - devtmpfs udev rw,size=10240k,nr_inodes=467898,mode=755
17 16 0:10 / /dev/pts rw,nosuid,noexec,relatime - devpts devpts rw,gid=5,mode=620,ptmxmode=000
18 20 0:14 / /run rw,nosuid,noexec,relatime - tmpfs tmpfs rw,size=376036k,mode=755
20 1 8:1 / / rw,relatime - ext4 /dev/disk/by-uuid/b909f34d-e519-438e-89cb-d15d2d5e3ab7 rw,errors=remount-ro,user_xattr,barrier=1,data=ordered
21 18 0:16 / /run/lock rw,nosuid,nodev,noexec,relatime - tmpfs tmpfs rw,size=5120k
22 18 0:17 / /run/shm rw,nosuid,nodev,noexec,relatime - tmpfs tmpfs rw,size=1236400k
23 20 0:18 / /tmp rw,relatime - tmpfs tmpfs rw
24 20 0:19 / /var/lib/nfs/rpc_pipefs rw,relatime - rpc_pipefs rpc_pipefs rw
25 15 0:20 / /proc/fs/nfsd rw,relatime - nfsd nfsd rw
--------------------------------------------------------------------------------
0:13 sysfs  /sys
0:3 /proc  /proc
0:5 udev  /dev
0:10 devpts  /dev/pts
0:14 tmpfs  /run
8:1 /dev/sda1 b909f34d-e519-438e-89cb-d15d2d5e3ab7 /
0:16 tmpfs  /run/lock
0:17 tmpfs  /run/shm
0:18 tmpfs  /tmp
0:19 rpc_pipefs  /var/lib/nfs/rpc_pipefs
0:20 nfsd  /proc/fs/nfsd


================================================================================
= Partitions
================================================================================
major minor  #blocks  name


   8        0   58615704 sda
   8        1   56190976 sda1
   8        2          1 sda2
   8        5    2421760 sda5
   8       16 2930266584 sdb
   8       17 2930265543 sdb1
   8       48 2930266584 sdd
   8       49 2930265543 sdd1
   8       32 2930266584 sdc
   8       33 2930265543 sdc1

Alles anzeigen

ryecoaaron · 4. Juni 2015

How was the array created? There are partitions on the drive telling me OMV did not create them. They also don't show up in blkid telling me it probably isn't software (mdadm) raid.

Grabber66 · 4. Juni 2015

All hdd's are nearly new and are only in this system. And Raid was build with omv.
But a few month ago, i have maybe the same Problem, and there i try these
omv-mkconf fstab
omv-mkconf mdadm

After all i use fsck.ext4, but need to build a new Raid 5 via omv. Thats all i do.

And i have the same Problem again....

ryecoaaron · 4. Juni 2015

Your blkid output doesn't show that the drives are members of a raid array. OMV doesn't use partitions for raid. The two commands you listed wouldn't have hurt anything. The assemble command says it isn't finding the right signatures on the drives. Not sure what else you can do if mdadm doesn't think the drive was in a raid array.

Grabber66 · 4. Juni 2015

OK thanks for your help.
I think i have to live with lost Data, and rebuild all new.
But now i try snapraid, maybe it is more stable.

Grabber66 · 4. Juni 2015

Maybe i have just a chance for my data.

Can you take a look here, please:

Code

root@openmediavault:~# mdadm --create /dev/md127 --verbose --level=5 --raid-devices=3 /dev/sdb1 /dev/sdc1 /dev/sdd1
mdadm: layout defaults to left-symmetric
mdadm: layout defaults to left-symmetric
mdadm: chunk size defaults to 512K
mdadm: size set to 2930134016K
mdadm: Defaulting to version 1.2 metadata
mdadm: array /dev/md127 started.
root@openmediavault:~# blkid
/dev/sda1: UUID="b909f34d-e519-438e-89cb-d15d2d5e3ab7" TYPE="ext4"
/dev/sda5: UUID="c0883761-e515-4bd4-b10f-bf4566d07899" TYPE="swap"
/dev/sdb1: UUID="f90aa112-94f0-19a4-053b-a1e9d949eb6d" UUID_SUB="20a5df6f-c0fd-429a-4caa-ed7f42e5359b" LABEL="openmediavault:127" TYPE="linux_raid_member"
/dev/sdd1: UUID="f90aa112-94f0-19a4-053b-a1e9d949eb6d" UUID_SUB="89f6dfa6-bc9b-c8db-cca0-68569b1a39ce" LABEL="openmediavault:127" TYPE="linux_raid_member"
/dev/sdc1: UUID="f90aa112-94f0-19a4-053b-a1e9d949eb6d" UUID_SUB="e1aaa6e3-7a01-922e-8277-ba9b0e66aef0" LABEL="openmediavault:127" TYPE="linux_raid_member"
root@openmediavault:~# fdisk -l


Disk /dev/sda: 60.0 GB, 60022480896 bytes
255 heads, 63 sectors/track, 7297 cylinders, total 117231408 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x000945a0


   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *        2048   112383999    56190976   83  Linux
/dev/sda2       112386046   117229567     2421761    5  Extended
/dev/sda5       112386048   117229567     2421760   82  Linux swap / Solaris


WARNING: GPT (GUID Partition Table) detected on '/dev/sdb'! The util fdisk doesn't support GPT. Use GNU Parted.


Disk /dev/sdb: 3000.6 GB, 3000592982016 bytes
256 heads, 63 sectors/track, 363376 cylinders, total 5860533168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disk identifier: 0x00000000


   Device Boot      Start         End      Blocks   Id  System
/dev/sdb1               1  4294967295  2147483647+  ee  GPT
Partition 1 does not start on physical sector boundary.


WARNING: GPT (GUID Partition Table) detected on '/dev/sdd'! The util fdisk doesn't support GPT. Use GNU Parted.


Disk /dev/sdd: 3000.6 GB, 3000592982016 bytes
256 heads, 63 sectors/track, 363376 cylinders, total 5860533168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disk identifier: 0x00000000


   Device Boot      Start         End      Blocks   Id  System
/dev/sdd1               1  4294967295  2147483647+  ee  GPT
Partition 1 does not start on physical sector boundary.


WARNING: GPT (GUID Partition Table) detected on '/dev/sdc'! The util fdisk doesn't support GPT. Use GNU Parted.


Disk /dev/sdc: 3000.6 GB, 3000592982016 bytes
256 heads, 63 sectors/track, 363376 cylinders, total 5860533168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disk identifier: 0x00000000


   Device Boot      Start         End      Blocks   Id  System
/dev/sdc1               1  4294967295  2147483647+  ee  GPT
Partition 1 does not start on physical sector boundary.


Disk /dev/md127: 6000.9 GB, 6000914464768 bytes
2 heads, 4 sectors/track, 1465067008 cylinders, total 11720536064 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 524288 bytes / 1048576 bytes
Disk identifier: 0x00000000


Disk /dev/md127 doesn't contain a valid partition table
root@openmediavault:~#

Alles anzeigen

ryecoaaron · 4. Juni 2015

There was... When you use the --create flag, you *usually* lose everything.

Grabber66 · 4. Juni 2015

Maybe i have a little chance:

In Webif the Detail gives me this informations:

Code

Version : 1.2
  Creation Time : Thu Jun  4 02:04:11 2015
     Raid Level : raid5
     Array Size : 5860268032 (5588.79 GiB 6000.91 GB)
  Used Dev Size : 2930134016 (2794.39 GiB 3000.46 GB)
   Raid Devices : 3
  Total Devices : 3
    Persistence : Superblock is persistent


    Update Time : Thu Jun  4 02:13:09 2015
          State : clean, degraded
 Active Devices : 2
Working Devices : 3
 Failed Devices : 0
  Spare Devices : 1


         Layout : left-symmetric
     Chunk Size : 512K


           Name : openmediavault:127  (local to host openmediavault)
           UUID : f90aa112:94f019a4:053ba1e9:d949eb6d
         Events : 3


    Number   Major   Minor   RaidDevice State
       0       8       17        0      active sync   /dev/sdb1
       1       8       33        1      active sync   /dev/sdc1
       2       0        0        2      removed


       3       8       49        -      spare   /dev/sdd1

Alles anzeigen

But How might i mount this ?

Grabber66 · 4. Juni 2015

So now my last results:

Code

root@openmediavault:~# cat /proc/mdstat
Personalities : [raid6] [raid5] [raid4]
md127 : active (auto-read-only) raid5 sdb1[0] sdd1[3] sdc1[1]
      5860268032 blocks super 1.2 level 5, 512k chunk, algorithm 2 [3/3] [UUU]


unused devices: <none>

Code

root@openmediavault:~# blkid
/dev/sda1: UUID="b909f34d-e519-438e-89cb-d15d2d5e3ab7" TYPE="ext4"
/dev/sda5: UUID="c0883761-e515-4bd4-b10f-bf4566d07899" TYPE="swap"
/dev/sdb1: UUID="f90aa112-94f0-19a4-053b-a1e9d949eb6d" UUID_SUB="20a5df6f-c0fd-429a-4caa-ed7f42e5359b" LABEL="openmediavault:127" TYPE="linux_raid_member"
/dev/sdd1: UUID="f90aa112-94f0-19a4-053b-a1e9d949eb6d" UUID_SUB="89f6dfa6-bc9b-c8db-cca0-68569b1a39ce" LABEL="openmediavault:127" TYPE="linux_raid_member"
/dev/sdc1: UUID="f90aa112-94f0-19a4-053b-a1e9d949eb6d" UUID_SUB="e1aaa6e3-7a01-922e-8277-ba9b0e66aef0" LABEL="openmediavault:127" TYPE="linux_raid_member"
/dev/md127: UUID="f90aa112-94f0-19a4-053b-a1e9d949eb6d" UUID_SUB="39b1b7c6-b5d1-c17e-8a40-719d0e94eccd" LABEL="openmediavault:127" TYPE="linux_raid_member"

Code

root@openmediavault:~# fdisk -l


WARNING: GPT (GUID Partition Table) detected on '/dev/sdb'! The util fdisk doesn't support GPT. Use GNU Parted.


Disk /dev/sdb: 3000.6 GB, 3000592982016 bytes
256 heads, 63 sectors/track, 363376 cylinders, total 5860533168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disk identifier: 0x00000000


   Device Boot      Start         End      Blocks   Id  System
/dev/sdb1               1  4294967295  2147483647+  ee  GPT
Partition 1 does not start on physical sector boundary.


WARNING: GPT (GUID Partition Table) detected on '/dev/sdc'! The util fdisk doesn't support GPT. Use GNU Parted.


Disk /dev/sdc: 3000.6 GB, 3000592982016 bytes
256 heads, 63 sectors/track, 363376 cylinders, total 5860533168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disk identifier: 0x00000000


   Device Boot      Start         End      Blocks   Id  System
/dev/sdc1               1  4294967295  2147483647+  ee  GPT
Partition 1 does not start on physical sector boundary.


WARNING: GPT (GUID Partition Table) detected on '/dev/sdd'! The util fdisk doesn't support GPT. Use GNU Parted.


Disk /dev/sdd: 3000.6 GB, 3000592982016 bytes
256 heads, 63 sectors/track, 363376 cylinders, total 5860533168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 4096 bytes / 4096 bytes
Disk identifier: 0x00000000


   Device Boot      Start         End      Blocks   Id  System
/dev/sdd1               1  4294967295  2147483647+  ee  GPT
Partition 1 does not start on physical sector boundary.


Disk /dev/sda: 60.0 GB, 60022480896 bytes
255 heads, 63 sectors/track, 7297 cylinders, total 117231408 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x000945a0


   Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *        2048   112383999    56190976   83  Linux
/dev/sda2       112386046   117229567     2421761    5  Extended
/dev/sda5       112386048   117229567     2421760   82  Linux swap / Solaris


Disk /dev/md127: 6000.9 GB, 6000914464768 bytes
2 heads, 4 sectors/track, 1465067008 cylinders, total 11720536064 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 4096 bytes
I/O size (minimum/optimal): 524288 bytes / 1048576 bytes
Disk identifier: 0x00000000


Disk /dev/md127 doesn't contain a valid partition table
root@openmediavault:~#

Alles anzeigen

Has anyone a idea for this, or is it totally crashed.

ryecoaaron · 4. Juni 2015

The array looks fine now. The data is most likely gone because the fresh array does not have a filesystem on it anymore.

Jetzt mitmachen!