90 hours to resilver 6x2TB drives in Z2?

vulcan4d · 28. Dezember 2018

I use ZFS and moved from a 2x4TB Mirror ZFS to a 6x2TB Z2 configuration. After moving my data I noticed that it's trying to resilver and the estimated time is 90 hours. I have about 4.5GB of actual data on it right now. It seems a little excessive. Would anyone comment as whether this speed is normal or whether this is slower than normal? I'm using a Dell H200 Raid Controller flashed with v20 LSI firmware in IT mode.

Code

tatus: One or more devices is currently being resilvered.  The pool will
	continue to function, possibly in a degraded state.
action: Wait for the resilver to complete.
  scan: resilver in progress since Fri Dec 28 01:29:16 2018
	169G scanned out of 7.37T at 23.0M/s, 91h25m to go
	53.8G resilvered, 2.24% done
config:


	NAME                                 STATE     READ WRITE CKSUM
	store1                               ONLINE       0     0     0
	  raidz2-0                           ONLINE       0     0     0
	    ata-ST2000LM007-1R8174_WDZ9JM94  ONLINE       0     0     0
	    ata-ST2000LM007-1R8174_WDZ60MMX  ONLINE       0     0     0
	    ata-ST2000LM007-1R8174_WDZ77P8L  ONLINE       0     0     0
	    ata-ST2000LM007-1R8174_WDZ1KKQW  ONLINE       0     0     0
	    ata-ST2000LM007-1R8174_WDZ8114Q  ONLINE       0     0     0  (resilvering)
	    ata-ST2000LM007-1R8174_WDZ6X637  ONLINE       0     0     0  (resilvering)

Alles anzeigen

tkaiser · 28. Dezember 2018

RAID-Z on Linux has some drawbacks. You might want to do a web search for 'zfs sequential resilvering'.

brando56894 · 31. Dezember 2018

I'm currently resilvering my RAIDZ2, upgrading from 4 TB drives to 6 TB drives. I have 2 six device VDEVs, so my filesystem is larger than yours at about 55 TiB raw and about 35 TiB used, and it only takes about 24 hours. I'm using an LSI 4 port HBA, I forget what model though.

Code

[bran@mediavault ~]$ zpool status
pool: storage


 state: DEGRADED


status: One or more devices is currently being resilvered.  The pool will


        continue to function, possibly in a degraded state.


action: Wait for the resilver to complete.


  scan: resilver in progress since Fri Dec 28 23:04:49 2018


        32.5T scanned out of 39.9T at 743M/s, 2h54m to go


        2.30T resilvered, 81.43% done


config:




        NAME                                            STATE     READ WRITE CKSUM


        storage                                         DEGRADED     0     0     0


          raidz2-0                                      ONLINE       0     0     0


            wwn-0x50014ee263fd8e58                      ONLINE       0     0     0


            wwn-0x50014ee26403e7ad                      ONLINE       0     0     0


            wwn-0x50014ee20ead73ff                      ONLINE       0     0     0


            wwn-0x50014ee263fd8ed8                      ONLINE       0     0     0


            wwn-0x50014ee2640297d6                      ONLINE       0     0     0


            wwn-0x50014ee2b9589a3c                      ONLINE       0     0     0


          raidz2-1                                      DEGRADED     0     0     0


            wwn-0x50014ee265e1bde5                      ONLINE       0     0     0


            wwn-0x50014ee265e1c809                      ONLINE       0     0     0


            wwn-0x5000cca24ce4760c                      ONLINE       0     0     0


            wwn-0x5000cca23ddd8b24                      ONLINE       0     0     0


            replacing-4                                 ONLINE       0     0     0


              wwn-0x5000cca24ce164c4                    ONLINE       0     0     0


              ata-WDC_WD60EFRX-68L0BN1_WD-WX11D68HX10L  ONLINE       0     0     0  (resilvering)


            11187314946580929058                        UNAVAIL      0     0     0  was /dev/sdj1


        logs


          wwn-0x55cd2e404c1198be                        ONLINE       0     0     0




errors: No known data errors

Alles anzeigen

It usually starts off slow, but then picks up speed as it gets deeper in. It's no uncommon for me to see it say in excess of 150 hours when it starts off, but within an hour or two it usually drops down to around 25-30 hours, which is normal for RAIDZ. (Striped) Mirrors only take a few hours to resilver.

Jetzt mitmachen!