I expose my really weird case to others power user to try to identify the problem.
I install and create a ZFS pool and notice estrange down on trhoughtput when cpoy my initial data ( about 6TB of movies), so I scrub the pool and meet this:
Pool status (zpool status):
pool: Rpool
state: ONLINE
status: One or more devices has experienced an error resulting in data
corruption. Applications may be affected.
action: Restore the file in question if possible. Otherwise restore the
entire pool from backup.
see: http://zfsonlinux.org/msg/ZFS-8000-8A
scan: scrub repaired 435M in 1h33m with 1 errors on Sun Mar 15 22:20:56 2015
config:
NAME STATE READ WRITE CKSUM
Rpool ONLINE 0 0 1
raidz1-0 ONLINE 0 0 36
ata-TOSHIBA_DT01ACA300_Z2P592PAS ONLINE 0 0 490
ata-TOSHIBA_DT01ACA300_Z2P4LS0GS ONLINE 0 0 357
ata-TOSHIBA_DT01ACA300_Z2P5909AS ONLINE 0 0 494
ata-TOSHIBA_DT01ACA300_Z2P58ZSAS ONLINE 0 0 320
raidz1-1 ONLINE 0 0 23
ata-TOSHIBA_DT01ACA300_63NZK2UGS ONLINE 0 0 452
ata-TOSHIBA_DT01ACA300_63NZKLSKS ONLINE 0 0 264
ata-TOSHIBA_DT01ACA300_63NZ4Z9GS ONLINE 0 0 513
ata-TOSHIBA_DT01ACA300_63QZR0TGS ONLINE 0 0 290
raidz1-2 ONLINE 0 0 107
ata-TOSHIBA_DT01ACA300_94OL4R2GS ONLINE 0 0 1,97K
ata-TOSHIBA_DT01ACA300_94OL4S4GS ONLINE 0 0 1,90K
ata-TOSHIBA_DT01ACA300_94OL228GS ONLINE 0 0 1,87K
ata-TOSHIBA_DT01ACA300_94OL343GS ONLINE 0 0 1,58K
errors: 1 data errors, use '-v' for a list
Alles anzeigen
so I suspect a RAM corruption and shutdown my NAS and boot a memtesrt Cd, all test was passed so no RAM problem.
my next test was to do a new scrub , this time I do not copy any file to the pool so I expect no more checksum error, surprise, more checksum errors where this time corrected:
Pool status (zpool status):
pool: Rpool
state: ONLINE
status: One or more devices has experienced an error resulting in data
corruption. Applications may be affected.
action: Restore the file in question if possible. Otherwise restore the
entire pool from backup.
see: http://zfsonlinux.org/msg/ZFS-8000-8A
scan: scrub repaired 315M in 1h33m with 1 errors on Mon Mar 16 18:56:51 2015
config:
NAME STATE READ WRITE CKSUM
Rpool ONLINE 0 0 1
raidz1-0 ONLINE 0 0 28
ata-TOSHIBA_DT01ACA300_Z2P592PAS ONLINE 0 0 300
ata-TOSHIBA_DT01ACA300_Z2P4LS0GS ONLINE 0 0 245
ata-TOSHIBA_DT01ACA300_Z2P5909AS ONLINE 0 0 267
ata-TOSHIBA_DT01ACA300_Z2P58ZSAS ONLINE 0 0 227
raidz1-1 ONLINE 0 0 17
ata-TOSHIBA_DT01ACA300_63NZK2UGS ONLINE 0 0 358
ata-TOSHIBA_DT01ACA300_63NZKLSKS ONLINE 0 0 206
ata-TOSHIBA_DT01ACA300_63NZ4Z9GS ONLINE 0 0 305
ata-TOSHIBA_DT01ACA300_63QZR0TGS ONLINE 0 0 223
raidz1-2 ONLINE 0 0 60
ata-TOSHIBA_DT01ACA300_94OL4R2GS ONLINE 0 0 1,41K
ata-TOSHIBA_DT01ACA300_94OL4S4GS ONLINE 0 0 1,15K
ata-TOSHIBA_DT01ACA300_94OL228GS ONLINE 0 0 1,59K
ata-TOSHIBA_DT01ACA300_94OL343GS ONLINE 0 0 1,32K
errors: 1 data errors, use '-v' for a list
Alles anzeigen
So something goes wrong whit my pool, my last test where to install a FreeNAS in a new boot disk and import the pool.
Import was sucessfull and I can configure SMB shares on FreeNAS and do a new scrub and susrprise no checksum errors:
root@RNAS] ~# zpool status
pool: Rpool
state: ONLINE
status: One or more devices has experienced an error resulting in data
corruption. Applications may be affected.
action: Restore the file in question if possible. Otherwise restore the
entire pool from backup.
see: http://illumos.org/msg/ZFS-8000-8A
scan: scrub in progress since Mon Mar 16 23:19:49 2015
272G scanned out of 4.61T at 845M/s, 1h29m to go
0 repaired, 5.75% done
config:
NAME STATE READ WRITE CKSUM
Rpool ONLINE 0 0 0
raidz1-0 ONLINE 0 0 0
da3p1 ONLINE 0 0 0
da0p1 ONLINE 0 0 0
da1p1 ONLINE 0 0 0
da2p1 ONLINE 0 0 0
raidz1-1 ONLINE 0 0 0
da7p1 ONLINE 0 0 0
da4p1 ONLINE 0 0 0
da5p1 ONLINE 0 0 0
da6p1 ONLINE 0 0 0
raidz1-2 ONLINE 0 0 0
ada5p1 ONLINE 0 0 0
ada4p1 ONLINE 0 0 0
ada3p1 ONLINE 0 0 0
ada6p1 ONLINE 0 0 0
Alles anzeigen
I copy a new amount of data by SMB and repeat a new scrub, and no errors are in checksum:
[root@RNAS] ~# zpool status -v
pool: Rpool
state: ONLINE
status: Some supported features are not enabled on the pool. The pool can
still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
the pool may no longer be accessible by software that does not support
the features. See zpool-features(7) for details.
scan: scrub repaired 0 in 1h32m with 0 errors on Wed Mar 18 00:06:21 2015
config:
NAME STATE READ WRITE CKSUM
Rpool ONLINE 0 0 0
raidz1-0 ONLINE 0 0 0
da3p1 ONLINE 0 0 0
da0p1 ONLINE 0 0 0
da1p1 ONLINE 0 0 0
da2p1 ONLINE 0 0 0
raidz1-1 ONLINE 0 0 0
da7p1 ONLINE 0 0 0
da4p1 ONLINE 0 0 0
da5p1 ONLINE 0 0 0
da6p1 ONLINE 0 0 0
raidz1-2 ONLINE 0 0 0
ada5p1 ONLINE 0 0 0
ada4p1 ONLINE 0 0 0
ada3p1 ONLINE 0 0 0
ada6p1 ONLINE 0 0 0
Alles anzeigen
My last test is to boot from OMV and import the pool, the pool was sucessfully imported, and do a new scrub ( remember that I do a previos scrub on FreeNAS and the pool was clear):
this time a new checksum errors appears:
Pool status (zpool status):
pool: Rpool
state: ONLINE
status: One or more devices has experienced an error resulting in data
corruption. Applications may be affected.
action: Restore the file in question if possible. Otherwise restore the
entire pool from backup.
see: http://zfsonlinux.org/msg/ZFS-8000-8A
scan: scrub repaired 5,05G in 5h0m with 2 errors on Thu Mar 19 20:33:16 2015
config:
NAME STATE READ WRITE CKSUM
Rpool ONLINE 0 0 2
raidz1-0 ONLINE 0 0 170
ata-TOSHIBA_DT01ACA300_Z2P592PAS ONLINE 0 0 3,82K
ata-TOSHIBA_DT01ACA300_Z2P4LS0GS ONLINE 0 0 6,70K
ata-TOSHIBA_DT01ACA300_Z2P5909AS ONLINE 0 0 4,04K
ata-TOSHIBA_DT01ACA300_Z2P58ZSAS ONLINE 0 0 5,57K
raidz1-1 ONLINE 0 0 189
ata-TOSHIBA_DT01ACA300_63NZK2UGS ONLINE 0 0 5,23K
ata-TOSHIBA_DT01ACA300_63NZKLSKS ONLINE 0 0 5,62K
ata-TOSHIBA_DT01ACA300_63NZ4Z9GS ONLINE 0 0 4,32K
ata-TOSHIBA_DT01ACA300_63QZR0TGS ONLINE 0 0 5,61K
raidz1-2 ONLINE 0 0 1,11K
ata-TOSHIBA_DT01ACA300_94OL4R2GS ONLINE 0 0 15,5K
ata-TOSHIBA_DT01ACA300_94OL4S4GS ONLINE 0 0 24,9K
ata-TOSHIBA_DT01ACA300_94OL228GS ONLINE 0 0 16,0K
ata-TOSHIBA_DT01ACA300_94OL343GS ONLINE 0 0 24,3K
errors: 2 data errors, use '-v' for a list
Pool details (zpool get all):
Alles anzeigen
So my questions are:
1 - why the same pool in the same hardaware have checksums errors with ZFS in OMV and do not have errors in FreeNAS?.
2 - If you have a ZFS pool , can you please do a scrub and post result ( I'll try to identify if this happens only to me or happenhs to others ZFS users).
Thanks.