ZFS Scrub problem

CATAHA · Apr 14th 2024

Good day members.

After recent update I'm unable to perform scrub on ZFS on two small NAS systems

I on both NAS Boxes i tried rebooting, i tried deferent browser and still unable to perform it

I got message that one disk is bad on one box right after i attempted starting scrub and on NAS_#_2 there are not problem with ZFS but i get same response

ANY HELP

Thanks

Here is what i get as message,

Code

Failed to execute command 'export PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin; export LANG=C.UTF-8; export LANGUAGE=; zpool scrub "Z1"' with exit code '1': 

OMV\ExecException: Failed to execute command 'export PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin; export LANG=C.UTF-8; export LANGUAGE=; zpool scrub "Z1"' with exit code '1':  in /usr/share/php/openmediavault/system/process.inc:247
Stack trace:
#0 /usr/share/omvzfs/Utils.php(449): OMV\System\Process->execute()
#1 /usr/share/omvzfs/Zpool.php(373): OMVModuleZFSUtil::exec()
#2 /usr/share/openmediavault/engined/rpc/zfs.inc(611): OMVModuleZFSZpool->scrub()
#3 [internal function]: OMVRpcServiceZFS->scrubPool()
#4 /usr/share/php/openmediavault/rpc/serviceabstract.inc(122): call_user_func_array()
#5 /usr/share/php/openmediavault/rpc/rpc.inc(86): OMV\Rpc\ServiceAbstract->callMethod()
#6 /usr/sbin/omv-engined(535): OMV\Rpc\Rpc::call()
#7 {main}

  

 Pool status (zpool status):


  pool: Z1

 state: DEGRADED

status: One or more devices are faulted in response to persistent errors.

    Sufficient replicas exist for the pool to continue functioning in a

    degraded state.

action: Replace the faulted device, or use 'zpool clear' to mark the device

    repaired.

  scan: scrub in progress since Sun Apr 14 07:19:48 2024

    1.76T scanned at 474M/s, 1.63T issued at 439M/s, 1.76T total

    0B repaired, 92.52% done, 00:05:14 to go

config:


    NAME                                            STATE     READ WRITE CKSUM

    Z1                                              DEGRADED     0     0     0

      raidz1-0                                      DEGRADED     0     0     0

        ata-ST2000DL003-9VT166_######             ONLINE       0     0     0

        ata-ST2000DM001-9YN164_######             ONLINE       0     0     0

        ata-Hitachi_HDS723020BLA642_MN######  FAULTED     82     0     1  too many errors

        ata-ST2000DM001-9YN164_######             ONLINE       0     0     0

Display More

Krisbee · Apr 14th 2024

What's the version of OMV & output of "zfs -V" at CLI. What was the update? Does the scrub reach 100% & complete on NAS_#_2?

CATAHA · Apr 14th 2024

Code

$ zfs -V
zfs-2.1.11-1
zfs-kmod-2.1.11-1
$ zpool replace Z1 ata-ST2000DM001-1CH164_#####
cannot open '/dev/disk/by-id/ata-ST2000DM001-1CH164_######': Permission denied
cannot replace ata-ST2000DM001-1CH164_Z1E727QX with ata-ST2000DM001-1CH164_#######: permission denied
$ zpool replace Z1 1193200083042633166 ata-ST2000DM001-1CH164_####
cannot open '/dev/disk/by-id/ata-ST2000DM001-1CH164_######': Permission denied
cannot replace 1193200083042633166 with ata-ST2000DM001-1CH164_#####: permission denied
$ zpool replace Z1 ata-Hitachi_HDS723020BLA642_MN1220F30JZRRD-part1 ata-ST2000DM001-1CH164_#####
cannot open '/dev/disk/by-id/ata-ST2000DM001-1CH164_######': Permission denied
cannot replace ata-Hitachi_HDS723020BLA642_MN1220F30JZRRD-part1 with ata-ST2000DM001-1CH164_#######: no such device in pool

Display More

I looked around and found another disk on shelf,

Installed it tried adding it (ZFS > Pools > Expand > Pool_NAME_Z1 > Basic > Device_ANOTHER_HDD > By ID > Force Creation > Scrub

When i tried to add a disk via logical way

Selecting Existing Pool, Raid-Config, Blank_Disk, and then OMV DOES NOT ALLOW because it was saying that i had to have minimum of 3 disks available

and now this is what i have (Check Code).....

" I " think it would be VARY nice if it was made MUCH MUCH MUCH easier just to have FEW more option available via GUI

ZFS > Pool > Disks > Offline(for the disk #) >

shutdown NAS,

Uninstall/Reinstall Disk,

Power-up NAS,

ZFS > Pool > Disks > Offline_DISK > Add to Pool > Rebuild

I just honestly DO NOT understand how this GUI works, because you got to go 2~4 other places to get it working instead of one single place....(check my POORLY developed picture)

Code

pool: Z1

 state: DEGRADED

status: One or more devices could not be used because the label is missing or

    invalid.  Sufficient replicas exist for the pool to continue

    functioning in a degraded state.

action: Replace the device using 'zpool replace'.

   see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-4J

  scan: scrub in progress since Sun Apr 14 10:28:27 2024

    1.34T scanned at 1.99G/s, 279G issued at 414M/s, 1.76T total

    0B repaired, 15.49% done, 01:02:43 to go

config:


    NAME                                 STATE     READ WRITE CKSUM

    Z1                                   DEGRADED     0     0     0

      raidz1-0                           DEGRADED     0     0     0

        ata-ST2000DL003-9VT166_#####  ONLINE       0     0     0

        ata-ST2000DM001-9YN164_#####  ONLINE       0     0     0

        1193200083042633166              UNAVAIL      0     0     0  was /dev/disk/by-id/ata-Hitachi_HDS723020BLA642_MN1220F30JZRRD-part1

        ata-ST2000DM001-9YN164_#####  ONLINE       0     0     0

      ata-ST2000DM001-1CH164_#####    ONLINE       0     0     0

Display More

Quote from Krisbee

What's the version of OMV & output of "zfs -V" at CLI. What was the update? Does the scrub reach 100% & complete on NAS_#_2?

Krisbee · Apr 14th 2024

At the CLI:

Code

zfs replace Z1 1193200083042633166 ata-ST2000DM001-1CH164_Z1E727QX

CATAHA · Apr 14th 2024

Just when i though live can't get any better i got this

Code

Failed to execute command 'export PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin; export LANG=C.UTF-8; export LANGUAGE=; zpool import -a 2>&1' with exit code '1': cannot import 'Z1': no such pool or dataset
Destroy and re-create the pool from
a backup source.


OMV\ExecException: Failed to execute command 'export PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin; export LANG=C.UTF-8; export LANGUAGE=; zpool import -a 2>&1' with exit code '1': cannot import 'Z1': no such pool or dataset
Destroy and re-create the pool from
a backup source. in /usr/share/php/openmediavault/system/process.inc:247
Stack trace:
#0 /usr/share/omvzfs/Utils.php(449): OMV\System\Process->execute()
#1 /usr/share/openmediavault/engined/rpc/zfs.inc(224): OMVModuleZFSUtil::exec()
#2 [internal function]: OMVRpcServiceZFS->importPool()
#3 /usr/share/php/openmediavault/rpc/serviceabstract.inc(122): call_user_func_array()
#4 /usr/share/php/openmediavault/rpc/rpc.inc(86): OMV\Rpc\ServiceAbstract->callMethod()
#5 /usr/sbin/omv-engined(535): OMV\Rpc\Rpc::call()
#6 {main}

Display More

Quote from Krisbee
At the CLI:
Code
zfs replace Z1 1193200083042633166 ata-ST2000DM001-1CH164_Z1E727QX

Krisbee · Apr 14th 2024

Quote from CATAHA

I looked around and found another disk on shelf,
Installed it tried adding it (ZFS > Pools > Expand > Pool_NAME_Z1 > Basic > Device_ANOTHER_HDD > By ID > Force Creation > Scrub
When i tried to add a disk via logical way
Selecting Existing Pool, Raid-Config, Blank_Disk, and then OMV DOES NOT ALLOW because it was saying that i had to have minimum of 3 disks available
and now this is what i have (Check Code).....

Why would you think a zfs "Expand" command via the WebUI had anything to do with replacing a failed disk? There is no ability to replace a failed disk via the WebUi, the CLI has to be used. The WebUI/CLI will not prevent you from making administrative mistakes. What is the current state of your pool?

CATAHA · Apr 14th 2024

Statues of ZFS Pool = ZERO

I installed another used HDD,

Trying via GUI adding another disk, i was not successful

I used CLI there i was not success either

I rebooted and ZFS Pool was no longer visible via GUI or CLI nor i was able to import as i did before in an older version of OMV when i lost system drive.

I Uninstalled ZFS Option on OMV and Installed Multiple Device option and now i'm in process of creating RAID 5,

once i'm done creating RAID_5, i'll try to simulate failure of 1 drive and add another one to see how that will work.

I'll also start looking for another solution to be a bullet-prof with less hassles when it comes to replacing failed disk(s) (similar to DROBO when i had it LONG time ago). That WON'T use ZFS,, That would be PLUG-N-PLAY, able to work with different brands of disks and sizes.

Thanks For you help mate

Why would you think a zfs "Expand" command via the WebUI had anything to do with replacing a failed disk? There is no ability to replace a failed disk via the WebUi, the CLI has to be used. The WebUI/CLI will not prevent you from making administrative mistakes. What is the current state of your pool?

ZFS Scrub problem

Participate now!

Similar Threads

ZFS Plugin: there are some changes every time I open "Pools" tab

Btrfs, mergerfs, snapraid and shared folders

less than 30 Mb/s ZFS Raidz2 - Analyze

KVM, ZFS and backport

creating shared "subdirectory" gives error but works. (possible bug?)

OMV6 problems with 'RRDCached' errors and attempted scrub yields '500 - Internal Server Error'

Tags