[HowTo] SnapRAID in OMV

  • Does one need to enable "Run Scrub - Set to true if you want to scrub after a successful sync" in order for the options "Scrub Frequency" and "Scrub Percentage" to take effect? The option sounds like it will run regardless of the set scrub frequency but the SnapRAID logs say "Array scrubbing is not enabled" so should it be enabled or not?

  • Hello all!


    is it a regular behavior of snapraid, that it runs the sheduled sync-job or the sheduled diff-script-job for exactly one hour and produces one notificationmail every single minute? I allways receave about 59 emails just because of snapraid. The result is, that I actually don't notice my notificationmails anymore...


    I've had this behavior already in OMV 2: Had a sheduled sync running, because I wasn't aware of the diff-script. After upgrade to OMV 4 I found the same behavior as I sheduled the sync like bevore and now - since i'm aware of the sence and function of the diff-script - i find in different style the same: 59 emails over one hour.


    I have only one sheduled snapraid job as far as i can see in Web-Gui and there was no snapraid-process running bevor the sheduled job started.


    Contend is almost the same in every email:




    the first mail had an additional line after DEL_TRESHOLD: 100

    Code
    [2019-05-01 04:01:02] omv-snapraid-diff: INFO: ''/tmp/snapraid/snapraid.out' deleted - creating a new one'

    all other mails have equal content like quoted above.


    Strange is also, that I've done file-changes for testing. But EVERY email reports ZERO file-changes!


    Not so the /var/log/snapraid.log. It seems to mainly have the same content as the mails have (hard to exactly check) BUT will after 2 times of reporting ZERO changes at the beginning (Minute 01:04) report a

    Code
    [2019-05-01 04:02:33] omv-snapraid-diff: INFO: 'SUMMARY of changes since last sync:'
    [2019-05-01 04:02:33] omv-snapraid-diff: INFO: 'Added: [26] - Deleted: [0] - Moved: [4] - Copied: [0] - Updated: [6]'
    [2019-05-01 04:02:33] omv-snapraid-diff: DEBUG: 'Pre-Hash option:  --pre-hash'
    [2019-05-01 04:02:33] omv-snapraid-diff: INFO: 'Changes detected [A-26,D-0,M-4,C-0,U-6] -> deleted files (
    T) is below threshold (100). Running SYNC Command.'
    [2019-05-01 04:02:33] omv-snapraid-diff: INFO: 'SnapRAID SYNC Job started'

    that corresponds to what I changed bevor AND would be the Information I'd like to see in one notificationmail. But i have not receaved a mail telling me that changes have been dedected and computed.



    After one hour I don't receave further mails and also the /var/log/snapraid.log gets no further entry but the snapraid-process still runs. Maybe because of the 5% scrub??



    edit:
    seems to be so...

    Code
    [2019-05-01 04:59:01] omv-snapraid-diff: INFO: 'SUMMARY of changes since last sync:'
    [2019-05-01 04:59:01] omv-snapraid-diff: INFO: 'Added: [0] - Deleted: [0] - Moved: [0] - Copied: [0] - Updated: [0]'
    [2019-05-01 04:59:01] omv-snapraid-diff: DEBUG: 'Pre-Hash option:  --pre-hash'
    [2019-05-01 04:59:01] omv-snapraid-diff: INFO: 'No change detected. Nothing to do'
    [2019-05-01 04:59:01] omv-snapraid-diff: INFO: 'SnapRAID Job ended.'
    [2019-05-01 09:24:07] omv-snapraid-diff: INFO: '----------------------------------------'
    [2019-05-01 09:24:07] omv-snapraid-diff: INFO: 'SnapRAID SCRUB Job finished'
    [2019-05-01 09:24:07] omv-snapraid-diff: INFO: 'Full statusreport sent to '''
    [2019-05-01 09:24:07] omv-snapraid-diff: INFO: 'SnapRAID Job ended.'

    now the snapraid-process is also stopped (disappeared)


    would be nice to receave the "full statusreport" after successfull scrub instead of the 59 similar mails above! Is there any way to do that?
    /edit



    Anyone here to tell me if that is all normal or what i maybe did wrong?
    Thank you!

  • After obversation over a couple of days I have to add:



    there are Status-mails at the end after finishing the scrub-job!
    they obviousliy were delivered too late on my system due to unkown external reasons (provider unreachable, ore whatever)...




    1.) there's a Status-mail simply informing me about: [NAS.local] SnapRAID - Sync/Srub Job COMPLETED


    2.) there's further more a mail informing me about Data errors found during the job (the .xls problem in my case)


    3.) and there's a Status-mail containing all Information that has been already send in the again 59 mails before and a bit more (the amount of changed files for example!!!)




    So everything would be great if there's a possibility to stop the system sending 59 simmilar mails during exactly one hour after beginning the shedulled diff-scribt-job.
    I've read from a couple of poeple who complained about that the Statusmail is a bit spamy. I understood, that they talked about ONE mail containing too much Information.




    Does somebody have the same behavior with 59 mails in the first hour?
    Is there a way to stop that?




    Thank you!

  • I have two 8TB drives that I would like to use with Snapraid. My understanding is one drive can be content and data while the other can be parity. That is how I believe they should be configured. As setup in Snapraid OMV plugin, does this seem like a good configuration?

    • Offizieller Beitrag

    My understanding is one drive can be content and data while the other can be parity.

    The typical setup is 1 parity drive to 2 or 3 data drives. However, what you're proposing will work but note,, without at least one copy of the content file, there's no recovery. So, if the content file is on the data disk only, and the data disk dies, there's no recovery.


    If you're going with 2 drives (1 data + 1 parity), you'll need to put a content file on the parity drive. In fact, it's a good idea to put a copy of the content file on all drives.

  • I have two 8TB drives that I would like to use with Snapraid. My understanding is one drive can be content and data while the other can be parity. That is how I believe they should be configured. As setup in Snapraid OMV plugin, does this seem like a good configuration?

    Like crashtest said, this will work but make sure you have a copy of the content file on both drives. Why do snapraid with only 2 drives? Do you plan to add additional drives in the future?

  • Like crashtest said, this will work but make sure you have a copy of the content file on both drives. Why do snapraid with only 2 drives? Do you plan to add additional drives in the future?


    Well, I have two 8TB drives and what I want to do is combine them, with hopefully some raid config as a backup. The data on one of the 8TB is already being backed up.


    I thought we could have 1 drive data and another as parity? Is there some better way in Snapraid, or another OMV plugin, to get it working?

  • Well, I have two 8TB drives and what I want to do is combine them, with hopefully some raid config as a backup. The data on one of the 8TB is already being backed up.


    I thought we could have 1 drive data and another as parity? Is there some better way in Snapraid, or another OMV plugin, to get it working?

    Having only two drives and wanting to "combine" them is inconsistent with SnapRaid, but this does depend on what you mean by "combine" which you are not making clear here.


    You can have one drive as data and one drive as parity on SnapRaid, but this doesn't "combine" them.

    --
    Google is your friend and Bob's your uncle!


    OMV AMD64 7.x on headless Chenbro NR12000 1U 1x 8m Quad Core E3-1220 3.1GHz 32GB ECC RAM.

    Einmal editiert, zuletzt von gderf ()

    • Offizieller Beitrag

    Why do snapraid with only 2 drives?

    I tested it one time, in a two drive setup, just to see if it would work. (It did.)
    The only reason I could come up with for using 2 disk SNAPRAID, would be for bit rot protection. Also SNAPRAID, and a simple filesystem like EXT4, will work reasonably well with USB connected drives.


    (Setting bit rot protection aside, which is a big deal in itself, creating a simple mirror with Rsync provides roughly the same benefits.)

  • I tested it one time, in a two drive setup, just to see if it would work. (It did.) The only reason I could come up with for using 2 disk SNAPRAID, would be for bit rot protection. Also SNAPRAID, and a simple filesystem like EXT4, will work reasonably well with USB connected drives.


    (Setting bit rot protection aside, which is a big deal in itself, creating a simple mirror with Rsync provides roughly the same benefits.)

    I agree Crashtest. Bit rot protection would be the major benefit. Also with Snapraid it's very easy to add addtional data drives and parity drives in the future, so if 2 drives were only the beginning with future plans for expansion that makes sense.


    Are they USB drives? Personally I would not use USB unless I was fully backed up elsewhere and 100% OK with losing the data on the USB drives.

    • Offizieller Beitrag

    Well, I have two 8TB drives and what I want to do is combine them, with hopefully some raid config as a backup. The data on one of the 8TB is already being backed up.

    What platform are you running? Is it ARM or X86?


    A close RAID equivalent is SNAPRAID+UnionFS. Actually, this combination is superior to RAID5 in many ways, and includes bit rot protection.
    (BTW: The UnionFS plugin is actually mergerfs.)
    _______________________________________________________


    What is the storage requirement? How much do you need?

  • I don't think /etc/default/snapraid is a valid file. I don't have one here.

    --
    Google is your friend and Bob's your uncle!


    OMV AMD64 7.x on headless Chenbro NR12000 1U 1x 8m Quad Core E3-1220 3.1GHz 32GB ECC RAM.

    Einmal editiert, zuletzt von gderf ()

    • Offizieller Beitrag

    What is the right way to override the default exclude list? Should this be done in /etc/default/snapraid?


    The path is /etc/snapraid.conf


    Universal excludes can be done there.
    ____________________________________


    It's also possible in the GUI as follows:



    (In this case, I chose a protected drive and excluded *.tmp files.)

  • The path is /etc/snapraid.conf

    This file is auto generated and should not be edited - right?
    My goal was to override (or get rid of) default exclude *.bak - how can I do that?
    Thank you for pointing me to Rules tab, but that will not help in my case - a new user rule will be added after the existing system or default rules and according to the manual, "Previous rules have the precedence over the later ones"


    I can edit /usr/share/openmediavault/mkconf/snapraid and comment the unnecessary exclude line, but don't think it's the right way.

    • Offizieller Beitrag

    how can I do that?

    You can't unless an include line would override the exclude. Never tried.


    I can edit /usr/share/openmediavault/mkconf/snapraid and comment the unnecessary exclude line, but don't think it's the right way.

    That is fine but the change will be overwritten by updates.

    omv 7.0.4-2 sandworm | 64 bit | 6.5 proxmox kernel

    plugins :: omvextrasorg 7.0 | kvm 7.0.10 | compose 7.1.2 | k8s 7.0-6 | cputemp 7.0 | mergerfs 7.0.3


    omv-extras.org plugins source code and issue tracker - github


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

    • Offizieller Beitrag

    The path is /etc/snapraid.conf
    Universal excludes can be done there.

    My regrets, @'AndrewZ'
    I meant to test this yesterday, but got busy. When the first "on demand" update is triggered, changes at this location are wiped.

Jetzt mitmachen!

Sie haben noch kein Benutzerkonto auf unserer Seite? Registrieren Sie sich kostenlos und nehmen Sie an unserer Community teil!