Beiträge von pinoLorentz

    I just added two seagate 8TB ironwolfs to my NAS. I'm seeing a huge number of ECC recovery/Raw read error rate on both drives. Did I get a couple lemons? Should I return these drives? This is with 91 hours total power on hours!


    Compare this to my WD that's ~1.5 year old with 0 raw read error rate




    BTW to help anyone searching on google: Installing RTL8125B drivers on Odroid h2+ which, for now, requires manual installation. Plug in a usb -> ethernet card temporarily to DL/install stuff:


    Code
    wget https://github.com/awesometic/realtek-r8125-dkms/archive/master.zip -O realtek-8125-dkms.zip
    sudo apt install make
    sudo apt install build-essential
    sudo apt install unzip
    apt-get install dkms
    apt install linux-headers-$(uname -r)
    unzip realtek-8125-dkms.zip
    cd realtek-8125-dkms
    sudo ./autorun.sh


    Then it should show up in 'ip a' - go to the webpage (still using a usb nic) and setup network profiles for the newly installed nics.

    Hi,


    Background

    I built a nas a while back on a budget - 20$ for rock64+sd+psu from ebay. With a 8TB HDD and a second 8TB HDD with the usb backup plugin to rsync the drives whenever i felt like plugging in the backup. Pretty solid setup - could reliably hit 100+MB/sec on transfers.


    Recently (~2 years later from initial setup) i discovered that some of my movies wouldn't play or would have artifacts that i knew weren't present in the past. Some of the rsynced backup data is fine as i believe it only syncs off of timestamps and not checksums, but i have no idea when the primary drive started corrupting data or what exact data is corrupted.... thankfully i did generate an md5 of all files a long time back, so that's a start... i'll need to write some code to dig into this.


    I started digging into SnapRaid as i could still use it with a pi4 or something i had onhand, and i could just buy another HDD and use as parity. After playing around I ran into some concerns


    Questions/Concerns


    SnapRaid works with USB drives, but guides suggest setting up a scheduled 'snapraid sync'. Seems like snapraid doesn't have knowledge of 'file actions' and will blindly sync and re-compute checksums on whatever the storage drives spit out. The only way to detect silent corruption or potentially bit rot is to run a diff, review the results and review all file differences, then either sync or rebuild data.


    I'm looking for something that runs 'live' where parity is updated per file, per file action. So if i transfer a file to the NAS, then the nas generates parity for that file - not rebuild the entire parity for the whole SSD. Also i'd like something that runs transparently (obviously i'd like to know if a drive is corrupting data).


    Is there anything that fits this description? I'm thinking the RAID 5 option would fit? Does OMV 'raid 5' use a software raid? This would require me to get a full computer with SATA and a couple more disks which I was hoping to avoid... At this point I'm thinking i need to get something more professional.


    To help someone in a similar predicament:

    Word of the wise - it's a very good idea to run a find and log an md5 of all files on your nas. Even with raid5 I've heard some horror stories long back (2005) of non protocol conforming hardware raid5 doing wonky stuff.


    Finding problems with video files - Let's say you don't know what an MD5 should be, you can still run this and see if the video file has 'problems'. Problem with doing this is that even good video files can still have missing frames here and there ;(. But if you get 100+ errors in a single video file - that's a red flag.