Newbie trying to build a little NAS for family photos

    • Newbie trying to build a little NAS for family photos

      After operating two external drives on my Asus Chromebox for some years, I recently discovered that (at least) one of them is having bad sectors. Since I don't want to jeopardise my digital family memories, I want to switch to a more robust setup with OMV on the Chromebox and two 2 TB Ironwolfs in an external Icy Box case. Since I am new to the OMV family, I appreciate any hints or advice to my planned setup. OMV4 is already installed on the Chromebox and I have made the first steps with it (the HDDs were not yet delivered).

      My plan is to operate the two HDDs separately (i.e. no RAID), writing to disk A and rsync the files to disk B as a backup. I also plan on regularly making an off-site backup to an external volume. I would prefer to let rsync run without --delete flag to avoid any loss due to accidental deletion on drive A.

      In the beginning I was thinking about a RAID 1 setup, but apart from the photos I also automatically copy recordings from TV (from my cable receiver) to drive A , which are then directly uploaded to the cloud and deleted after upload from the drive. So these files do not need to be mirrored and mirroring them only increases writings without any purpose in my opinion. Future usage might change, but currently this is what is planned.

      As file system for the discs I thought about keeping things simple using ext4 on both drives, but I have no experience with the other formats (XFS, ZFS, BTRFS) and if they offer any advantages in my case.

      So if you have any comments/hints on my setup please let me know. If I posted in the wrong section, please move to a more appropriate area.
    • I think your plans sounds excellent. Go for it!

      Using two separate drives, one for shared data and one for rsync backups/snapshots, is a simple and very robust setup.

      If you want to improve the security further you could store the most important images in RAR-archives with the archive protection feature activated. Or use some utility to calculate a checksum for a subfolder and check for changes.

      Another (future?) option is the not only have two separate drives but even two separate NAS. At different locations.
      OMV 4: 7 x Odroid HC2 + 1 x HC1 + 2 x RPi4
    • Thank you both, so be it :)
      I will have a look at rsnapshot. haven't heard of that yet. Sounds well suited for my case as it seems.

      One question about that Icy box encasing (IB-RD3621U3): if I understood correctly, this case also has a RAID controller on board, the settings RAID 0, 1, Single or JBOD/Big can be set with a jumper-linke setup (raidsonic.de/products/external…x_de.php?we_objectID=3589). If I would want to use any of the RAID settings of the drive, how would that needed to be addressed in OMV? I wouldn't set a software RAID on top, would I?
    • If you setup the dual drive cabinet for RAID 1 it will appear in OMV as one single drive. And you won't have to do anything special in OMV.

      If you setup the dual drive cabinet for JBOD then you could either use each disk separately or configure a software RAID. However, since both drives use the same USB cable, performance would be lower with software RAID in OMV.

      But if you setup RAID in the cabinet, if something goes wrong with the cabinet itself, you might loose all data unless you can get a new identical cabinet.

      You could also (if you know how) set it up with btrfs RAID1. That would allow for automatic bitrot protection. But perhaps with low performance since both drives are on the same cable.

      However, OMV doesn't support software RAID over USB, so you would have to set it up yourself from the command line.

      One potential problem with the IB cabinet is that the specs states that it is only compatible with Windows and Mac OS X. That doesn't sound nice. It might still support Linux, but perhaps with very low performance? Or it might work perfectly fine with OMV and Linux, only it hasn't been tested? I don't know. I wouldn't buy it for use with OMV/Linux...

      I use a similar cabinet for one of my RPi4, but from StarTech. It is speced as "OS independent" and I know for a fact that it works fine with OMV on my RPi4. I have it setup for JBOD with two separate independent HDDs. I use it with two old 8TB Archival SMR HDDs for secondary "cold" backups. That is, an extra set of snapshot copies of my most important stuff. I update it only only if needed. Perhaps monthly. It is mostly shut down.

      About rsync and rsnapshot, and my rsync script...

      Snapshots using rsync lets you create backup copies that look just like a full copy of the original. But instead of copying every single file, rsync can identify unchanged files and then "hardlink" to a previous identical copy of the same file. This means that each snapshot consists of a bunch of folders with hardlinks and the occasional updated or new file. It is much faster to create a snapshot like this and it takes up very little storage.

      This means that you can have two similar sized HDDs and use one for shared data and one for backup snapshot. And each snapshot is (appears as) a time-stamped full copy of the original.

      The plugin rsnapshot supports this form of snapshots. it allows you to snapshot shared folders.

      But I prefer to do this outside OMV using cron and my own snapshot script. Typically I use a couple of scripts, on for each major subfolder on the original HDD. For instance one script for music, one for ebooks, one for tv and one for movies.

      github.com/WikiBox/snapshot.sh
      OMV 4: 7 x Odroid HC2 + 1 x HC1 + 2 x RPi4

      The post was edited 2 times, last by Adoby ().

    • RAID increases the chance of loosing data (vs separate drive you backup to). Go with using the separate backup drive.

      QUESTION: Has anyone tried the Borg Backup OMV Plug-in? (OPENMEDIAVAULT-BORGBACKUP) I can't find any information or guide or example on how to use it anywhere.
    • Newbie trying to build a little NAS for family photos

      Thanks Adoby for that long answer. The RAID setup was just for information. I will see if the case suits my purpose and if it doesn't work properly, I will send it back. It seems as I don't need the RAID function of the case anyway, but now it is ordered ;)

      How will the speed from one HDD to the other be in such a setup? I mean the files don't need to pass the USB bus twice, don't they? Since I don't copy to both HDDs simultaneously, speed won't be cut in half I hope.
    • Unfortunately I suspect that copying from one HDD to another in a dual USB HDD case will be slower than copying between two separate single USB HDD cases. I think the data has to pass twice through the cable... It might be possible to pass data full speed in two directions simultaneously over USB. Full duplex like a network card. I doubt it...

      But I haven't tested.

      However with regards to rsync snapshots this will only be a big problem for the first snapshot. That might take some extra time. Subsequent snapshots should be pretty fast since most files already are available for hardlinking. It should be fast enough, even at half speed, I think.

      I suspect that the speed of copying from one HDD to another in a dual HDD USB case will still be faster than copying from one NAS to another over GbE. So you should be fine.
      OMV 4: 7 x Odroid HC2 + 1 x HC1 + 2 x RPi4