Mergerfs question

    • OMV 3.x

    This site uses cookies. By continuing to browse this site, you are agreeing to our Cookie Policy.

    • Mergerfs question

      Hi!
      I have installed latest OMV and configured SnapRaid and MergerFS.
      I have an external harddisk which I have all of my backup stuff.
      So I started by creating an MergerFS pool and created an RSync Module pointing to a location on the pool.
      I then copied the files with Rsync from the external backup harddisk to the pool.
      I have a pool of four harddisk in the poo,, but it looks like only one of the harddisks was mostly used for the the files as now one of the drives is almost full while the other are not yet half full.
      Is this how it should be?
      Is there any command to adjust the imbalance and spread the files more evenly between the drives?

      Here is also a notice I get about this issue:

      Resource limit matched Service fs_srv_dev-disk-by-label-DISK1


      Date: Sat, 12 Aug 2017 05:40:22
      Action: alert
      Host: nas.dasilva.network
      Description: space usage 99.4% matches resource limit [space usage>85.0%]

      Regards,
      Cesar da Silva
    • No, I don't. Here is an ls of all of the drives including the Pool for referens.

      cesar@nas:/srv$ ls dev-disk-by-label-DISK1
      lost+found Media Nextcloud snapraid.parity Virtualbox
      cesar@nas:/srv$ ls dev-disk-by-label-DISK2
      Logs Media snapraid.conf.bak snapraid.content.lock
      lost+found snapraid.conf snapraid.content Virtualbox
      cesar@nas:/srv$ ls dev-disk-by-label-DISK3
      lost+found Media snapraid.conf snapraid.conf.bak snapraid.content
      cesar@nas:/srv$ ls dev-disk-by-label-DISK4
      Files lost+found OMV-Backup snapraid.conf snapraid.content tmp
      cesar@nas:/srv$ ls c908b475-65da-4325-ac82-1a48b8dcd4c6/
      Files Media snapraid.conf snapraid.content.lock Virtualbox
      Logs Nextcloud snapraid.conf.bak snapraid.parity
      lost+found OMV-Backup snapraid.content tmp
    • The way I understand it is that if your pool is "existing path most free space" files that are written to an existing path common to all pooled drives will be written to the drive with the most free space first.

      As the drive with the most free space begins to fill, one of the others will have more free space, and the writes will go there until another drive in the pool is the one that has the most free space. This would spread the files over the pooled drives such that they would all have about the same amount of free space.

      But this would not work unless the files being written were destined to a common path. And you say you don't have such a common path scenario.

      Maybe you should try another pool policy, such as "Most Free Space" instead.

      Of course I could be understanding megerfs incorrectly and if so, the above is all wrong and worthless.
      OMV 3.x - ASRock Rack C2550D4I - 16GB ECC - Silverstone DS380
    • gderf wrote:

      Maybe you should try another pool policy, such as "Most Free Space" instead.


      Of course I could be understanding megerfs incorrectly and if so, the above is all wrong and worthless.

      I'm no expert, but I think you are exactly right, and I chose "most free space" for the same reason when I set up my pool. Also, I THINK this will improve SnapRAID's performance as well. During a sync, data can be pulled from all populated drives and the speed will increase as a result. If most of your data is limited to one drive, most of your sync process will be limited by the speed of that single drive.

      Ex: 1 drive syncs at 110 MB/s, 5 drives sync at 5 x 110 MB/s = 550 MB/s
    • thunderlight1 wrote:

      Thank you for your replies.
      I was also thinking the same way you are, that it should save a file to the drive which has the most space available at that time.
      Is there a way now to have the files being distributed evenly between the drives automatically or do I need to recreate the pool from scratch?

      If you mean you want it to rebalance the existing files, I don't believe that MergerFS can do that. I'm no expert, though. Maybe look at the MergerFS documentation.
    • flvinny521 wrote:

      If you mean you want it to rebalance the existing files, I don't believe that MergerFS can do that. I'm no expert, though. Maybe look at the MergerFS documentation.
      There is a balance utility (I think) available on the mergerfs github but github is down right now.
      omv 4.0.6 arrakis | 64 bit | 4.12 backports kernel | omvextrasorg 4.1.0
      omv-extras.org plugins source code and issue tracker - github.com/OpenMediaVault-Plugin-Developers

      Please don't PM for support... Too many PMs!
    • Hi, this result is also the same result I have just experienced and clearly it is lack of knowledge that was the cause. Maybe a popup box to appear in the browser when choosing a policy, that explains the policy, would help?

      I do however have an additional problem.

      My OMV to OMV over SMB copy failed when a 40GB file was the last to fill a drive. It only had 11GB left on the drive. Yet it continued to copy anyway.
      Is this also user error? Due to the minimum free space?

      thanks in advance
      regards
      -----------------------------------------------------------------------------------------------------------------------------------------

      ext4 + snapRAID (≥2 parity) + mergerfs + Smart monitoring + spindown + UPS + Corsair AX psu and 1:1 backup

      recently successfully recovered from a double hard drive failure, hard drives were bought six years ago in a single purchase, still got a way to go as I bought 8 at the time.
      I know this because I wrote the place of purchase and date on the hard drives.
    • Ok, it is due to minimum free space, np.

      to help others here is the policy description link.

      github.com/trapexit/mergerfs#policy-descriptions

      regards
      -----------------------------------------------------------------------------------------------------------------------------------------

      ext4 + snapRAID (≥2 parity) + mergerfs + Smart monitoring + spindown + UPS + Corsair AX psu and 1:1 backup

      recently successfully recovered from a double hard drive failure, hard drives were bought six years ago in a single purchase, still got a way to go as I bought 8 at the time.
      I know this because I wrote the place of purchase and date on the hard drives.