Data Pooling with MergerFS

1st Official Post

    Hello everyone.

    After I didn't get any answers in German, I'll try my luck again in English ... :)


    During my new installation I tried the two plugins Union FS and Merger FS.

    Unfortunately, I am not getting the result I wanted.

    For each of my main directories I would like to specify whether the data is distributed over several disks or specifically stored on one disk.

    Disk 1

    /Medienspeicher/Bilder/2020 -> All Pictures of 2020

    Disk 2

    /Medienspeicher/Bilder/2021

    Disk 3

    /Medienspeicher/Bilder/2019

    E.g. Photo folders can be distributed, but the whole Photos / 2020 folder.


    Music or documents could be placed discreetly on a disk.

    I want to user the spin down feature on the disks,

    therefore sensible data storage is important.


    With UnionFS I couldn't do that, with Merger FS I don't know what to enter in the path.


    Can someone help me with this.

    Many Thanks


    Regards

    Matthias

    • Official Post

    I don't think it is possible to have different storage policies for separate folders.


    However, if you create a pool with existing files in folders, the files remain where they are. Unless you move/copy/modify the files. Or balance the pool.


    One possible option then is to use a policy that does not preserve the path and regularly run a script that move files you have changed back to the right HDD. I think rsync would be perfect for this, but some testing would be needed to verify that Move files from the wrong HDD to the right. Perhaps as part of you creating normal backups of your data.


    (Warning: When moving files in a mergerfs between the pool and individual HDDs it is easy to delete files by mistake! That is because often when you move a file you use a copy-delete method. And the delete may delete both copies if the paths match...)


    Another option could be to create two separate pools. One that preserves existing paths and one that doesn't.

    Ok, thanks for your awnser.

    That with the different pools sounds like a practicable way for me.

    But for this I think the best plugin would be Merger FS.

    Can someone tell me how the paths have to be structured that have to be entered there for each pool

    e.g. /srv/dev...xxx..xxx..disk1/mediastorage/pictures ???

    • Official Post
    Quote from matthias80

    I don't know what to enter in the path.

    If you enable the Absolute Path column (click arrow in the column header) in the Shared Folders tab, you see the path you need to use. And no, you can't cut&paste and there is no way to fix that. Put each absolute path on a new line in the mergerfs folders plugin.

    omv 7.4.7-1 sandworm | 64 bit | 6.8 proxmox kernel

    plugins :: omvextrasorg 7.0 | kvm 7.0.14 | compose 7.2.3 | k8s 7.2.0-1 | cputemp 7.0.2 | mergerfs 7.0.5 | scripts 7.0.8


    omv-extras.org plugins source code and issue tracker - github - changelogs


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

    • Official Post
    Quote from matthias80

    But I don't have to create the pool in advance to then select it when sharing folders.

    Not sure what you mean. If you want to create sharedfolders from the mergerfs pool, the pool has to exist.

    omv 7.4.7-1 sandworm | 64 bit | 6.8 proxmox kernel

    plugins :: omvextrasorg 7.0 | kvm 7.0.14 | compose 7.2.3 | k8s 7.2.0-1 | cputemp 7.0.2 | mergerfs 7.0.5 | scripts 7.0.8


    omv-extras.org plugins source code and issue tracker - github - changelogs


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

Participate now!

Don’t have an account yet? Register yourself now and be a part of our community!

Register Yourself Login