Unionfilesystem Plugin

  • Hi,


    first of all thank you for this plugin. To set up a pool with all your different data drives has never been easier. :) No need to use the command line for a mhddfs pool or to create shared folder manually on each drive in comparision to the normal aufs-plugin. :thumbup:


    There are only two questions i'm not able to figure out by myself.

    • I created an aufs-pool but the files which I copied on it don't get spread any more according to which drive has the most free space. Does this function will come back in later versions or did i miss an option to configure it right?
    • Is it possible to restrict the available space for each user, so they won't be able to block the whole pool storage with their files? I tried it with the quota function but for the pool I only get the following error message: Invalid method parameter: 'false' does not match '/^[a-f0-9]{8}-[a-f0-9]{4}-[a-f0-9]{4}-[a-f0-9]{4}-[a-f0-9]{12}$/i'


      Code
      Fehler #2002:
      exception 'OMVException' with message 'Invalid method parameter: 'false' does not match '/^[a-f0-9]{8}-[a-f0-9]{4}-[a-f0-9]{4}-[a-f0-9]{4}-[a-f0-9]{12}$/i'' in /usr/share/php/openmediavault/rpcservice.inc:187
      Stack trace:
      #0 /usr/share/openmediavault/engined/rpc/quota.inc(68): OMVRpcServiceAbstract->validateMethodParams(Array, '{\n\t\t\t  "type":"...')
      #1 [internal function]: OMVRpcServiceQuota->get(Array, Array)
      #2 /usr/share/php/openmediavault/rpcservice.inc(125): call_user_func_array(Array, Array)
      #3 /usr/share/php/openmediavault/rpc.inc(79): OMVRpcServiceAbstract->callMethod('get', Array, Array)
      #4 /usr/sbin/omv-engined(500): OMVRpc::exec('Quota', 'get', Array, Array, 1)
      #5 {main}

    Thanks in advance!

    • Offizieller Beitrag

    1 - aufs is supposed to put files on the drive with the most free space. That is its whole purpose. You didn't miss an option and there is no function to add. If it is not working, that is something I haven't been able to figure out. I can't replicate it.


    2 - No this isn't possible. If quotas don't work, I would guess they don't work with aufs. Never used quotas. You might be able to setup quotas on the drives themselves instead of the pool.

    omv 7.0-32 sandworm | 64 bit | 6.5 proxmox kernel

    plugins :: omvextrasorg 7.0 | kvm 7.0.9 | compose 7.0.9 | cputemp 7.0 | mergerfs 7.0.3


    omv-extras.org plugins source code and issue tracker - github


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

  • Thanks for the fast reply.


    1. Ok, it isn't that important for me. I've only wondered why it doesn't seem to work with the new unionfilesystem plugin.


    2. Then I will setup the quotas for each drive to achieve my goal. :)

    • Offizieller Beitrag

    The old aufs plugin had the same problem in rare cases. I guess that is why aufs is being replaced.

    omv 7.0-32 sandworm | 64 bit | 6.5 proxmox kernel

    plugins :: omvextrasorg 7.0 | kvm 7.0.9 | compose 7.0.9 | cputemp 7.0 | mergerfs 7.0.3


    omv-extras.org plugins source code and issue tracker - github


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

  • I've tested mhddfs before but only reached 50mb/s in writing and the copy only started after 10 or more seconds (temporarily "no response" on task manager of my win7 desktop). Get some strange error messages as well while copying files onto my server (something like he can't be reached anymore but the first file in queue was copied without any problem). So I went back to using aufs.

    • Offizieller Beitrag

    mhddfs is a fuse filesystem so it is definitely slower.

    omv 7.0-32 sandworm | 64 bit | 6.5 proxmox kernel

    plugins :: omvextrasorg 7.0 | kvm 7.0.9 | compose 7.0.9 | cputemp 7.0 | mergerfs 7.0.3


    omv-extras.org plugins source code and issue tracker - github


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

  • I've read about it but was surprised that it is about two times slower at my network than an aufs pool. Nevertheless thanks for the plugins and their continuous improvements (e.g. simpler/faster pooling creation). :)

    • Offizieller Beitrag

    I really wish we could use overlayfs. It is better than aufs and mhddfs but wasn't added to the kernel until 3.18.

    omv 7.0-32 sandworm | 64 bit | 6.5 proxmox kernel

    plugins :: omvextrasorg 7.0 | kvm 7.0.9 | compose 7.0.9 | cputemp 7.0 | mergerfs 7.0.3


    omv-extras.org plugins source code and issue tracker - github


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

  • Strange, now the first data drive is full and I get a messages that my storage hasn't enough space. Although the pool has in total more than 5TB free space remaining. It seems that the new aufs-pool created with the unionfilesystem plugin basically do not work for me anymore. Setup the pool from scratch several times without success.
    Is there a possibility to install the "old" aufs plugin instead of the unionfs plugin? Both pooling and data writing on the drive with the most free space have worked very well on my server.

  • Try adding OMV_FSTAB_MNTOPS_AUFS="sum,create=mfs" to /etc/default/openmediavault. Change mfs to the one you want (look here under Policies for Creating to find out which you want). Then you'll have to run omv-mkconf fstab and remount the pool or reboot the server. Don't forget to check dmesg (I think?).


    About quota, it says

    Zitat

    If you want to use disk-quota, you should set it up to your writable branch since aufs does not have its own block device.

    here. I guess you could set up the quota for each drive and it'll will work.

  • Adding the line into it and followed your instructions. Does not work. I have two 3TB drives in my aufs pool but the files were still copied only to one of them.
    I would like to try the former aufs "standalone" plugin but after the latest omv-extras update I can't find it anymore. Haven't any problems with it. Can I download it somewhere else?

    • Offizieller Beitrag

    The plugins setup the pool the same way. I don't think the old version is going to help. Download it from here.

    omv 7.0-32 sandworm | 64 bit | 6.5 proxmox kernel

    plugins :: omvextrasorg 7.0 | kvm 7.0.9 | compose 7.0.9 | cputemp 7.0 | mergerfs 7.0.3


    omv-extras.org plugins source code and issue tracker - github


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

  • The only other think I can think of is that only one branch is read-write and the other ones is read-only? Or the even simpler error, the shared folders aren't setup on the pool but on the different filesystems on their own.

    • Offizieller Beitrag

    Possible. I always wanted to try removing the .wh files but I have never been able duplicate this problem.

    omv 7.0-32 sandworm | 64 bit | 6.5 proxmox kernel

    plugins :: omvextrasorg 7.0 | kvm 7.0.9 | compose 7.0.9 | cputemp 7.0 | mergerfs 7.0.3


    omv-extras.org plugins source code and issue tracker - github


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

  • Download it from here.


    Thanks for the link. I just want to try it, even if this plugin does the same on the paper. :)
    I have just tried it out and it works. Don't know, why the unionfs plugin causes problems on my server.


    The only other think I can think of is that only one branch is read-write and the other ones is read-only? Or the even simpler error, the shared folders aren't setup on the pool but on the different filesystems on their own.


    Double-checked all my configurations and can't find anything wrong. The shared folder is setup on the created pool and the smb share shows me the entire pool storage size under windows.

    • Offizieller Beitrag

    Can you post your fstab? cat /etc/fstab

    omv 7.0-32 sandworm | 64 bit | 6.5 proxmox kernel

    plugins :: omvextrasorg 7.0 | kvm 7.0.9 | compose 7.0.9 | cputemp 7.0 | mergerfs 7.0.3


    omv-extras.org plugins source code and issue tracker - github


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

    • Offizieller Beitrag

    Nope. I would like to see the output from the old aufs plugin.

    omv 7.0-32 sandworm | 64 bit | 6.5 proxmox kernel

    plugins :: omvextrasorg 7.0 | kvm 7.0.9 | compose 7.0.9 | cputemp 7.0 | mergerfs 7.0.3


    omv-extras.org plugins source code and issue tracker - github


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

    • Offizieller Beitrag

    I just noticed the new plugin doesn't add the =rw for each branch and is missing udba=reval. Maybe this is causing the problem? I just noticed my aufs is not working either. I will do some tests...

    omv 7.0-32 sandworm | 64 bit | 6.5 proxmox kernel

    plugins :: omvextrasorg 7.0 | kvm 7.0.9 | compose 7.0.9 | cputemp 7.0 | mergerfs 7.0.3


    omv-extras.org plugins source code and issue tracker - github


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

    Einmal editiert, zuletzt von ryecoaaron ()

Jetzt mitmachen!

Sie haben noch kein Benutzerkonto auf unserer Seite? Registrieren Sie sich kostenlos und nehmen Sie an unserer Community teil!