Pool Hard Drives

  • I will give this all a try. Like I said I haven't tried anything else because using windows was what I knew how to do, and yes the command line stuff is scary. I would have no idea how to do that. Is there some sort of a guide I can review?


    Personally, since I had no experience with Linux, I just set up a Linux Mint virtual machine on my Windows PC that I played around with for a few weeks. It helped me learn how to do a lot of basic things from the command line like moving and deleting files. Then I set up an OMV VM and played around with that for a month or so. You can practice as much or little as you want and never have to worry about messing anything up, since if you do, you can delete the VM and start over again.

  • Most people don't really need this and I recommend against manual configuration.

    I need it. I did it. It works great.


    jcschwartz,
    I'd recommend some other way of keeping track of what you've watched rather than physically moving files around. That seems very cumbersome to me. I use Kodi to watch my movies and it has a little icon next to the file name to show if a file's been watched or not.

  • I need it. I did it. It works great.

    That is why I said "most". While you have it working, I don't think it is a good idea to recommend it for newbs.

    I use Kodi to watch my movies and it has a little icon next to the file name to show if a file's been watched or not.

    That is what I do as well.

    How do you go about setting up OMV VM?

    That needs a more information like what virtualization platform.

    omv 5.5.9 usul | 64 bit | 5.4 proxmox kernel | omvextrasorg 5.3.6
    omv-extras.org plugins source code and issue tracker - github


    Please read this before posting a question.
    Please don't PM for support... Too many PMs!

  • I need it. I did it. It works great.
    jcschwartz,
    I'd recommend some other way of keeping track of what you've watched rather than physically moving files around. That seems very cumbersome to me. I use Kodi to watch my movies and it has a little icon next to the file name to show if a file's been watched or not.


    Kodi and Plex also have Trakt plugins that sync your watched status to a trakt.tv account, which is nice because it will sync again if you ever have to reinstall or reset your kodi database.

  • Just wondering why nobody recommended using eXtplorer. Seems like a simple solution for someone not familiar with Linux and OMV.

    OMV 4.1.30-1 (Arrakis); Shuttle XPC SH67H3; Intel Core i5-2390T; 8 GB DDR3-1333 RAM; 128GB SanDisk Z400s SSD (OS); Samsung 860 EVO 1TB (primary storage).

  • The OP was asking about methods to move files across drives, which was slow because the user was doing it through a network share.


    Given the description of the setup and problem, the user may not be aware of all options, and eXtplorer may resolve the simple issue of quicker file transfer without having to do much else to the server.


    Not saying this is unquestionably the best solution, just that it is a way to easily resolve file transfer speeds.

    OMV 4.1.30-1 (Arrakis); Shuttle XPC SH67H3; Intel Core i5-2390T; 8 GB DDR3-1333 RAM; 128GB SanDisk Z400s SSD (OS); Samsung 860 EVO 1TB (primary storage).

  • eXtplorer is not available as plug-in for OMV3 and OMV4. So installation is more complex.


    IMO easiest way to copy files on the server is midnight commander.


    Install with
    sudo apt install mc


    start with
    sudo mc


    To get started with CLI, I recommend "The Linux Command Line", which can be downloaded for free here:
    http://linuxcommand.org/tlcl.php/

  • Ah, okay. I didn't realize the plugin was discontinued. That is a better explanation as to why it was not recommended.

    OMV 4.1.30-1 (Arrakis); Shuttle XPC SH67H3; Intel Core i5-2390T; 8 GB DDR3-1333 RAM; 128GB SanDisk Z400s SSD (OS); Samsung 860 EVO 1TB (primary storage).

  • mergerfs works on top of existing filesystems. Creating a pool will not do anything to the files on the current filesystems. You can add/remove drives whenever you want. If a drive fails, you will just lose access to the files on that drive.


    OP, this is the problem with mergerfs. Here is what happens, if you have 3 drives and you create a pool with them and then you decide to remove one of the drives your data on that drive will be removed from the pool. I would suggest installing Rockstor instead of OMV due to a fact that when you create a pool in Rockstor and you want to remove the drive but keep all the data Rockstor will move the data to the drives you are keeping. OMV does not seem to have anything like this unless you go with RAID.

  • OP, this is the problem with mergerfs. Here is what happens, if you have 3 drives and you create a pool with them and then you decide to remove one of the drives your data on that drive will be removed from the pool. I would suggest installing Rockstor instead of OMV due to a fact that when you create a pool in Rockstor and you want to remove the drive but keep all the data Rockstor will move the data to the drives you are keeping. OMV does not seem to have anything like this unless you go with RAID.

    Ok troll. I don’t know why you are recommending something else in the OMV forum due to one filesystem choice. There are plenty of filesystem choices in OMV that dont behave this way. Pretty sure Rockstor doesn’t do anything magical with mergerfs to do something else (if it even supports mergerfs). And last time I checked, there isn’t a filesystem or raid type supported by Rockstor that isn’t supported by OMV.

    omv 5.5.9 usul | 64 bit | 5.4 proxmox kernel | omvextrasorg 5.3.6
    omv-extras.org plugins source code and issue tracker - github


    Please read this before posting a question.
    Please don't PM for support... Too many PMs!

  • Ok troll. I don’t know why you are recommending something else in the OMV forum due to one filesystem choice. There are plenty of filesystem choices in OMV that dont behave this way. Pretty sure Rockstor doesn’t do anything magical with mergerfs to do something else (if it even supports mergerfs). And last time I checked, there isn’t a filesystem or raid type supported by Rockstor that isn’t supported by OMV.


    OMV has nothing to loose if I recommend something else that will make things easier for those people. OMV is free so they are not loosing any revenue. No, Rockstor uses BTRFS but to me thats all besides the point. When I asked on here about a filesystem that would be able to do what I want I was told that mergerfs can not do things this way. I have 8TB and 4TB drives in my system and I have them set up in Liner Raid right now for total of 12TB of space. I had 8TB and 4TB merged together too with mergerfs before I found out that I just cant add or remove drives without loosing data so for me there was no difference between setting up Linear Raid with these two drives or using mergerfs. Lets say I want to add another 8TB and then remove the old 8TB. Under Rockstor I can create pool and select Linear Raid. Then I can add and remove drives without data being removed as long as there is enough room for the data on the drives that are staying in the system. And I can do all this with few clicks because the system is set up so you dont have to be a rocket scientist to figure things out. Im not knocking OMV. Im just pointing out that some other system might be better for some people.





    Im talking Linear RAID. See above.

  • And I can do all this with few clicks because the system is set up so you dont have to be a rocket scientist to figure things out. Im not knocking OMV. Im just pointing out that some other system might be better for some people.

    You can do that with OMV too. Just not with btrfs (yet). You can do it with lvm, zfs, or mdadm. OMV may be a bit more difficult some times but that is because it is more flexible.

    omv 5.5.9 usul | 64 bit | 5.4 proxmox kernel | omvextrasorg 5.3.6
    omv-extras.org plugins source code and issue tracker - github


    Please read this before posting a question.
    Please don't PM for support... Too many PMs!

  • So I tried LVM2. I was able to add physical disks under Volume Groups but I was not able to remove any. When I clicked on Reduce, all I got was the page with no disks listed. zfs didnt want to install at all on OMV4. There were countless errors. mdadm I didnt try.


    One suggestion, If I cant do it through GUI its simply not going to work for me and for millions of other average users. Hence why I was saying that Rockstor might be more helpful.

  • Hi ZanosG,


    You can have linear RAID with mdadm.
    For example, I have 4x2To RAID 5 for main storage, and make backups of that datas every night with rsnapshot on a 3x2To Linear RAID.


    That works perfect for me, and very easy to configure with OMV GUI.

    Lian Li PC-V354 with Be Quiet! fans | ASRock Rack x470D4U | AMD Ryzen 5 3600 | 1xCrucial 16GB DDR4 2666MHz ECC
    1xADATA 8200 Pro 256MB NVMe for System/Caches/Logs/Downloads | 4xWD 10To HDD RAID 6 for Datas
    Powered by OMV v5.5.5 / Linux kernel 5.6.0

  • So I tried LVM2. I was able to add physical disks under Volume Groups but I was not able to remove any. When I clicked on Reduce, all I got was the page with no disks listed. zfs didnt want to install at all on OMV4. There were countless errors. mdadm I didnt try.

    With LVM, you have to know how to use it. You can't reduce a volume group if there is an LV on that physical volume.
    zfs has installed many, many times on OMV 4 for me. What are these countless errors?


    One suggestion, If I cant do it through GUI its simply not going to work for me and for millions of other average users. Hence why I was saying that Rockstor might be more helpful.

    How is that a suggestion? The suggestions I gave do work in the GUI. I never said they are for the millions of average users. The only reason Rockstor is easier in your case is because of btrfs. lvm and mdadm are much older and more complicated.


    You are not an average user if you add and remove disks all the time. Average users add a couple of disks and just want it to work. They *might* add a disk but very, very few people remove disks. Adding works very well with mergerfs.

    omv 5.5.9 usul | 64 bit | 5.4 proxmox kernel | omvextrasorg 5.3.6
    omv-extras.org plugins source code and issue tracker - github


    Please read this before posting a question.
    Please don't PM for support... Too many PMs!

  • Hi ZanosG,


    You can have linear RAID with mdadm.
    For example, I have 4x2To RAID 5 for main storage, and make backups of that datas every night with rsnapshot on a 3x2To Linear RAID.


    That works perfect for me, and very easy to configure with OMV GUI.

    Thanks for your input but I cant even find anything on google on how to install this mdadm at all. If I had that many drives and had RAID 5 I would have no problem with growing it. The problem is that with Linear you cant grow it or remove disks. You have to break the RAID and start all over again and thats when all your data is gone.

  • Hi,


    mdadm is part of the basic packages on debian, so OMV has it from the box else...

    Code
    apt-get install mdadm


    For the growing of a linear RAID, no problem...

    I then added it to the array:


    Code
    mdadm --grow /dev/md0 --add /dev/sdd1
    cat /proc/mdstat:
    Personalities : [linear]
    md0 : active linear sdd1[2] sdc1[1] sdb1[0]
    288768 blocks 64k rounding
    unused devices: <none>


    Then resize your File System... and mount it with OMV GUI. ;)


    Done ;)

    Lian Li PC-V354 with Be Quiet! fans | ASRock Rack x470D4U | AMD Ryzen 5 3600 | 1xCrucial 16GB DDR4 2666MHz ECC
    1xADATA 8200 Pro 256MB NVMe for System/Caches/Logs/Downloads | 4xWD 10To HDD RAID 6 for Datas
    Powered by OMV v5.5.5 / Linux kernel 5.6.0

  • With LVM, you have to know how to use it. You can't reduce a volume group if there is an LV on that physical volume.zfs has installed many, many times on OMV 4 for me. What are these countless errors?


    How is that a suggestion? The suggestions I gave do work in the GUI. I never said they are for the millions of average users. The only reason Rockstor is easier in your case is because of btrfs. lvm and mdadm are much older and more complicated.
    You are not an average user if you add and remove disks all the time. Average users add a couple of disks and just want it to work. They *might* add a disk but very, very few people remove disks. Adding works very well with mergerfs.

    I dont know what errors were. As soon as I encounter errors I ditch everything and move onto something that is proven to work. I dont have a know how on how to monkey with things in CLI nor do I want to. And Im not sure why we are going back and forth with this. From the beginning I have only claimed that Rockstor might be easier for people like me and you have said it yourself that any options in OMV will be harder to set up for someone like me. And for the last time, yes mergerfs will remove and add disks fine however the data does not get moved over prior to disk being removed. Im not sure how hard is to understand that when in GUI I select to remove disk and once the disk is removed I check the folder in question and the data is gone.


  • Sorry but that's all gibberish to me. I do appreciate your input however I don't know what to do with any of that or if its going to mess my system if i start typing stuff in CLI without knowing what exactly it is doing.

Participate now!

Don’t have an account yet? Register yourself now and be a part of our community!