Is OMV going to work for me?

  • Excellent - I have decided that I am indeed going to give OMV a go as my main server.


    What I am going to do is build a second server and run this at the same time as my windows one - I can thoroughly test the Linux system over the next few weeks/months and make the cut when I am sure it is fully working.


    I note that the journaling file systmem has been mentioned above.


    I assume that my main options should be ext4 and BTRFS - there seems to be loads of conflicting information on which to use. How do I decide?


    With regards to Emby:


    NPVR is really great, when combined with Schedules Direct (you pay for this, but you get accurate and consistent EPG data).


    I have NPVR record everything to a single folder. When a new recording is made, it puts it in a subfolder (named after the TV show). The file in that subfolder is in the format "ShowTitle.SxxExx.EpisodeTitle.ts.


    I have Emby set up monitor the recording folder and as a new file appears, it automatically scrapes the data from TVDB. All fanart etc. is stored directly in the subfolder for each show.


    Hope this helps - let me know if you need anything else (the least I can do, given how much advice you have given me).

  • not sure what conflicting information you get bu here is my POV.


    EXT4 is a reliable and tried FS. it is currently one of the most used across Linux distros except for XFS.
    but it has some shortcomings that FS like ZFS and BTRFS are trying to eliminate.
    i.e. EXT4 and a like, do not have self healing capabilities and no protection against data bitrot.
    this FS need additional tools and modules for that and other capabilities.


    FSs like ZFS and BTRFS fix that and add a built-in raid capability , built-in drive pooling and more.
    I personally prefer BTRFS for my FS if I can use it.
    there are planty of comparison on the net between BTRFS and ZFS so I am not going to go into this here, but will just do a very quick feature list for you to think off.


    Both ZFS and BTRFS are CoW FS and both feature raid and drive pooling options.
    however where BTRFS will happily let you mix drive sizes in the raid/pool setup
    ZFS is more strict and more demanding. with BTRFS it is easy to switch between raid configs on the fly and expand or contract raid pool on a running system with only a mild slowdown, ZFS does not offer the same level of options as far as I can tell. you can do it , but it does require a more fiddling and CLI interaction with the system. hence why I favor BTRFS.
    BUT
    at the very moment BTRFS only offer Raid-0, 1 and 10 as stable code.
    there is raid- 5 and 6 but it is still in unstable state and not recommended.
    judging by my past experience I would not recommend using BTRFS on raw devices for raid and drive pooling , as I have lost data with that setup I only use BTRFS on partitioned drives.

    omv 3.0.56 erasmus | 64 bit | 4.7 backport kernel
    SM-SC846(24 bay)| H8DME-2 |2x AMD Opteron Hex Core 2431 @ 2.4Ghz |49GB RAM
    PSU: Silencer 760 Watt ATX Power Supply
    IPMI |3xSAT2-MV8 PCI-X |4 NIC : 2x Realteck + 1 Intel Pro Dual port PCI-e card
    OS on 2×120 SSD in RAID-1 |
    DATA: 3x3T| 4x2T | 2x1T

    • Official Post

    raw device

    Formatting the entire device as btrfs versus a partition as btrfs. He is saying create a partition if you want to use it. OMV does create a partition in single drive situations but does not for raid.

    omv 8.5.11-1 synchrony | 7.0 proxmox kernel

    plugins:

    omvextrasorg 8.0.3 | kvm 8.3.4 | compose 8.2.2 | cterm 8.0.4 | borgbackup 8.2.1 | tempmon 8.0.5 |

    mergerfs 8.0.2 | scripts 8.0.6 | writecache 8.3.0 | backup 8.1 | kernel 8.1


    omv-extras.org plugins source code and issue tracker - github - changelogs


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

  • RAW device is when you use the disk as is. no partition table and no partitions at all.
    you can do this with LVM and mdadm, as well as ZFS.
    the volume manager of your choice is laid out on top of the bare drive and is responsible for how the data is written onto the medium. if you ever used LVM or mdadm you will remember that you did not prepair the drives beforehand to put it in to raid volume or LVM volume. you just plug in the drive into system and used commands to create the raid/LVM volume on top. than you would create the mbr or gpt on the volume and create partition(s) on that. any older File systems are layered on top of the raw devices to make them usable, while BTRFS and ZFS are "File Systems" they incorporate some features that before only existed on specialty go-between media management modules like LVM or mdadm
    so if you use any of this FS you do not need the go-between modules, all the features are right within the File System itself.
    example :


    with any older FS you had to go through several steps to prepare the drive for use.
    even though you sometimes could do some of the steps in one swoop the steps where still there, just jumble up into single command.


    i.e. when you issue the Format disk command you are telling the computer to perform this 3 basic steps in order.


    1. create partition table. (prepare the disk for use by building a special database like structure in specific area of the disk)
    2. create partition or partitions (using the database from step 1 , define and outline the area(s) of the disk to be used for data)


    3. format the disk/partition as needed (this builds/define an address table of all bits on the disk into reference table with in the database in step 1)
    (when you run format command on new empty disk , all 3 steps are performed in order as needed , when you ask to format partition only usually only step 3 is performed.)


    BTRFS and ZFS use different schema and all the volume information is kept within internal metadata structures hence both of them can use disks directly, as is with no further preparation on your part.


    Hope this was not overly detailed, but I though a more detailed explanation,even if you know most of it, might help someone with less experience, in the future.

    omv 3.0.56 erasmus | 64 bit | 4.7 backport kernel
    SM-SC846(24 bay)| H8DME-2 |2x AMD Opteron Hex Core 2431 @ 2.4Ghz |49GB RAM
    PSU: Silencer 760 Watt ATX Power Supply
    IPMI |3xSAT2-MV8 PCI-X |4 NIC : 2x Realteck + 1 Intel Pro Dual port PCI-e card
    OS on 2×120 SSD in RAID-1 |
    DATA: 3x3T| 4x2T | 2x1T

  • So I have been doing something very similar except in my case I had a headless Win 7 machine using ArgusTV and Schedules Direct. The switch to TVHeadend is not to be taken lightly. Once you get the hang of it it's not hard set up but the real problem is the EPG data. To get Schedules Direct to work well I ended up having to use the 4.1.x test builds so I had xml utils with the tv_grab_sd_json for Schedules Direct. Even then TVHeadend cuts off the detailed show descriptions and ignores the repeat flag so you cannot set the DVR to new airings only. I ended up keeping Win 7 as a virtual machine to run ArgusTV.


    I am not sure you can install TVHeadend successfully alongside OMV anyway since you will need 4.1 and don't think that installs on Wheezy. So you might need to have a VM for you DVR anyway.

    Sumpermicro A1SAM-C2550F
    2xKingston 8GB 240-Pin DDR3 SDRAM ECC Unbuffered DDR3 1600 (PC3 12800) Server Memory w/TS Hynix B Model
    16GB SSD for Proxmox
    64GB SSD for VM (OMV 2.2.13 & Win7 x64)

  • So I have been doing something very similar except in my case I had a headless Win 7 machine using ArgusTV and Schedules Direct. The switch to TVHeadend is not to be taken lightly. Once you get the hang of it it's not hard set up but the real problem is the EPG data. To get Schedules Direct to work well I ended up having to use the 4.1.x test builds so I had xml utils with the tv_grab_sd_json for Schedules Direct. Even then TVHeadend cuts off the detailed show descriptions and ignores the repeat flag so you cannot set the DVR to new airings only. I ended up keeping Win 7 as a virtual machine to run ArgusTV.


    I am not sure you can install TVHeadend successfully alongside OMV anyway since you will need 4.1 and don't think that installs on Wheezy. So you might need to have a VM for you DVR anyway.

    I am not against DVR in VM , but if OP goes with OMV 3 it will be fine as it is on Jessie and have 4.1 or at least can install backport for it.

    omv 3.0.56 erasmus | 64 bit | 4.7 backport kernel
    SM-SC846(24 bay)| H8DME-2 |2x AMD Opteron Hex Core 2431 @ 2.4Ghz |49GB RAM
    PSU: Silencer 760 Watt ATX Power Supply
    IPMI |3xSAT2-MV8 PCI-X |4 NIC : 2x Realteck + 1 Intel Pro Dual port PCI-e card
    OS on 2×120 SSD in RAID-1 |
    DATA: 3x3T| 4x2T | 2x1T

  • True but after having some issues myself with OMV 3 I would not push anyone in that direction. I would suggest the OP come up with a plan that allows for OMV2 or 3. IMHO 3 is still a beta product.

    Sumpermicro A1SAM-C2550F
    2xKingston 8GB 240-Pin DDR3 SDRAM ECC Unbuffered DDR3 1600 (PC3 12800) Server Memory w/TS Hynix B Model
    16GB SSD for Proxmox
    64GB SSD for VM (OMV 2.2.13 & Win7 x64)

    • Official Post

    IMHO 3 is still a beta product.

    Core OMV 3.x is stable in my opinion. Some of the plugins are beta though.

    omv 8.5.11-1 synchrony | 7.0 proxmox kernel

    plugins:

    omvextrasorg 8.0.3 | kvm 8.3.4 | compose 8.2.2 | cterm 8.0.4 | borgbackup 8.2.1 | tempmon 8.0.5 |

    mergerfs 8.0.2 | scripts 8.0.6 | writecache 8.3.0 | backup 8.1 | kernel 8.1


    omv-extras.org plugins source code and issue tracker - github - changelogs


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

  • Unfortunately, I think I might be a little bit out of my depth here - though very determined to get up to speed.


    I have all the bits for my server - i.e. an SSD for the operating system and three hard drives (1 x 1tb HDD and 2 x 500gb HDD).


    If I decide to go down the BTRFS route, what would I need to do to get up and running with this?


    Again, you'll have to excuse my inexperience, but what seems to be the issue with TVH?


    Would MythTV be a better alternative in the circumstances?


    Given my particular uses for the server, am I perhaps over-complicating things by trying to use OMV as a DVR too? I.e. am I one of the candidates who might in fact be better off installing something like Ubuntu instead?

  • ok, in your case it really does not matter which FS you will use as you do not plan on using Raid, or LVM or anything special like that.


    so first thing first, build out the hardware,


    install OMV (I would definitely go with Version 3)
    First thing to do after initial install is to login to WebUI and change Admin password
    and UI time out settings so you can work.
    also turn on and configure SSH so you can login into CLI as needed.
    run all updates etc.
    install your data drives if you did not do it before.
    install omv-extras plugin.


    using File system tab in OMV select each of your data drives and create filesystem on it.
    omv v3 supports BTRFS so you will be able to choose it as FS for each drive.
    OMV does not support any special configuration for BTRFS so you cannot create BTRFS raid setup or anything special, but a plain straightforward single drive format is supported.


    using plugins tab, install SnapRaid and unionfilesystem plugins.
    any other plugins as your fancy strikes,
    if you have enough RAM and CPU I would install Virtual box as well. be aware though, if you do choose to install VB do it on it's own after all other plugins are setup and your data drives are ready for the data.
    reason being, you can put your VM things on the data store rather than on SSD, which personally I prefer.


    now once all of that installed (ignore VB for now)
    use SnapRaid tab and configure the array. (remember that your biggest drive needs to be the Parity drive,
    so your single 1TB will be your Parity and 2 500Gb will be your data) you will get 1TB of storage like this. if space is a commodity skip the snapraid for now and just run 3 drives as is until you can get a 2TB drive to add as parity snap raid and mergerfs can be added at any time even on filled disks with no problems.


    no use the unionfilesystem tab and create a new pool using your data disk. give name to the pool (it will ask for it.)
    if you skipped the snapraid for now, you can add all 3 of the drives to the pool.
    if you use snapraid only pool the" data" disks , do not add parity disks to the pool.
    NOTE: an FYI tip, when creating file systems, add label to the disk according to what you will be using them for.


    i.e. I name my all data disks either D[##] (D+number of the disk according to the sequence I create them
    ) OR data## (same as above but using full word "data" )
    P[##] or parity## etc.
    the reason I add sequence to the parity drives is that snapraid can use multiple parity disks and this way I know what is which.
    when all is done, add Shares using the pool drive (which will be created and mounted automatically for you by OMV)


    since OMV mounts everything in "/media/<UUID>" you might want to create a links folder and symlink the pool mount with a friendly name there for future references, there is a plugin for that too.
    now that you ready you can install the TVHeadend using CLI and configure it as you pleased.


    now if you had a network tuner like silicondust makes you could just run a ubuntu VM and install headend inside VM. mounting NFS shares to record the data from it.
    but a built-in tuner will not transfer to VM. maybe a good plan for the future upgrades.

    omv 3.0.56 erasmus | 64 bit | 4.7 backport kernel
    SM-SC846(24 bay)| H8DME-2 |2x AMD Opteron Hex Core 2431 @ 2.4Ghz |49GB RAM
    PSU: Silencer 760 Watt ATX Power Supply
    IPMI |3xSAT2-MV8 PCI-X |4 NIC : 2x Realteck + 1 Intel Pro Dual port PCI-e card
    OS on 2×120 SSD in RAID-1 |
    DATA: 3x3T| 4x2T | 2x1T

  • That is absolutely fantastic - thank you so much!


    I am going to have a go this weekend and see how I get on - your instructions are really clear so hopefully (as long as I take things slowly), it shouldn't be too painful.


    It is interesting that you have raised the idea of network tuners as I have just been doing a bit of research on them.


    At the moment, I have two internal tuners (dual DVB-T and single DVB-S2).


    I was looking to get rid of both tuners and replace them with a dual DVB-T2 and a dual DVB-S2 (either one one card or two dual cards).


    However, I found this little device that may well be better (especially in light of your comments above):


    https://digitaldevices.de/prod…tv_tuner/octopus_net_mix/


    My only reservation about using a network tuner is the amount of traffic that is going to be transmitted over my network (which is Gigabit speed).


    It is not uncommon for me to be recording four HD streams whist potentially streaming three more.


    Could this sort of throughout load potentially cause a problem for my network?

  • may I make a suggestion, if you have a choice do not get untested tuners.
    it maybe just me, but over the years I had so much issues with different tuners compatibility
    that I just gave up on that idea.
    I am planning to resurrect the setup some time in the future but A. using a network tuner, this way I am not tied to a specific machine, and B. all my research points to the Silicon dust home run tuners as the most comparable out there. everywhere you look SD-homerun is supported out of the box whether by Linux or Windows.


    as for network traffic, I don't know, maybe if you use a good quality switch and split the load using vlans?
    with my setup I can simply separate the tuners physically. my server has 2 nics and is located in the basement right next to Cable box. so I can do that. YMMV

    omv 3.0.56 erasmus | 64 bit | 4.7 backport kernel
    SM-SC846(24 bay)| H8DME-2 |2x AMD Opteron Hex Core 2431 @ 2.4Ghz |49GB RAM
    PSU: Silencer 760 Watt ATX Power Supply
    IPMI |3xSAT2-MV8 PCI-X |4 NIC : 2x Realteck + 1 Intel Pro Dual port PCI-e card
    OS on 2×120 SSD in RAID-1 |
    DATA: 3x3T| 4x2T | 2x1T

    • Official Post

    all my research points to the Silicon dust home run tuners as the most comparable out there. everywhere you look SD-homerun is supported out of the box whether by Linux or Windows.

    I have an HDHomerun extend that has a transcoding dlna server builtin. A scheduled job can record with a simple wget command that looks like:


     wget "http://192.168.1.196:5004/auto/v3.1?transcode=internet540&duration=3600" -O "/media/long_uuid/videos/bigbang.mp4"

    omv 8.5.11-1 synchrony | 7.0 proxmox kernel

    plugins:

    omvextrasorg 8.0.3 | kvm 8.3.4 | compose 8.2.2 | cterm 8.0.4 | borgbackup 8.2.1 | tempmon 8.0.5 |

    mergerfs 8.0.2 | scripts 8.0.6 | writecache 8.3.0 | backup 8.1 | kernel 8.1


    omv-extras.org plugins source code and issue tracker - github - changelogs


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

Participate now!

Don’t have an account yet? Register yourself now and be a part of our community!