Looking to take advantage of 10GbE and overcome HD bottleneck

Without raid, you won't get better than single disk performance. Since you are using all spinning disk, you are unlikely to break the 190MB/s mark. An SSD (cache or not) would help you get to about 500 MB/s. Since you only have three disks of the same size, you would probably struggle to hit 500 MB/s even in raid 0. raid 5 would struggle to hit 350 MB/s. All of those speeds are assuming your current disks can hit 180-190MB/s each.

For a while, I ran a seven drive raid 0 array of 1TB disks on a hardware raid controller and it would do about 850MB/s at best.

nvme is the easiest way to saturate 10gbe and doesn't require raid.

Zitat von mi-hol

the MOBO doesn't provide a NVMe interface, only:

Uh, it has pci-e slots and a pci-e to nvme adapter is only about $10 on Amazon. I have them in a couple of my systems.

Zitat von square_eyes

Would a cache work - does OMV support caching?

Any caching would have to be setup from the command line.

Zitat von square_eyes

I have seen multi/raid NVMe PCIe risers but not sure if my old mobo supports those - something about lane splitting?

Depends on if the pcie switch is on the card or not. Most don't have the switch and are expensive if they do. The cards without it needs specific motherboards usually. nvme doesn't need raid to saturate 10gbe though. I only have one card in my system (Samsung 960 Pro).

Zitat von square_eyes

Any services you can suggest that will play nice with SAMBA/Greyhole?

Caching is typically at the filesystem level and samba/greyhole would just see a normal filesystem. Using bcache or zfs with cache are pretty common. I use just the nvme drive with ext4 since it is a 1TB nvme drive. Keeps it simple and would work well with samba.

Zitat von square_eyes

I'm struggling to find a tutorial for optimising for 10GbE. I found this which has some steps but no real explanation as to where each setting is and what it's doing (such as - Parameters for NFS export: "async,no_subtree_check,insecure"). In another 10GbE thread there is a vague reference to OMV taking over all system config, and eventually overwriting things.

Is there an approach to take with OMV in mind - e.g. omv-env variables and other system settings? I'd say with multi gig becoming more commonplace, it's worth a look if it doesn't exist somewhere already.

What are you trying to optimize? nfs shouldn't need any optimization based on the network adapter speed. I use the default settings for nfs.

Zitat von mi-hol

starting with OMV 5,6,13 all config files managed by OMV are registered as deviations see

Not quite true either. None of the omv-extras plugins register deviations. In general it is just easier to say OMV completely manages the services it controls. If you install transmission or apache, OMV will never touch either since there is no core OMV control or plugin for them.