Slow smb share

Hi,

A fresh install of OMV v3 on a base Debian Jessie distribution running on ODROID-XU4

The external USB3 drive is a 2TB Western Digital My Passport Ultra

This drive is luks encrypted, file system is ext4

I've used this drive on a Windows 10 machine with NTFS before and it had read/write rates > 80 MB/sec there

Extra options for SMB/CIFS in OMV are:

getwd cache = yes
write cache size = 524288
min receivefile size = 16384

And "Use sendfile" is ticked as well

I'm using all tuning options (governor = ondemand, tuned irq settings, etc.)
from Obihörnchens blog entries.

mii-tool's output is fine:

eth0: negotiated 1000baseT-FD flow-control, link ok

iperf3 output looks good as well (> 900 Mbits/sec)

I'm aware that the luks encryption costs performance but the
write rate of a 1 GB file to the SMB shares starts with ~85 MB/s
but immediately drops down to about 18 MB/s and stays in that
range.

top shows that a process called ksoftirqd/<x> can jump up to ~ 80%
kworker/ takes up to 30% (sometimes this and ksoftirqd share the 80% value)
and samba takes the rest (about 20%).

I'm using these tweaks in /etc/rc.local

# cpu0 sets cpu[0-3], cpu4 sets cpu[4-7]
devices/system/cpu/cpu0/cpufreq/ondemand/io_is_busy = 1
devices/system/cpu/cpu4/cpufreq/ondemand/io_is_busy = 1
devices/system/cpu/cpu0/cpufreq/ondemand/sampling_down_factor = 10
devices/system/cpu/cpu4/cpufreq/ondemand/sampling_down_factor = 10
devices/system/cpu/cpu0/cpufreq/ondemand/up_threshold = 80
devices/system/cpu/cpu4/cpufreq/ondemand/up_threshold = 80


# Move USB and network irqs to first A15 CPU cluster
# usb2
echo 4 > /proc/irq/103/smp_affinity_list
# usb3
echo 4 > /proc/irq/104/smp_affinity_list
# network
echo 4 > /proc/irq/105/smp_affinity_list
# Enable RPS on all A15 cores expect the interrupt core (4)
echo e0 > /sys/class/net/eth0/queues/rx-0/rps_cpus

How can I get the speeds up?

I'm afraid, I can't use that image. I've ordered my XU4 with an eMMC 16GB media only
and it seems the issue that the linked image isn't able to boot from an eMMC drive is still
unresolved.

The network is not the problem. As I said iperf3 shows over 900MBit. The Win 10 client
isn't the problem as well. It can read / write to a NixOS machine on the same 1GBit
network with > 100 MB/sec. I'll check if the hdd enclosure is a bottleneck by connecting
a 256GB Samsung 850 Pro to the XU4 and copy large files from / to that device...

Any other suggestions?

The encasing isn't the problem. Write / read rates are over 90 MB/sec.

The default encryption seems to be aes-xts 256. And cryptsetup benchmark
shows that the max. en- / decryption rates are at about 41 MB/sec.

Using aes-cbc-essiv with 256 bit (real 128, because they are splitted)
has about 90 MB/sec en- / decryption rates...
I know this cipher is vulnerable to attacks but at least I wanted to see
if it would be an option..

But using this still cuts the performance down to 18 MB/sec...

The non encrypted drive performs well at about 90 MB/sec *sigh*