Very Slow Transfer Speed on Raspberry Pi 4 with OMV 5

  • I tried my other external Disk.

    Formatted it to ext4 on the OMV RPi4 an ran the test.

    Turns out that drive can reach up to 100+ MB/s in write-Speed.

    I´m now going to copy all files and clear the MyBook. Than i´m going to formate it to ext4.

    dont know if i did something wrong the first time.


    the only thing i tried around with was the write-cache and advanced power management which is activated under

    Storage - Disk - edit (the drive)


    Settings:

    1 - Minimum power usage with standby (spindown)

    Maximum performance, maximum acoustic output

    20 minutes

    Write-cache enable



    Test done:


    SMB Extra Options modified to:

    min receivefile size = 16384

    write cache size = 524288

    getwd cache = yes

    socket options = TCP_NODELAY IPTOS_LOWDELAY

    read raw = yes

    write raw = yes


    Storage - Disk - edit (the drive)


    Settings:

    1 - Minimum power usage with standby (spindown)

    Maximum performance, maximum acoustic output

    20 minutes

    Write-cache enable


    Western Digital My Book USB 3.0 (WDBBGB) 12TB (WDBBGB0120HBK)

    omv 5.5.23-1 (usul) on RPi4 Kernel 5.4.83


    ------------------------------------------------------------------------------

    CrystalDiskMark 8.0.1 x64 (C) 2007-2021 hiyohiyo

    Crystal Dew World: https://crystalmark.info/

    ------------------------------------------------------------------------------

    * MB/s = 1,000,000 bytes/s [SATA/600 = 600,000,000 bytes/s]

    * KB = 1000 bytes, KiB = 1024 bytes


    [Read]

    SEQ 1MiB (Q= 8, T= 1): 102.885 MB/s [ 98.1 IOPS] < 80819.75 us>

    SEQ 1MiB (Q= 1, T= 1): 99.157 MB/s [ 94.6 IOPS] < 10566.57 us>

    RND 4KiB (Q= 32, T= 1): 51.263 MB/s [ 12515.4 IOPS] < 2554.58 us>

    RND 4KiB (Q= 1, T= 1): 8.835 MB/s [ 2157.0 IOPS] < 462.51 us>


    [Write]

    SEQ 1MiB (Q= 8, T= 1): 118.255 MB/s [ 112.8 IOPS] < 70155.66 us>

    SEQ 1MiB (Q= 1, T= 1): 111.288 MB/s [ 106.1 IOPS] < 9409.57 us>

    RND 4KiB (Q= 32, T= 1): 49.696 MB/s [ 12132.8 IOPS] < 2632.65 us>

    RND 4KiB (Q= 1, T= 1): 8.911 MB/s [ 2175.5 IOPS] < 458.13 us>


    Profile: Default

    Test: 64 MiB (x5)

    Mode: [Admin]

    Time: Measure 5 sec / Interval 5 sec

    Date: 2021/02/03 19:08:09

    OS: Windows 10 Professional N [10.0 Build 19042] (x64)


    Code
    lsusb -t
    /: Bus 02.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/4p, 5000M
    |__ Port 2: Dev 2, If 0, Class=Mass Storage, Driver=usb-storage, 5000M
    /: Bus 01.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/1p, 480M
    |__ Port 1: Dev 2, If 0, Class=Hub, Driver=hub/4p, 480



    ^^:thumbup:


    118.255 MB/s sounds fine to me. much better than only up to 30 MB/s


    seems you were right @mi-hol. sorry for the confusion with the format of the drive. Thanks for your help.


    ext4 seems to do it for me pretty well.

  • Thanks for taking the time to try my suggestions. Well done!

    omv 5.6.3-1 (usul) on RPi4/4GB with Kernel 5.10.x and WittyPi 3 V2 RTC HAT

    2x 6TB HDD formatted with ext4 in Icy Box IB-RD3662-C31 / hardware supported RAID1

    For Read/Write performance of SMB shares hosted on this hardware see forum here

  • I tried


    Write-cache enable


    read raw = yes

    write raw = yes


    Nothing helps. Write speed to USB3 1Tb ext4 hdd 2-10MB/s. Read - 85-115 MB/s


    Raspberry Pi 4 8 Gb raspiOS 64 bit. dd command shows write speed 78+ Mb/s


    Will look in future for better software. As I saw in this topic OMV is bugged soft and people can't find reasons why.

  • As I saw in this topic OMV is bugged soft and people can't find reasons why.

    that others were able to fix the issue via SMB configuration, tells you what?

    omv 5.6.3-1 (usul) on RPi4/4GB with Kernel 5.10.x and WittyPi 3 V2 RTC HAT

    2x 6TB HDD formatted with ext4 in Icy Box IB-RD3662-C31 / hardware supported RAID1

    For Read/Write performance of SMB shares hosted on this hardware see forum here

  • I have this and still speed drops.

    1 gb network.

    TCP settings :


    client min protocol=NT1

    ntlm auth=yes

    min receivefile size = 16384

    write cache size = 524288

    getwd cache = yes

    socket options = TCP_NODELAY IPTOS_LOWDELAY

    read raw = yes

    write raw = yes




    root@raspberrypi:~# lsusb -t

    /: Bus 02.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/4p, 5000M

    |__ Port 1: Dev 2, If 0, Class=Mass Storage, Driver=uas, 5000M

    /: Bus 01.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/1p, 480M

    |__ Port 1: Dev 2, If 0, Class=Hub, Driver=hub/4p, 480M

    root@raspberrypi:~# lsusb -t

    /: Bus 02.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/4p, 5000M

    |__ Port 1: Dev 2, If 0, Class=Mass Storage, Driver=uas, 5000M

    /: Bus 01.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/1p, 480M

    |__ Port 1: Dev 2, If 0, Class=Hub, Driver=hub/4p, 480M

    root@raspberrypi:~#

  • Birdybird without hardware details and benchmarks results, how would anybody be able to help?

    omv 5.6.3-1 (usul) on RPi4/4GB with Kernel 5.10.x and WittyPi 3 V2 RTC HAT

    2x 6TB HDD formatted with ext4 in Icy Box IB-RD3662-C31 / hardware supported RAID1

    For Read/Write performance of SMB shares hosted on this hardware see forum here

  • Birdybird without hardware details and benchmarks results, how would anybody be able to help?

    RP4 with sandidk sdssdh3 1t00 1 Terabyte usb3 attached with latest omv5. Copy from w10 client to ext4 formatted drive.




    To run the benchmark yourself type/paste:


    wget https://raw.githubusercontent.…chmarks/master/Storage.sh

    chmod +x Storage.sh

    sudo ./Storage.sh


    login as: root

    root@192.168.1.9's password:

    Linux raspberrypi 5.10.11-v7l+ #1399 SMP Thu Jan 28 12:09:48 GMT 2021 armv7l

    Clock speeds: CPU: 1500 - Core: 500 - RAM:

    System rootfs drive (/) has been detected as /dev/mmcblk0p2 (mmcblk0p2)

    % Total % Received % Xferd Average Speed Time Time Time Current

    Dload Upload Total Spent Left Speed

    100 795k 100 795k 0 0 2361k 0 --:--:-- --:--:-- --:--:-- 2361k

    System: Host: raspberrypi Kernel: 5.10.11-v7l+ armv7l bits: 32 compiler: gcc v: 10.2.1 Console: tty 1

    Distro: Raspbian GNU/Linux 10 (buster)

    Machine: Type: ARM Device System: Raspberry Pi 4 Model B Rev 1.1 details: BCM2711 rev: c03111 serial: 100000000008378e

    CPU: Info: Quad Core model: ARMv7 v7l variant: cortex-a72 bits: 32 type: MCP arch: v7l rev: 3

    features: Use -f option to see features bogomips: 1080

    Speed: 1500 MHz min/max: 600/1500 MHz Core speeds (MHz): 1: 1500 2: 1500 3: 1500 4: 1500

    Graphics: Device-1: bcm2711-vc5 driver: vc4_drm v: N/A bus ID: N/A

    Device-2: bcm2711-hdmi0 driver: N/A bus ID: N/A

    Device-3: bcm2711-hdmi1 driver: N/A bus ID: N/A

    Display: server: No display server data found. Headless machine? tty: 137x42

    Message: Unable to show advanced data. Required tool glxinfo missing.

    Network: Message: No ARM data found for this feature.

    IF-ID-1: eth0 state: up speed: 1000 Mbps duplex: full mac: dc:a6:32:44:c6:79

    IF-ID-2: tun0 state: unknown speed: 10 Mbps duplex: full mac: N/A

    IF-ID-3: wlan0 state: down mac: dc:a6:32:44:c6:7a

    Drives: Local Storage: total: 938.92 GiB used: 704.5 GiB (75.0%)

    ID-1: /dev/mmcblk0 vendor: SanDisk model: SU08G size: 7.4 GiB

    ID-2: /dev/sda type: USB vendor: SanDisk model: SDSSDH3 1T00 size: 931.51 GiB

    Message: No Optical or Floppy data was found.

    Partition: ID-1: / size: 6.97 GiB used: 2.09 GiB (30.0%) fs: ext4 dev: /dev/mmcblk0p2

    ID-2: /boot size: 252 MiB used: 47.6 MiB (18.9%) fs: vfat dev: /dev/mmcblk0p1

    Info: Processes: 403 Uptime: 13d 1h 46m Memory: 3.81 GiB used: 526.5 MiB (13.5%) gpu: 76 MiB Init: systemd runlevel: 5

    Compilers: gcc: 8.3.0 Packages: 742 Shell: Sudo v: 1.8.27 inxi: 3.3.01

    Card CSD status register: MID: 3 OID: SD PNM: SU08G PRV: 8.0 MDATE: 1/2012

    Card SCR status register: SD Physical Version Specification: 3

    MicroSD information: Clock Speed: 50.0 - Manufacturer: SanDisk - Model: SU08G - Vendor: SD - Product: SD - HW Version: 0x8 - FW Version: 0x0 - Date Manufactured: 01/2012

    Class: Class 4

    Running HDParm tests ...

    /dev/mmcblk0p2:

    Timing O_DIRECT cached reads: 44 MB in 2.02 seconds = 21.82 MB/sec

    Timing O_DIRECT disk reads: 66 MB in 3.04 seconds = 21.68 MB/sec

    HDParm: 21.68 MB/s - HDParmCached: 21.82 MB/s

    Running dd tests ...

    81920+0 records in

    81920+0 records out

    335544320 bytes (336 MB, 320 MiB) copied, 73.0562 s, 4.6 MB/s

    DD Write Speed: 4.6 MB/s

    Running fio write test ...

    Running fio read test ...

    FIO results - 4k RandWrite: 86 IOPS (345 KB/s) - 4k RandRead: 1437 IOPS (5749 KB/s)

    Running iozone test ...

    Iozone: Performance Test of File I/O

    Version $Revision: 3.429 $

    Compiled for 32 bit mode.

    Build: linux


    Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins

    Al Slater, Scott Rhine, Mike Wisner, Ken Goss

    Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR,

    Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner,

    Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone,

    Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root,

    Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer,

    Vangel Bojaxhi, Ben England, Vikentsi Lapa.


    Run began: Tue Mar 9 17:10:04 2021


    Auto Mode

    Include fsync in write timing

    O_DIRECT feature enabled

    File size set to 81920 kB

    Record Size 4 kB

    Command line used: iozone -a -e -I -i 0 -i 1 -i 2 -s 80M -r 4k

    Output is in kBytes/sec

    Time Resolution = 0.000001 seconds.

    Processor cache size set to 1024 kBytes.

    Processor cache line size set to 32 bytes.

    File stride size set to 17 * record size.

    random random bkwd record stride

    kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread

    81920 4 1256 1302 5155 5170 5141 408


    iozone test complete.

    RandRead: 5141 - RandWrite: 408 - Read: 5155 - Write: 1256

    Enter a description of your storage and setup (Example: Kingston A400 SSD on Pi 4 using StarTech SATA to USB adapter)

    Description: sandisk

    (Optional) Enter alias to use on benchmark results. Leave blank for completely anonymous.

    Alias (leave blank for Anonymous):



    Category Test Result

    HDParm Disk Read 21.68 MB/s

    HDParm Cached Disk Read 21.82 MB/s

    DD Disk Write 4.6 MB/s

    FIO 4k random read 1437 IOPS (5749 KB/s)

    FIO 4k random write 86 IOPS (345 KB/s)

    IOZone 4k read 5155 KB/s

    IOZone 4k write 1256 KB/s

    IOZone 4k random read 5141 KB/s

    IOZone 4k random write 408 KB/s


    Score: 423

  • Birdybird the network hardware is not mentioned.

    Did you see the variation that different routers cause in the benchmark result link in below signature?

    omv 5.6.3-1 (usul) on RPi4/4GB with Kernel 5.10.x and WittyPi 3 V2 RTC HAT

    2x 6TB HDD formatted with ext4 in Icy Box IB-RD3662-C31 / hardware supported RAID1

    For Read/Write performance of SMB shares hosted on this hardware see forum here

  • network hardware is 1gb speed. cat5e cables

    its a router experiabox v10a. a couple of months

    ago i used raspian buster with minidlna i had no speed drops. also when omv5 came out i had no speed drops. speed was around 100mbs. i can test tomorrow with raspian buster if the speed is the same.

  • Will look in future for better software. As I saw in this topic OMV is bugged soft and people can't find reasons why.

    Realize that the Samba implementation OMV is using is Debian. OMV is not an operating system. It's an application that uses the Debian kernel and Debian's userland. Samba (SMB) is part of that userland. So, if you really think something is wrong with Debian, one of the oldest distro's out there, keep that in mind when looking for "better software".

  • router experiabox v10a

    while you measured, did you switch off Wifi and disconnect all ethernet cables except for the systems under test?


    the router seems to have a single (low performance) processor, I'd suspect (even bet money) that some WiFi related activity is causing the periodic slow down.

    System-On-ChipBCM63168 family
    CPU @FrqMIPS @400MHz

    omv 5.6.3-1 (usul) on RPi4/4GB with Kernel 5.10.x and WittyPi 3 V2 RTC HAT

    2x 6TB HDD formatted with ext4 in Icy Box IB-RD3662-C31 / hardware supported RAID1

    For Read/Write performance of SMB shares hosted on this hardware see forum here

    Edited 2 times, last by mi-hol ().

  • i assure you nobody used wifi

    unfortunately that doesn't help behause wifi has periodic activities (ie. automatic channel hopping) that consume cpu resources even when wifi is not used AND you have no control about what connect devices (like smartphones) do in the background while they are not actively used

    omv 5.6.3-1 (usul) on RPi4/4GB with Kernel 5.10.x and WittyPi 3 V2 RTC HAT

    2x 6TB HDD formatted with ext4 in Icy Box IB-RD3662-C31 / hardware supported RAID1

    For Read/Write performance of SMB shares hosted on this hardware see forum here

  • Nobody has problems with speed drops raspberry4 with omv5

    Checking read/write speeds is a waste of time until network connectivity is tested using iperf this will tell you your 'potential' network speed.

    I don't use a Pi for storage, but wired/ethernet networking is best served through a powered switch rather than the 'switch' on the router.

    Raid is not a backup! Would you go skydiving without a parachute?

  • I installed iperf but what options do i use

    Try searching the forum, or iperf's site will give that information, I have used it once due to an issue on my network between my server and W10.

    I checked everything. raspberry4direct cable to switch then direct cable to switch to client pc w10

    A network switch is a separate piece of hardware, it is not the use of the Ethernet ports on the rear of a router, my wired network is connected to a switch, my router is then connected to that switch to supply internet access to those machines

    Raid is not a backup! Would you go skydiving without a parachute?

  • I installed iperf but what options do i use ?


    On one of the devices (i.e. Raspberry Pi) run it as a server:

    Code
    iperf3 -s -f K


    and on the other (your PC, I use Linux, but I'm sure there is iperf for other OS's too) as a client connecting to that iperf 'server':

    Code
    iperf3 -c 192.168.10.1 -f K

    change the ip address to you iperf server IP you run the first code from above.


    Both machine will give you similar results. Paste the results from one of them here.

Participate now!

Don’t have an account yet? Register yourself now and be a part of our community!