slow transfer speed (tried what I read)

speeskeek · 13. Januar 2015

hi there,

I have an OMV for some time now, very happy with it. Unfortunately my LAN transfer speeds are now horribly slow, copying of a few 100mb's takes hours to complete.
The max speed I can get is 120kpbs-ish.

Tried installing the backports kernel, AFP is the same song.

Nothing is wrong with the disks:

Code

root@NAS [sdc5-DL-backup-500gb] # dd if=/dev/zero of=tempfile bs=102400 count=1024
1024+0 records gelezen
1024+0 records geschreven
104857600 bytes (105 MB) gekopieerd, 5,02022 s, 20,9 MB/s
root@NAS [sdc5-DL-backup-500gb] # dd of=/dev/zero if=tempfile bs=12400 count=1024
1024+0 records gelezen
1024+0 records geschreven
12697600 bytes (13 MB) gekopieerd, 0,0263773 s, 481 MB/s

Reading from a samba share looks quick - 600mb in 1 minute.

I tried to do this from my mac and from a win7 laptop - same slow upload speed on both.

PS: the server (OMV) beeps from tiem to time (pc speaker). what is that?

info on the system:

Code

Linux NAS 3.16.0-0.bpo.4-amd64 #1 SMP Debian 3.16.7-ckt2-1~bpo70+1 (2014-12-08) x86_64 GNU/Linux

Code

================================================================================
= Network interfaces
================================================================================
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host
       valid_lft forever preferred_lft forever
2: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000
    link/ether 00:11:09:8b:51:ec brd ff:ff:ff:ff:ff:ff
    inet 192.168.1.250/24 brd 192.168.1.255 scope global eth1
       valid_lft forever preferred_lft forever

Alles anzeigen

Thank you for your help.

subzero79 · 13. Januar 2015

The information you gave is pretty much useless. Please post your hw specs, MB, CPU and drive brand/model(raid and partition configuration)

That ifconfig also is useless, please post ethtool eth1 && ethtool -i eth1.

speeskeek · 13. Januar 2015

hi there, sorry for the useless info.

The harddisks are PATA and SATA - no raid.
the system is a Amd64 3400+ on a MSI k8N Neo platinum

what gives us lspci:

Code

root@NAS [~] # lspci
00:00.0 Host bridge: NVIDIA Corporation nForce3 250Gb Host Bridge (rev a1)
00:01.0 ISA bridge: NVIDIA Corporation nForce3 250Gb LPC Bridge (rev a2)
00:01.1 SMBus: NVIDIA Corporation nForce 250Gb PCI System Management (rev a1)
00:02.0 USB controller: NVIDIA Corporation CK8S USB Controller (rev a1)
00:02.1 USB controller: NVIDIA Corporation CK8S USB Controller (rev a1)
00:02.2 USB controller: NVIDIA Corporation nForce3 EHCI USB 2.0 Controller (rev a2)
00:08.0 IDE interface: NVIDIA Corporation CK8S Parallel ATA Controller (v2.5) (rev a2)
00:09.0 IDE interface: NVIDIA Corporation nForce3 Serial ATA Controller 2 (rev a2)
00:0a.0 IDE interface: NVIDIA Corporation nForce3 Serial ATA Controller (rev a2)
00:0b.0 PCI bridge: NVIDIA Corporation nForce3 250Gb AGP Host to PCI Bridge (rev a2)
00:0e.0 PCI bridge: NVIDIA Corporation nForce3 250Gb PCI-to-PCI Bridge (rev a2)
00:18.0 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] HyperTransport Technology Configuration
00:18.1 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Address Map
00:18.2 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] DRAM Controller
00:18.3 Host bridge: Advanced Micro Devices [AMD] K8 [Athlon64/Opteron] Miscellaneous Control
01:00.0 VGA compatible controller: NVIDIA Corporation NV17 [GeForce4 MX 420] (rev a3)
02:08.0 RAID bus controller: Promise Technology, Inc. PDC20376 (FastTrak 376) (rev 02)
02:0d.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8169 PCI Gigabit Ethernet Controller (rev 10)

Alles anzeigen

Info about the nic

Code

root@NAS [~] # ethtool eth1 && ethtool -i eth1
Settings for eth1:
    Supported ports: [ TP MII ]
    Supported link modes:   10baseT/Half 10baseT/Full 
                            100baseT/Half 100baseT/Full 
                            1000baseT/Half 1000baseT/Full 
    Supported pause frame use: No
    Supports auto-negotiation: Yes
    Advertised link modes:  10baseT/Half 10baseT/Full 
                            100baseT/Half 100baseT/Full 
                            1000baseT/Half 1000baseT/Full 
    Advertised pause frame use: Symmetric Receive-only
    Advertised auto-negotiation: Yes
    Link partner advertised link modes:  100baseT/Half 
    Link partner advertised pause frame use: No
    Link partner advertised auto-negotiation: No
    Speed: 100Mb/s
    Duplex: Half
    Port: MII
    PHYAD: 0
    Transceiver: internal
    Auto-negotiation: on
    Supports Wake-on: pumbg
    Wake-on: g
    Current message level: 0x00000033 (51)
                   drv probe ifdown ifup
    Link detected: yes
driver: r8169
version: 2.3LK-NAPI
firmware-version: 
bus-info: 0000:02:0d.0
supports-statistics: yes
supports-test: no
supports-eeprom-access: no
supports-register-dump: yes
supports-priv-flags: no

Alles anzeigen

about the disks:

Code

================================================================================
= Block device attributes
================================================================================
/dev/sdd1: LABEL="80kaput" UUID="b2578be3-58a2-4341-a939-76a929eeba2d" TYPE="ext4"
/dev/sde1: UUID="786e24e1-3a65-43bf-bebd-753af11cdecf" TYPE="ext4"
/dev/sdb1: LABEL="NieuweDisk" UUID="8414A4BD14A4B418" TYPE="ntfs"
/dev/sdc1: LABEL="Documents" UUID="2918e581-e0af-48ba-9ccd-b88d9a510d6f" TYPE="ext4"
/dev/sde5: UUID="fc778cc2-004d-4f08-9cff-d3e55955c788" TYPE="swap"
/dev/sda5: LABEL="Backup-DL" UUID="01CFFA686B0C8880" TYPE="ntfs"


================================================================================
= File system disk space usage
================================================================================
Bestandssysteem                                        Type     1024-blokken   Gebruikt Beschikbaar Vulgraad Aangekoppeld op
rootfs                                                 rootfs       75416696   10209000    61353668      15% /
udev                                                   devtmpfs        10240          0       10240       0% /dev
tmpfs                                                  tmpfs          257444        792      256652       1% /run
/dev/disk/by-uuid/786e24e1-3a65-43bf-bebd-753af11cdecf ext4         75416696   10209000    61353668      15% /
tmpfs                                                  tmpfs            5120          0        5120       0% /run/lock
tmpfs                                                  tmpfs         1172480     133660     1038820      12% /run/shm
tmpfs                                                  tmpfs         1287216          4     1287212       1% /tmp
/dev/sdb1                                              fuseblk    1953513024 1431733376   521779648      74% /media/8414A4BD14A4B418
/dev/sda5                                              fuseblk     485420008   22706132   462713876       5% /media/01CFFA686B0C8880
/dev/sdc1                                              ext4        195890528    8253268   187620876       5% /media/2918e581-e0af-48ba-9ccd-b88d9a510d6f
/dev/sdd1                                              ext4         78654360      53272    78584704       1% /media/b2578be3-58a2-4341-a939-76a929eeba2d
/dev/sdb1                                              fuseblk    1953513024 1431733376   521779648      74% /export/Series
/dev/sdb1                                              fuseblk    1953513024 1431733376   521779648      74% /export/Film


================================================================================
= Static information about the file systems
================================================================================
# /etc/fstab: static file system information.
#
# Use 'blkid' to print the universally unique identifier for a
# device; this may be used with UUID= as a more robust way to name devices
# that works even if disks are added and removed. See fstab(5).
#
# <file system> <mount point>   <type>  <options>       <dump>  <pass>
# / was on /dev/sda1 during installation
UUID=786e24e1-3a65-43bf-bebd-753af11cdecf /               ext4    errors=remount-ro 0       1
# swap was on /dev/sda5 during installation
UUID=fc778cc2-004d-4f08-9cff-d3e55955c788 none            swap    sw              0       0
/dev/sr0        /media/cdrom0   udf,iso9660 user,noauto     0       0
tmpfs           /tmp            tmpfs   defaults        0       0
# >>> [openmediavault]
/dev/disk/by-uuid/DC00076C00074D48 /media/DC00076C00074D48 ntfs defaults,nofail 0 2
/dev/disk/by-uuid/68949B5E949B2D96 /media/68949B5E949B2D96 ntfs defaults,nofail 0 2
/dev/disk/by-uuid/8414A4BD14A4B418 /media/8414A4BD14A4B418 ntfs defaults,nofail 0 2
/dev/disk/by-uuid/01CFFA686B0C8880 /media/01CFFA686B0C8880 ntfs defaults,nofail 0 2
UUID=2918e581-e0af-48ba-9ccd-b88d9a510d6f /media/2918e581-e0af-48ba-9ccd-b88d9a510d6f ext4 defaults,nofail,acl,user_xattr,noexec,usrjquota=aquota.user,grpjquota=aquota.group,jqfmt=vfsv0 0 2
UUID=b2578be3-58a2-4341-a939-76a929eeba2d /media/b2578be3-58a2-4341-a939-76a929eeba2d ext4 defaults,nofail,user_xattr,noexec,usrjquota=aquota.user,grpjquota=aquota.group,jqfmt=vfsv0,acl 0 2
/media/8414A4BD14A4B418/Series /export/Series none bind 0 0
/media/8414A4BD14A4B418/Film /export/Film none bind 0 0
# <<< [openmediavault]

Alles anzeigen

subzero79 · 13. Januar 2015

First, your nic adapter is showing speed negotiation at fast ethernet, that's 10MB/s, so your switch is probably can't go gigabit. So that's how far youre gonna get. The problem is now you're getting 120KB/s if I read correct

For testing read speeds in drives you can use hdparm -tT /dev/sde1 for example. This can confirm if your drives can go past 10-12MB/s and from there extract files in samba client at that speed. Write speeds to drive are always slower, but not that dramatic to go at 120KB/s

Test iotop and top in OMV when you're trying to copy a file in samba, check if any process different from samba spikes up.

Also test FTP transfers to see if you get the same slow speed.

What else? your nic card is eth1 realtek, is there eth0 around maybe the nforce one? is it active? maybe try and disable it in BIOS
I have an alive nforce4 platform with an opteron 148 (939), read/write speeds are like 40MB/s on sata2 drives. So don't get too much expectations.

NTFS-3G as a fuse mount is not very fast.

speeskeek · 13. Januar 2015

hi thanks for the quick reply.

Yeah, I know it's not the speed-beast I got here, but it was a lot faster before (its now 2-3 days after one or other update it is slow). The nic and/or switch are fast ethernet (and not gigabit) but that is ok for me.

Yes eth1 is the only one 'alive' now, the eth0 is the nforce onboard one, but disabled in bios (since when I installed the system).

the hard-drive speeds look ok:

Code

root@NAS [~] # hdparm -tT /dev/sde1


/dev/sde1:
Timing cached reads: 598 MB in 2.00 seconds = 298.88 MB/sec
Timing buffered disk reads: 168 MB in 3.02 seconds = 55.67 MB/sec

when copying a file with samba there is no weird CPU usage, smdb is at 0.7%
ftp transfer - looks like I have problem with permissions. willlook for that.

iotop gives me this:
1667 be/4 root 0.00 B/s 283.79 K/s 0.00 % 0.00 % mount.ntfs /dev/sda5 /media/01CFFA686B0C8880 -o rw,_netdev

when writing to a share on a ext4-disk:
8544 be/4 nobody 0.00 B/s 229.99 K/s 0.00 % 0.00 % smbd -D

subzero79 · 13. Januar 2015

I can see the slow speed reading from iotop from the fuse mount (ntfs)

sdc1 is an ext4 drive (Documents lable). Can you create a share in that file system and test speed there from Samba.

speeskeek · 13. Januar 2015

Zitat von speeskeek

when writing to a share on a ext4-disk:
8544 be/4 nobody 0.00 B/s 229.99 K/s 0.00 % 0.00 % smbd -D

I think your post crossed my edit

subzero79 · 13. Januar 2015

Mmmm i missed that

Do you have the realtek firmware bundle? dpkg -l | grep realtek

if you don't have it run apt-get -t wheezy-backports install firmware-realtek and reboot

Also is there a problem in checking with the onboard nforce nic?

speeskeek · 13. Januar 2015

Zitat von subzero79

Do you have the realtek firmware bundle? dpkg -l | grep realtek

yup is installed

Zitat

Also is there a problem in checking with the onboard nforce nic?

I can do that - but it is weird, to have to change the nic suddenly at a blue tuesday I'll try later, is a headless machine, so need to grab a screen and all... It will be for after my TV night with my wife

subzero79 · 13. Januar 2015

Things to try without the monitor:

-Test with FTP or WinSCP for SSH. From there we can blame Samba if you get decent speed.

- If you have time bring down the PC, and take off the nic card for some time (10 minutes) and plug it again and boot OMV.

- Try an install the realtek official driver instead of the kernel one

speeskeek · 13. Januar 2015

ok I'll do that.

is this something that can cause my problems?

Code

21869.331289] nr_pdflush_threads exported in /proc is scheduled for removal
[21869.331630] sysctl: The scan_unevictable_pages sysctl/node-interface has been disabled for lack of a legitimate use case.  If you have one, please send an email to linux-mm@kvack.org.

speeskeek · 13. Januar 2015

a scp copy from my mac to my OMV-nas is also slow (150-200-ish KB/s)

subzero79 · 13. Januar 2015

Is this wired or wireless?

Do you have a windows client (wired of course)?

speeskeek · 13. Januar 2015

Zitat von subzero79

Is this wired or wireless?

Do you have a windows client (wired of course)?

all is wired - I hate wireless

I have a windows 7 pc somewhere here. that samba-speed is also slow

subzero79 · 13. Januar 2015

Can we blame it on the switch then? Maybe when you get your monitor you can try a direct cable connect in between your server and you computer.

speeskeek · 14. Januar 2015

I changed the switch and the cable before - and as it is with samba, as well as scp I guess it is a NIC problem.
First I'll try and change the nic to the nforce, if not I'll play with the official driver for the realtec.

subzero79 · 14. Januar 2015

How did it go with nforce?

I leave you this link that has tons of other helpful commands to start debugging network problems.

http://unix.stackexchange.com/…bleshooting-and-debugging

Also you can use iperf tool to measure LAN speeds. iperf is installed in osx by brew, and in windows you can download the package here https://iperf.fr/

speeskeek · 17. Januar 2015

Nforce nic was not better, a 3com pci i had spare didnt do verry well.. But the screen helped me (it showed duplex errors)

so there is a port broken on my isp's switch/router/cablemodem

Now the speeds are 30-ish - ok for me!

Jetzt mitmachen!