Not able to pass 60MB/s read or write speed

Hi,

I recently upgraded my system because I wasn't able to pass 60MB/s with my Asus C60m1-i Mainboard (which runs a RAID5 with 4 3TB WD Reds).
It has a Realtek network chipset, which really sucks.

So I thought let's do it the right way.

I bought an HP ProCurve 1810-8G and a Supermicro X7SPA-HF-D525 mainboard with a dual Intel 82574L NIC.
I enabled Link Aggregation for the NICs and trunked the 1810-8G's ports, which are connected to the board.
Also I enabled Jumbo Frames (on the switch, the OMV and the client pc, which got an Intel Gigabit CT NIC and runs Win7 Ultimate) and Flow Control.
But no matter what I try, I'm not able to get past 60-70MB/s.

Do you have any tips for me, how to improve my transfer speed?
Thanks guys

Hi,

CPU load is around 10%, so there is nothing stressing the system...
It's both ways around 60MB/s - 70MB/s, testet it with the same file (around 4,4GB).
Where can I check my raid speed and how do I bench it?
Thanks

Regards,
Sebastian

How long does this usually take?
The write is taking some time already.
CPU load is around 40% -45% during this test.

Hi,

here is the result for write:
102400+0 records in
102400+0 records out
102400000000 bytes (102 GB) copied, 1154.46 s, 88.7 MB/s

88,7 MB/s is not that much - I would expect more from a RAID5 set with 4x WD Reds 3TB.

I'll start the read test now...

Here are the results for write:

102400+0 records in
102400+0 records out
102400000000 bytes (102 GB) copied, 396.934 s, 258 MB/s

CPU load was around 25% during the write test...

These are my system specs:
Mainboard: Supermicro X7SPA-HF-D525 (6x SATA2, Onboard Intel Atom D525 CPU, 2x Intel 82574L Gigabit LAN)
Ram: 4GB DDR3 (not shure right now, if 1066 or 800)
HDD: 1x Kingston SSDNow V+200 120GB (system drive), 4x WD Red 3TB (Raid5, ext4)

Here are the raid details:

Version : 1.2
  Creation Time : Sat Dec  1 19:04:55 2012
     Raid Level : raid5
     Array Size : 8790795264 (8383.56 GiB 9001.77 GB)
  Used Dev Size : 2930265088 (2794.52 GiB 3000.59 GB)
   Raid Devices : 4
  Total Devices : 4
    Persistence : Superblock is persistent


    Update Time : Mon Jul 29 13:38:15 2013
          State : clean
 Active Devices : 4
Working Devices : 4
 Failed Devices : 0
  Spare Devices : 0


         Layout : left-symmetric
     Chunk Size : 512K


           Name : openmediavault:Storage  (local to host openmediavault)
           UUID : e008acec:969e8fcb:9632fbb0:da94fa8b
         Events : 28312


    Number   Major   Minor   RaidDevice State
       0       8        0        0      active sync   /dev/sda
       1       8       16        1      active sync   /dev/sdb
       2       8       32        2      active sync   /dev/sdc
       3       8       64        3      active sync   /dev/sde

I just tested copying with my laptop via lan:
I get around 105MB/s read and about 85MB/s write (some file as before).
Write is still a bit low, but I guess read won't get any better with one 1Gbit connection.

I'll try the onboard NIC of my desktop computer now, and see what results I get there.

But I'm still concerned about the low raid write performance...

Zitat von "ryecoaaron"

What is the output of (change md127 to match your raid number):

cat /sys/block/md127/md/stripe_cache_size

The value is 256

So the cache size might be to small?

Zitat von "davidh2k"

I would say your Atom has not enough power to calculate the parity with higher speeds.

There are some guidelines for RAID5 which means you should get a specific amount of hard disks (3, 5 or 9 disks) or you will get slower write speeds because the raid has to reread blocks and rewrite them which slows the RAID down.

Source: http://de.wikipedia.org/wiki/R…_Parit.C3.A4tsinformation -> Einfluss auf die Write-Performance
Sorry, German only, the english wikipedia article is not as half as good as the german one.

Greetings
David

Alles anzeigen

So if I put in another drive I should be fine again?

I'll have a look at the article later (no problem - I'm german :lol: )

The test with the onboard NIC had the same result:
Read speed between 60MB/s and 70MB/s - I guess this will have something to do with this machine...

Alright, I'll give this a try...

davidh2k

What settings did you select for hard discs?
Did you enable the write cache?

ryecoaaron

After I increased the cache I get 156MB/s with the benchmark.
So helped a lot...
Would it make sense, to increase the cache even more?

No, it didn't - but I guess that's down to the individual client.
With my laptop I'm now able to achieve aroud 100MB/s read and write with one 1Gbit connection.
So it isn't the fault of the OMV...

Next month I'll get another WD Red, so I have a 5 disk raid - so hopefully this will boost the write performance further more.

Thanks for your help guys!