[solved] omv and 3ware strange behaviour

  • Hi Folks,
    this is my first Post on this Forum.
    I'm using OMV 0.4.28 on my self-made NAS, installed on a USB-Drive.


    I Plugged in a 3Ware 3ware 9650se-16ml Controller with 5x 3TB Drives attached.
    After that i created a RAID-5 in the Controllers Bios.
    The Array is created sucessfully an the 3ware-Cli-Tool shows the following:


    Now if i start OMV and login to the WebIF i found a strange behavior.
    At the Physical Disk Section i can now see 7 Drives (see Attachment):


    6x 9650SE-16M DISK - AMCC (sda, sdb, sdc, sdd, sde, sdf --> one disk to much?!?!)
    1x CRUZER FIT - Sandisk (sdg --> OMV DISK)


    I expected to see two drives:


    1x 9650SE-16M DISK - AMCC (sda --> the RAID-5 Array)
    1x CRUZER FIT - Sandisk (sdb --> OMV DISK)


    parted -l shows the following:


    What am i doing wrong?
    Greetings
    Cleem

    • Offizieller Beitrag

    Hard to say but it might be a driver issue due to the older kernel. I would upgrade to the backports 3.2 kernel.


    On another note, I wouldn't use a usb stick for OMV...

    omv 7.1.0-2 sandworm | 64 bit | 6.8 proxmox kernel

    plugins :: omvextrasorg 7.0 | kvm 7.0.13 | compose 7.2 | k8s 7.1.0-3 | cputemp 7.0.1 | mergerfs 7.0.5 | scripts 7.0.7


    omv-extras.org plugins source code and issue tracker - github - changelogs


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

  • Hi, thanx for the quick reply.
    Upgraded to 3.2 Kernel but issue still exists :(
    Have been looking for a solution all day long, don't know what else to do....

    • Offizieller Beitrag

    Glad you found the problem :)


    You should mark your original post as [SOLVED].

    omv 7.1.0-2 sandworm | 64 bit | 6.8 proxmox kernel

    plugins :: omvextrasorg 7.0 | kvm 7.0.13 | compose 7.2 | k8s 7.1.0-3 | cputemp 7.0.1 | mergerfs 7.0.5 | scripts 7.0.7


    omv-extras.org plugins source code and issue tracker - github - changelogs


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

  • cleem


    Noticed you are using a Sandisk Cruzer Edge (USB flash thumb stick) as your OMV system drive. OMV chews up and spits out flash drives on a regular basis. It would be good to find a small SSD or laptop drive to replace it.


    There are numerous posts here on the site concerning not using flash drives for the OMV system disk. Be prepared!

  • Ok, thanks for the Hint!
    Changed the USB-Stick with an 64 GB SSD today :)


    Another issue i noticed, i created a CIFS-Share on my ARRAY.
    If i'm uploading some Files to the Share i reach Transfer-Rates about 100-110 MB/s
    But if i download the Files from the Share i only reach 70-80 MB/s....


    ...i expected, that write-operations are much slower than reading-operations.... :-$

  • my Systems HDD is a Samsung SSD 830 Series with 128GB...
    The Drive is connected to 6GB/s SATA-Port.
    The Throughput should be up to 520 MB/s reading, up to 320 MB/s writing....
    .. shouldn't be the Bottleneck?


    Can you explain an reliable Way to test the NAS-Speed?

  • cd /media/yourraid/


    writetest: (write 100gb to your raid, you can decrease it to 10gb if you wish, just reduce count to 10240)

    Code
    dd if=/dev/zero of=tempfile bs=1MB count=102400


    readtest: (read that exact same file you've just written)

    Code
    dd if=tempfile of=/dev/zero bs=1MB count=102400


    afterwards delete the "tempfile"


    you can also check your speed via hdparm:


    Code
    hdparm -tT /dev/sda


    (uses cache)


    Code
    hdparm -tT --direct /dev/sda


    (without cache)


    i have the exact same setup as yours (16port 3ware controller since two days, 8port before) and 5x3TB wd red raid5, filesystem is xfs - windows to nas/raid speed is about 90-110mb/s via smb.


    Write:
    10737418240 Bytes (11 GB) kopiert, 19,9063 s, 539 MB/s
    107374182400 Bytes (107 GB) kopiert, 224,111 s, 479 MB/s


    Read:
    10737418240 Bytes (11 GB) kopiert, 22,4036 s, 479 MB/s
    107374182400 Bytes (107 GB) kopiert, 220,974 s, 486 MB/s


    hdparm:
    /dev/sdb:
    Timing O_DIRECT cached reads: 1168 MB in 2.00 seconds = 583.57 MB/sec
    Timing O_DIRECT disk reads: 1640 MB in 3.00 seconds = 546.61 MB/sec


    /dev/sdb:
    Timing cached reads: 10732 MB in 2.00 seconds = 5368.82 MB/sec
    Timing buffered disk reads: 1646 MB in 3.00 seconds = 548.62 MB/sec


    Greetings
    David

    "Well... lately this forum has become support for everything except omv" [...] "And is like someone is banning Google from their browsers"


    Only two things are infinite, the universe and human stupidity, and I'm not sure about the former.

    Upload Logfile via WebGUI/CLI
    #openmediavault on freenode IRC | German & English | GMT+1
    Absolutely no Support via PM!

  • Did some Tests on my ext4-fs, but my Performance is different to yours....


    dd if=/dev/zero of=tempfile bs=1MB count=102400


    102400000000 Bytes (102 GB) kopiert, 773,062 s, 132 MB/s

    dd if=/dev/zero of=tempfile bs=1MB count=10240


    10240000000 Bytes (10 GB) kopiert, 57,255 s, 179 MB/s


    dd if=tempfile of=/dev/zero bs=1MB count=102400


    102400000000 Bytes (102 GB) kopiert, 195,02 s, 525 MB/s

    dd if=tempfile of=/dev/zero bs=1MB count=10240

    10240000000 Bytes (10 GB) kopiert, 3,14201 s, 3,3 GB/s
    10240000000 Bytes (10 GB) kopiert, 2,925 s, 3,5 GB/s
    10240000000 Bytes (10 GB) kopiert, 2,9202 s, 3,5 GB/s

    hdparm -tT /dev/sda
    /dev/sda:
    Timing cached reads: 5554 MB in 2.00 seconds = 2779.50 MB/sec
    Timing buffered disk reads: 1624 MB in 3.00 seconds = 540.89 MB/sec


    hdparm -tT --direct /dev/sda
    /dev/sda:
    Timing O_DIRECT cached reads: 1150 MB in 2.00 seconds = 574.21 MB/sec
    Timing O_DIRECT disk reads: 1632 MB in 3.00 seconds = 543.83 MB/sec

  • what i don't understand is why you get good Performance via hdparm, but that bad write Performance via dd.
    I would suggest that your raid striping maybe is not the best, also it could be ext4 related.


    did something write/Access to your raid at the Moment you did the dd?


    If your raid has not yet many data on it i would suggest that you reformate it to xfs.


    also go to your Controller Settings and enable your write Cache / read Cache to intelligent / storsave to balance


    Greetings
    David

    "Well... lately this forum has become support for everything except omv" [...] "And is like someone is banning Google from their browsers"


    Only two things are infinite, the universe and human stupidity, and I'm not sure about the former.

    Upload Logfile via WebGUI/CLI
    #openmediavault on freenode IRC | German & English | GMT+1
    Absolutely no Support via PM!

  • Hi David,
    At the Time i DDed nothing else had access to my Array...
    My HDDs are assigned to a RAID5-Array with 256KB Stripe size(default-Settings)... yours too?


    Changed the Storsave-Profile from Protection to balanced.
    Write Cache was already enabled, read Cahce was intelligent.


    With the changed storsave Profile i tested again:


    dd if=/dev/zero of=tempfile bs=1MB count=10240


    10240000000 Bytes (10 GB) kopiert, 52,6018 s, 195 MB/s (little bit better..)


    Can't belive that the "lack" of Performance is EXT4-related....
    I decided to use EXT4 instead of XFS after reading this Post http://www.pro-linux.de/artike…das-dateisystem-ext4.html


    What was your Reason to choose XFS?

  • 256KB Stripe size, yes, mine too.
    I don't really know what made me Chose XFS over ext4, if i remember correctly ext4 uses a rather big Journal with 5% of storage, and i think xfs uses a not so large Journal.


    But as far as i see thats the only difference we seem to have in our configuration, except what are your System specs? mine is a core i5 with 4gb of ram.


    Greetings
    David

    "Well... lately this forum has become support for everything except omv" [...] "And is like someone is banning Google from their browsers"


    Only two things are infinite, the universe and human stupidity, and I'm not sure about the former.

    Upload Logfile via WebGUI/CLI
    #openmediavault on freenode IRC | German & English | GMT+1
    Absolutely no Support via PM!

Jetzt mitmachen!

Sie haben noch kein Benutzerkonto auf unserer Seite? Registrieren Sie sich kostenlos und nehmen Sie an unserer Community teil!