How to create 'charts' to show infiniband network traffic

1. offizieller Beitrag

    Hi , I have a (running) infiniband 10Gb netwok, where OMV serves to a Virtulization Test Lab (via iSCSI). It works very nice, and I get about 3,5Gb/sec (iftop)


    I would like to see this network traffic reflected on 'beautifull charts' as with any other network interfaces.


    Can anybody point me things to do and/or where to start ?


    Best Regards.

    OMV 4.x. OMV-Extras ZFS iSCSI Infiniband. Testing OMV 5.1. Testing OMV arm64

    Einmal editiert, zuletzt von vcp_ai ()

    • Offizieller Beitrag

    That would probably require a change in OMV core. Submit request here. Most people probably don't have nice toys like that :) Just out of curiosity, what is the output of: ifconfig -a

    omv 7.0.5-1 sandworm | 64 bit | 6.8 proxmox kernel

    plugins :: omvextrasorg 7.0 | kvm 7.0.13 | compose 7.1.4 | k8s 7.1.0-3 | cputemp 7.0.1 | mergerfs 7.0.4


    omv-extras.org plugins source code and issue tracker - github - changelogs


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

    Infiniband cards (10Gb) are very cheap (used in eB*y) I obtained a switch (same way ) by 200€.


    Result of ifconfig:

    Code
    ib0       Link encap:UNSPEC  HWaddr 80-00-04-04-FE-80-00-00-00-00-00-00-00-00-00-00
          inet addr:192.168.123.25  Bcast:192.168.123.255  Mask:255.255.255.0
          UP BROADCAST RUNNING MULTICAST  MTU:65520  Metric:1
          RX packets:228771314 errors:0 dropped:0 overruns:0 frame:0
          TX packets:236948343 errors:0 dropped:8 overruns:0 carrier:0
          collisions:0 txqueuelen:256
          RX bytes:316304819896 (294.5 GiB)  TX bytes:1229576587415 (1.1 TiB)


    To make them work I had 'only' to add this to /etc/network/interfaces

    Code
    auto ib0
iface ib0 inet static
        address  192.168.123.25
        netmask  255.255.255.0
        pre-up modprobe ib_ipoib
        pre-up echo connected > /sys/class/net/ib0/mode
        mtu 65520


    I obtain a very 'solid' server with OMV annd this network config...
    Regards

    OMV 4.x. OMV-Extras ZFS iSCSI Infiniband. Testing OMV 5.1. Testing OMV arm64

    • Offizieller Beitrag

    I don't about cheap but they are cheaper than I thought.


    Network interfaces are hard-coded in OMV. So, the ib prefix would have to be added to the OMV core. I would file a bug report using the link from my last post.

    omv 7.0.5-1 sandworm | 64 bit | 6.8 proxmox kernel

    plugins :: omvextrasorg 7.0 | kvm 7.0.13 | compose 7.1.4 | k8s 7.1.0-3 | cputemp 7.0.1 | mergerfs 7.0.4


    omv-extras.org plugins source code and issue tracker - github - changelogs


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

    Patch received tested, and working.
    See mantis http://bugtracker.openmediavault.org/view.php?id=1425


    Attached some screen captures and 'nice charts'.
    You can see network bandwith that can be obtained with this solution. Network was stressed using iperf on two nodes.


    Regards

    • Offizieller Beitrag

    Definitely fast. What kind of storage do you have to keep up with it?

    omv 7.0.5-1 sandworm | 64 bit | 6.8 proxmox kernel

    plugins :: omvextrasorg 7.0 | kvm 7.0.13 | compose 7.1.4 | k8s 7.1.0-3 | cputemp 7.0.1 | mergerfs 7.0.4


    omv-extras.org plugins source code and issue tracker - github - changelogs


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

    OMV system is a desktop PC. Intel i3 . 8Gb RAM.
    Storage is:
    - 8GB SSD for OMV
    - 4x512GB HD (desktop SATA series) RAID-Z2 for iSCSI server


    I'm using it as a Shared Storage Server for a Virtualization Test System:
    3 x Proliant G6 servers (bought second hand for 200€ each)
    . Servers only have a 8GB SSD for system
    . Disks for Virtual machines are in the OMV Server, and accesed via iSCSI (that allows me to migrate [online] Virtual Machines between Servers).


    I'm just testing things, but I'm quite happy with my 'NAS' setup with OMV.


    As an example, attached you can find a report from Crystal Diskmark, running on a Virtual Machine as defined in this setup. With corresponding Interface Stats (Read at 6Gb/Write at 2Gb !).
    Virtual Machine's disk is on OMV (another server), so speed reported by CrystalDiskmark, is the better way I've found to test overall speed (Proliant, Virtualization, Network, and OMV ZFS server).


    Now I know that just replacing ZFS disks with SSDs I will have an 'Enterprise Server' (with the benefits of Debian, OpenSource and this Community.)


    Regards

    Hi.


    Im new here so pls forgive me if this clear..


    I just install OMV on my new incredible storage serwer. I install infiniband card, and they work perfectly (when i configure then manually).


    But how i can update my OMV to install ib0????



    Thx for help....

Jetzt mitmachen!

Sie haben noch kein Benutzerkonto auf unserer Seite? Registrieren Sie sich kostenlos und nehmen Sie an unserer Community teil!

Benutzerkonto erstellen Anmelden