Help setting up bonding 802.3ad

  • Hi all,


    Im running OMV version 0.5.38 (Sardaukar) on Kernel Linux 2.6.32-5-amd64 on hp n40l h/w. I’ve installed a dual port network card nc360t which I’ve configured in gui to be bonded in 802.3ad mode eth1 and eth2 with eth1 set as primary in options section. This appears as interface bond0 and gets a ip address from dhcp ok as below:




    The onboard eth0 is present and has a static address not bonded. I have a dd-wrt installed on a switch which I understand supports 802.3ad complient and I’ve configured the switch as below.




    When I look at the omv system logs I see messages for eth1 and eth2 - bond0: link status definitely up for interface eth1 and bond0: link status definitely up for interface eth2.


    The issues im experiencing is when I disconnect eth0 from the network I lose complete network connectivity to OMV and im unable to reach the bond0 address. Also when all 3 ethernet ports are connected my wd tv live which streams from omv losses connectivity dropping music if its playing, I reconnect and it does it loses connection again. Have I misconfigured 802.3ad bonding?



    Thank you,


    Pizzafries

  • Outputs from ifconfig & cat /etc/network/interfaces


    root@openmediavault:/# ifconfig


    bond0 Link encap:Ethernet HWaddr xx:xx:xx:xx:xx:xx
    inet addr:192.168.1.75 Bcast:192.168.1.255 Mask:255.255.255.0
    UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1
    RX packets:24488 errors:0 dropped:0 overruns:0 frame:0
    TX packets:10957 errors:0 dropped:0 overruns:0 carrier:0
    collisions:0 txqueuelen:0
    RX bytes:13929604 (13.2 MiB) TX bytes:1072167 (1.0 MiB)


    eth0 Link encap:Ethernet HWaddr xx:xx:xx:xx:xx:xx
    inet addr:192.168.1.30 Bcast:192.168.1.255 Mask:255.255.255.0
    UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
    RX packets:19672 errors:0 dropped:0 overruns:0 frame:0
    TX packets:23009 errors:0 dropped:0 overruns:0 carrier:0
    collisions:0 txqueuelen:1000
    RX bytes:14215590 (13.5 MiB) TX bytes:7257228 (6.9 MiB)
    Interrupt:18


    eth1 Link encap:Ethernet HWaddr xx:xx:xx:xx:xx:xx
    UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
    RX packets:16526 errors:0 dropped:0 overruns:0 frame:0
    TX packets:10813 errors:0 dropped:0 overruns:0 carrier:0
    collisions:0 txqueuelen:1000
    RX bytes:12446435 (11.8 MiB) TX bytes:1054311 (1.0 MiB)
    Interrupt:16 Memory:fe8e0000-fe900000


    eth2 Link encap:Ethernet HWaddr xx:xx:xx:xx:xx:xx
    UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
    RX packets:7962 errors:0 dropped:0 overruns:0 frame:0
    TX packets:144 errors:0 dropped:0 overruns:0 carrier:0
    collisions:0 txqueuelen:1000
    RX bytes:1483169 (1.4 MiB) TX bytes:17856 (17.4 KiB)
    Interrupt:17 Memory:fe880000-fe8a0000


    lo Link encap:Local Loopback
    inet addr:127.0.0.1 Mask:255.0.0.0
    inet6 addr: ::1/128 Scope:Host
    UP LOOPBACK RUNNING MTU:16436 Metric:1
    RX packets:5853 errors:0 dropped:0 overruns:0 frame:0
    TX packets:5853 errors:0 dropped:0 overruns:0 carrier:0
    collisions:0 txqueuelen:0
    RX bytes:1282318 (1.2 MiB) TX bytes:1282318 (1.2 MiB)


    cat /etc/network/interfaces


    # The loopback network interface
    auto lo
    iface lo inet loopback
    iface lo inet6 loopback


    # eth0 network interface
    auto eth0
    allow-hotplug eth0
    iface eth0 inet dhcp
    dns-nameservers 192.168.1.1 192.168.1.1
    iface eth0 inet6 manual
    pre-down ip -6 addr flush dev eth0


    # bond0 network interface
    auto bond0
    iface bond0 inet dhcp
    dns-nameservers 192.168.1.1 192.168.1.1
    bond-slaves eth1 eth2
    bond-primary eth1
    bond-mode 4
    bond-miimon 100
    bond-downdelay 200
    bond-updelay 200
    iface bond0 inet6 manual
    pre-down ip -6 addr flush dev bond0

    • Offizieller Beitrag

    I assume the wrt is your router. You need to setup the agrigation on the switch. If it does not have a web page it is probably not going to support lag. Lag = 802.3ad


    Are you pluging the server into the router? What router is that?

  • root@openmediavault:/# cat /proc/net/bonding/bond0
    Ethernet Channel Bonding Driver: v3.7.1 (April 27, 2011)


    Bonding Mode: IEEE 802.3ad Dynamic link aggregation
    Transmit Hash Policy: layer2 (0)
    MII Status: up
    MII Polling Interval (ms): 100
    Up Delay (ms): 200
    Down Delay (ms): 200


    802.3ad info
    LACP rate: slow
    Min links: 0
    Aggregator selection policy (ad_select): stable
    Active Aggregator Info:
    Aggregator ID: 2
    Number of ports: 3
    Actor Key: 17
    Partner Key: 1000
    Partner Mac Address: xx:xx:xx:xx:xx:xx


    Slave Interface: eth1
    MII Status: up
    Speed: 1000 Mbps
    Duplex: full
    Link Failure Count: 0
    Permanent HW addr: xx:xx:xx:xx:xx:xx
    Aggregator ID: 2
    Slave queue ID: 0


    Slave Interface: eth2
    MII Status: up
    Speed: 1000 Mbps
    Duplex: full
    Link Failure Count: 0
    Permanent HW addr: xx:xx:xx:xx:xx:xx
    Aggregator ID: 2
    Slave queue ID: 0


    Slave Interface: eth0
    MII Status: up
    Speed: 1000 Mbps
    Duplex: full
    Link Failure Count: 0
    Permanent HW addr: xx:xx:xx:xx:xx:xx
    Aggregator ID: 2
    Slave queue ID: 0
    root@openmediavault:/#

    • Offizieller Beitrag

    I am no expert but it looks like it is working to me. Look in /var/log/messages. I see this

    Code
    bonding: Warning: either miimon or arp_interval and arp_ip_target module parameters must be specified, otherwise bonding will not detect link failures! see bonding.txt for details.
    If you have souces installed it is here /usr/src/linux-source-2.6.32/Documentation/networking/bonding.txt
  • I dont see that message, i see:


    Mar 17 23:32:24 openmediavault kernel: [ 14.967534] bonding: Ethernet Channel Bonding Driver: v3.7.1 (April 27, 2011)
    Mar 17 23:32:24 openmediavault kernel: [ 14.974070] bonding: bond0: setting mode to 802.3ad (4).
    Mar 17 23:32:24 openmediavault kernel: [ 14.974160] bonding: bond0: Setting MII monitoring interval to 100.
    Mar 17 23:32:24 openmediavault kernel: [ 14.974247] bonding: bond0: Setting up delay to 200.
    Mar 17 23:32:24 openmediavault kernel: [ 14.974306] bonding: bond0: Setting down delay to 200.
    Mar 17 23:32:24 openmediavault kernel: [ 14.996715] bonding: bond0: Adding slave eth1.
    Mar 17 23:32:24 openmediavault kernel: [ 15.203510] bonding: bond0: enslaving eth1 as a backup interface with a down link.
    Mar 17 23:32:24 openmediavault kernel: [ 15.211172] bonding: bond0: Adding slave eth2.
    Mar 17 23:32:24 openmediavault kernel: [ 15.415479] bonding: bond0: enslaving eth2 as a backup interface with a down link.
    Mar 17 23:32:24 openmediavault kernel: [ 15.423426] bonding: bond0: Adding slave eth0.
    Mar 17 23:32:24 openmediavault kernel: [ 16.204427] bonding: bond0: enslaving eth0 as a backup interface with a down link.
    Mar 17 23:32:24 openmediavault kernel: [ 16.210400] bonding: bond0: Unable to set primary slave; bond0 is in mode 4
    Mar 17 23:32:24 openmediavault kernel: [ 16.221568] ADDRCONF(NETDEV_UP): bond0: link is not ready
    Mar 17 23:32:24 openmediavault kernel: [ 17.853007] e1000e: eth2 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: Rx/Tx
    Mar 17 23:32:24 openmediavault kernel: [ 17.940124] bonding: bond0: link status up for interface eth2, enabling it in 0 ms.
    Mar 17 23:32:24 openmediavault kernel: [ 17.940134] bonding: bond0: link status definitely up for interface eth2, 1000 Mbps full duplex.
    Mar 17 23:32:24 openmediavault kernel: [ 17.942344] ADDRCONF(NETDEV_CHANGE): bond0: link becomes ready
    Mar 17 23:32:24 openmediavault kernel: [ 18.117172] e1000e: eth1 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: Rx/Tx
    Mar 17 23:32:24 openmediavault kernel: [ 18.140248] bonding: bond0: link status up for interface eth1, enabling it in 200 ms.
    Mar 17 23:32:24 openmediavault kernel: [ 18.340180] bonding: bond0: link status definitely up for interface eth1, 1000 Mbps full duplex.
    Mar 17 23:32:24 openmediavault kernel: [ 19.035320] Software Watchdog Timer: 0.07 initialized. soft_noboot=0 soft_margin=60 sec soft_panic=0 (nowayout= 0)
    Mar 17 23:32:24 openmediavault kernel: [ 19.063776] wd_keepalive (1505): /proc/1505/oom_adj is deprecated, please use /proc/1505/oom_score_adj instead.
    Mar 17 23:32:24 openmediavault kernel: [ 19.292000] tg3 0000:04:00.0: eth0: Link is up at 1000 Mbps, full duplex
    Mar 17 23:32:24 openmediavault kernel: [ 19.292011] tg3 0000:04:00.0: eth0: Flow control is on for TX and on for RX
    Mar 17 23:32:24 openmediavault kernel: [ 19.344106] bonding: bond0: link status up for interface eth0, enabling it in 200 ms.
    Mar 17 23:32:24 openmediavault kernel: [ 19.544184] bonding: bond0: link status definitely up for interface eth0, 1000 Mbps full duplex.

  • Does this may help you?


    http://h30499.www3.hp.com/t5/N…td-p/5570403#.UyeKG4X7F69


    Greetings
    David

    "Well... lately this forum has become support for everything except omv" [...] "And is like someone is banning Google from their browsers"


    Only two things are infinite, the universe and human stupidity, and I'm not sure about the former.

    Upload Logfile via WebGUI/CLI
    #openmediavault on freenode IRC | German & English | GMT+1
    Absolutely no Support via PM!

    • Offizieller Beitrag

    eth0 is set to dhcp in the post above. Did you add it to the bond after you posted that?


    Here is my /etc/network/interfaces. I don't think I modifyed it.


    As far as I know it is working but have not tested much.

  • Thank you david2k & donh,


    I will look into the link :)


    Yday I created a static ip 802.3ad bond with all three interfaces eth0 eth1 eth2.


    My latest cat /etc/network/interfaces output:
    # The loopback network interface
    auto lo
    iface lo inet loopback
    iface lo inet6 loopback


    # bond0 network interface
    auto bond0
    iface bond0 inet static
    address 192.168.1.10
    gateway 192.168.1.1
    netmask 255.255.255.0
    dns-nameservers 192.168.1.1 192.168.1.1
    bond-slaves eth1 eth2 eth0
    bond-primary eth2
    bond-mode 4
    bond-miimon 100
    bond-downdelay 200
    bond-updelay 200
    iface bond0 inet6 manual
    pre-down ip -6 addr flush dev bond0

  • Hi, just sharing my config for others to use as a reference. It took me a while to get this going.


    I have three network interfaces, for my setup I wanted 802.3ad/LACP bonding plus two bridge interfaces.


    - eth0,eth2 are bonded (bond0) and connected to my lab network
    - eth1 not bonded and connected to my homenetwork
    - labbr0 bridge interface connected to bond0
    - hombr0 bridge interface connected to eth1


    I have Cisco SG 200-18 18-Port Gigabit Smart Switch configured correctly for eth0 and eth2.
    I did configure bonding via Openmediavault admin console, then I lock the network file with the "chattr" command so that Openmediavault cannot modify my changes.


    chattr +i /etc/network/interfaces


    And the contents of that file.


    $ cat /etc/network/interfaces
    # The loopback network interface
    auto lo
    iface lo inet loopback
    iface lo inet6 loopback


    # Network interfaces
    allow-hotplug eth0
    iface eth0 inet manual
    pre-up ifconfig $IFACE up
    pre-down ifconfig $IFACE down


    allow-hotplug eth1
    iface eth1 inet manual
    pre-up ifconfig $IFACE up
    pre-down ifconfig $IFACE down


    allow-hotplug eth2
    iface eth2 inet manual
    pre-up ifconfig $IFACE up
    pre-down ifconfig $IFACE down


    # bond0 network interface
    auto bond0
    iface bond0 inet manual
    bond-slaves eth0 eth2
    bond-primary eth0
    bond-mode 4
    bond-miimon 100
    bond-downdelay 200
    bond-updelay 200
    iface bond0 inet6 manual
    pre-down ip -6 addr flush dev bond0


    # homenet bridge on eth1 HOMENET NEtwork
    auto hombr0
    iface hombr0 inet static
    address 192.168.10.5
    gateway 192.168.10.1
    netmask 255.255.255.0
    dns-nameservers 8.8.8.8
    bridge_ports eth1
    bridge_fd 0
    bridge_hello 0
    bridge_maxage 0
    bridge_stp on
    bridge_waitport 0



    # labnet bridge on eth1 LABNET Network
    auto labbr0
    iface labbr0 inet static
    address 192.168.40.4
    gateway 192.168.40.1
    netmask 255.255.255.0
    dns-nameservers 8.8.8.8
    bridge_ports bond0
    bridge_fd 0
    bridge_hello 0
    bridge_maxage 0
    bridge_stp on
    bridge_waitport 0

Jetzt mitmachen!

Sie haben noch kein Benutzerkonto auf unserer Seite? Registrieren Sie sich kostenlos und nehmen Sie an unserer Community teil!