Forest Notes

Tips, tricks, cheatsheets


Project maintained by iamzaychik Hosted on GitHub Pages — Theme by mattgraham

Dell Configuring LACP between OpenIndiana and a Dell Force10 switch

2019-04-15

Link aggregation is a method of bundling interfaces together to act as one for increased bandwith and/or failover. One of most used protocols, next to a couple of proprietary ones, for controlling such a channel bond is **LACP</strong>, the * Link Aggregation Control Protocol.

1. Configuring LACP on Dell S4810

Let’s assume, we want to bond two 10G Ethernet ports together, namely **TenGigabitEthernet 0/32</strong> and **TenGigabitEthernet 0/33</strong> `S4810(conf)#interface range tengigabitethernet 0/32 , tengigabitethernet 0/33 S4810(conf-if-range-te-0/32,te-0/33)#port-channel-protocol LACP S4810(conf-if-range-te-0/32,te-0/33-lacp)#  port-channel 9 mode active S4810(conf-if-range-te-0/32,te-0/33-lacp)#show conf ! interface TenGigabitEthernet 0/32 description po9 uplink to Server47 no ip address flowcontrol rx on tx off ! port-channel-protocol LACP port-channel 9 mode active no shutdown ! interface TenGigabitEthernet 0/33 description po9 uplink to Server47 no ip address flowcontrol rx on tx off ! port-channel-protocol LACP port-channel 9 mode active no shutdown` Next, the port-channel interface needs to be configured as **layer 2 port</strong> and **activated afterwards</strong>: `S4810(conf)#interface port-channel 9 S4810(conf-if-po-9)#description Uplink to Server47 S4810(conf-if-po-9)#switchport S4810(conf-if-po-9)#no shutdown S4810(conf-if-po-9)#show config ! interface Port-channel 9 description Uplink to Server47 no ip address switchport no shutdown` It’s always good practice to also change the description. Depending on your configuration, you might want to change the **vlan settings</strong> for this newly created port-channel as well: `S4810(conf)#interface vlan 11 S4810(conf-if-vl-11)#untagged port-channel 9 S4810(conf-if-vl-11)#show config ! interface Vlan 11 description VLAN11-LAN ip address 10.11.1.10/16 tagged TenGigabitEthernet 0/8-13 tagged Port-channel 1-5,11,13-14 untagged TenGigabitEthernet 0/14,19-20,23,38,46 untagged Port-channel 9 ip helper-address 10.10.10.1 no shutdown` Of course, depending on the actual network topology, your mileage might vary here. Note that the port-channel will stay in a ‘down’ state until it can exchange LACPDUs with the remote end: `S4810(conf)#do show interfaces port-channel 9 brief Codes: L - LACP Port-channel LAG  Mode  Status       Uptime      Ports L   9    L2L3  down         00:00:00`

2. Configuring LACP on OpenIndiana

First, disable the **NWAM</strong> (Network Auto Magic) service:

* ?
1
2
# svcadm disable svc:/network/physical:nwam`</div>
# svcadm enable svc:/network/physical:default`</div> </div></td> </tr> </tbody> </table> </div> </div> To **list the available physical ports</strong>, use `dladm`
* ?
1
2
3
4
5
6
7
8
root@Server47:~`# dladm show-phys`</div>
LINK         MEDIA                STATE      SPEED  DUPLEX    DEVICE`</div>
myri10ge1    Ethernet             down       10000  full      myri10ge1`</div>
myri10ge0    Ethernet             down       10000  full      myri10ge0`</div>
bnx2         Ethernet             down       0      unknown   bnx2`</div>
bnx0         Ethernet             up         1000   full      bnx0`</div>
bnx1         Ethernet             down       0      unknown   bnx1`</div>
bnx3         Ethernet             down       0      unknown   bnx3`</div> </div></td> </tr> </tbody> </table> </div> </div> To create an aggregate device with **two links</strong> (`myri10ge0` and `myri10ge1`) in **LACP mode</strong> (`-L active`) with and * L2 failover policy (Determines the outgoing link by hashing the MAC (L2) header of each packet), run:
* ?
1
dladm create-aggr -l myri10ge0 -l myri10ge1 -L active -P L2 aggr1`</div> </div></td> </tr> </tbody> </table> </div> </div> You can use `dladm show-aggr` to see the **current state</strong>:
* ?
1
2
3
root@Server47:~`# dladm show-aggr`</div>
LINK            POLICY   ADDRPOLICY           LACPACTIVITY  LACPTIMER   FLAGS`</div>
aggr1           L2       auto                 active        short       -----`</div> </div></td> </tr> </tbody> </table> </div> </div> Next, **create an interface</strong> `aggr1`:
* ?
1
2
3
4
5
6
root@Server47:~`# ipadm create-if aggr1`</div>
root@Server47:~`# ipadm show-if`</div>
IFNAME     STATE    CURRENT      PERSISTENT`</div>
lo0        ok       -m-`v`------46 ---`</div>
bnx0       ok       bm--------46 -46`</div>
aggr1      down     bm--------46 -46`</div> </div></td> </tr> </tbody> </table> </div> </div> You should now see that the LACP link is established on the layer 2 switch:
* ?
1
2
3
4
5
6
S4810(conf)`#do show interfaces port-channel 9 brief`</div>
Codes: L - LACP Port-channel`</div>
    `LAG  Mode  Status       Uptime      Ports          `</div>
L   9    L2L3  up           00:00:00    Te 0`/32`    (Up)`</div>
                                        `Te 0`/33`    (Up)`</div> </div></td> </tr> </tbody> </table> </div> </div> The last thing left to do is to **create an IP address</strong> on top of the `aggr1` interface:
* ?
1
root@Server47:~`# ipadm create-addr -T static -a 10.11.20.6/16 aggr1/v4`</div> </div></td> </tr> </tbody> </table> </div> </div> Again, depending on your topology, you might want to **add/edit you default route</strong> to go over the aggragate interface. -----