Community discussions

MikroTik App
 
tangram
Member Candidate
Member Candidate
Topic Author
Posts: 132
Joined: Wed Nov 16, 2016 9:55 pm

Bond interface(balance-rr) and bridging

Mon Jun 12, 2017 9:28 am

Hi,

I'm trying to have ethernet ports and a balance-rr bonding interface in the same bridge but it doesn't seem to work - i get a message that the bond interface is receiving same mac on different port. The device is a rb3011, I have the sfp and ether1 in the bonding interface connected to a smartswitch(i could use lacp here but for ros balance-rr is far better). This interface i put in a bridge with ether2-5. I set everything and all works until i connect the second port of the bonding interface.

I thought to configure the bond interface as trunk and have ports 2-5 as bridge in the same vlan with the ports of the switch - assume vlan1. Didn't have time to test this tough.
Can this be done using another approach ? I'm trying to do this so that I don't have to buy another switch :)


Thanks.
 
User avatar
pukkita
Trainer
Trainer
Posts: 3051
Joined: Wed Dec 04, 2013 11:09 am
Location: Spain

Re: Bond interface(balance-rr) and bridging

Mon Jun 12, 2017 10:24 am

ROS version and firmware version?

post an export so that all details can be taken into account.

May not have anything to do with this, but FYI from 6.39.2 changelog:
*) bonding - do not add bonding interface if "could not set MTU" error is received;
 
tangram
Member Candidate
Member Candidate
Topic Author
Posts: 132
Joined: Wed Nov 16, 2016 9:55 pm

Re: Bond interface(balance-rr) and bridging

Mon Jun 12, 2017 5:17 pm

ROS version and firmware version?

post an export so that all details can be taken into account.

May not have anything to do with this, but FYI from 6.39.2 changelog:
*) bonding - do not add bonding interface if "could not set MTU" error is received;
ROS is 6.39.2 firmware is 3.35
I've narrowed down the problem. The problem appears when I add the bond interface to bridge. Message is "bridge port received packet with own address as source address".
I think it may be switch related but i don't know why bonding without bridge works.

Setup has nothing special:

/interface bridge
add name=LAN
/interface ethernet
set [ find default-name=sfp1 ] name=SFP-LANSwitch
set [ find default-name=ether2 ] name=ether2-LANSwitch

/interface bonding
add name=BondTrunk slaves=SFP-LANSwitch,ether2-LANSwitch
/interface bridge port
add bridge=LAN interface=BondTrunk
add bridge=LAN interface=ether1-PowerOnly
add bridge=LAN interface=ether3
add bridge=LAN interface=ether4
add bridge=LAN interface=ether5


Ok, i set 802.3ad and lacp works. Any ideas how to fix it for balance-rr ?
 
User avatar
pukkita
Trainer
Trainer
Posts: 3051
Joined: Wed Dec 04, 2013 11:09 am
Location: Spain

Re: Bond interface(balance-rr) and bridging

Tue Jun 13, 2017 10:43 am

Post a
/interface print detail where !dynamic
This is to double check there's no duplicated mac address.

If there's no duplicated mac, I'd generate a supout while the problem is happening and email it to support.
 
tangram
Member Candidate
Member Candidate
Topic Author
Posts: 132
Joined: Wed Nov 16, 2016 9:55 pm

Re: Bond interface(balance-rr) and bridging

Tue Jun 13, 2017 5:21 pm

Post a
/interface print detail where !dynamic
This is to double check there's no duplicated mac address.

If there's no duplicated mac, I'd generate a supout while the problem is happening and email it to support.
You were right, the bridge get's the bond interface's mac:

0 RS name="SFP-LANSwitch" default-name="sfp1" type="ether" mtu=1500
actual-mtu=1500 l2mtu=1600 max-l2mtu=8158 mac-address=6C:3B:6B:F8:6A:70
fast-path=yes last-link-up-time=jun/13/2017 17:06:17 link-downs=0


2 RS name="ether2-LANSwitch" default-name="ether2" type="ether" mtu=1500
actual-mtu=1500 l2mtu=1598 max-l2mtu=8156 mac-address=6C:3B:6B:F8:6A:6C
fast-path=yes last-link-up-time=jun/13/2017 17:06:19 link-downs=0

11 RS name="BondTrunk" type="bond" mtu=1500 actual-mtu=1500 l2mtu=1598
mac-address=6C:3B:6B:F8:6A:6C fast-path=yes
last-link-up-time=jun/13/2017 17:06:17 link-downs=0

12 R name="LAN" type="bridge" mtu=auto actual-mtu=1500 l2mtu=1598
mac-address=6C:3B:6B:F8:6A:6C fast-path=yes
last-link-up-time=jun/13/2017 17:05:17 link-downs=0


I changed the mac address from bridge and sfp so that there are no duplicates but i still get that message when i set balance-rr. Only lacp dynamic works.
 
adaanhaupt
just joined
Posts: 5
Joined: Sat Oct 18, 2014 8:27 pm

Re: Bond interface(balance-rr) and bridging

Wed Jun 14, 2017 8:23 am

I am interested, i have been playing with bonding and it works, but the problem that I found is that it is slow? If I don speed teat over one of yhe erthernet bond links I get 250mbps if I do the speed test over the two ethernet bond links I get 125 per ethernet port. Have you experienced the same? I thought that if you bonded the two ethernet ports, that the threw put will increase. I am bonding between two CCR's
 
tangram
Member Candidate
Member Candidate
Topic Author
Posts: 132
Joined: Wed Nov 16, 2016 9:55 pm

Re: Bond interface(balance-rr) and bridging

Wed Jun 14, 2017 11:01 am

I don't have the setup to test full throughput but i get beyond the speed of one link. I download from a storage with around 1.3 gb and the traffic is balanced over the 2 interfaces in balance-rr mode. LACP works too but your limited per data flow at interface speed. I get max around 850mb per file transfer over one interface and if I start another transfer from different host i get around 400mb, over the second interface. So depends on what you need to achieve. Sadly in my case, so far only lacp works. In your while using CCRs you should not have problems.

I would set bond interface only on one CCR and on the other just put ports in the same bridge, or set them as slave - balance-rr implies the other side is a generic switch.
 
User avatar
pukkita
Trainer
Trainer
Posts: 3051
Joined: Wed Dec 04, 2013 11:09 am
Location: Spain

Re: Bond interface(balance-rr) and bridging

Wed Jun 14, 2017 11:04 am

2 RS name="ether2-LANSwitch" default-name="ether2" type="ether" mtu=1500
actual-mtu=1500 l2mtu=1598 max-l2mtu=8156 mac-address=6C:3B:6B:F8:6A:6C
fast-path=yes last-link-up-time=jun/13/2017 17:06:19 link-downs=0

11 RS name="BondTrunk" type="bond" mtu=1500 actual-mtu=1500 l2mtu=1598
mac-address=6C:3B:6B:F8:6A:6C fast-path=yes
last-link-up-time=jun/13/2017 17:06:17 link-downs=0

12 R name="LAN" type="bridge" mtu=auto actual-mtu=1500 l2mtu=1598
mac-address=6C:3B:6B:F8:6A:6C fast-path=yes
last-link-up-time=jun/13/2017 17:05:17 link-downs=0
That one was duplicated too... If there's no duplicates now, set up balance rr, make a supout while the issue is happening and email support.
 
tangram
Member Candidate
Member Candidate
Topic Author
Posts: 132
Joined: Wed Nov 16, 2016 9:55 pm

Re: Bond interface(balance-rr) and bridging

Wed Jun 14, 2017 11:44 am

I saw after i posted and changed that one too, but still no joy. I'll send the supout, thanks.
 
tangram
Member Candidate
Member Candidate
Topic Author
Posts: 132
Joined: Wed Nov 16, 2016 9:55 pm

Re: Bond interface(balance-rr) and bridging

Wed Jun 14, 2017 1:24 pm

I'm doing some more testing meanwhile. CRS109-8G with cisco 2960g switch and 6.39.2 works with balance-rr and there are no errors. I'm setting the cisco with etherchannel though..i'll try more tinkering with the other switch( hp 2410-24g)
 
tangram
Member Candidate
Member Candidate
Topic Author
Posts: 132
Joined: Wed Nov 16, 2016 9:55 pm

Re: Bond interface(balance-rr) and bridging

Wed Jun 14, 2017 5:02 pm

It's fixed now. I set the switch to static aggregation or whatever the hp equivalent term for cisco's etherchannel is. The bond interface works in balance-rr and there are no mac errors. Also I removed the bogus macs that I've previously set on mikrotik. To others, please be advised that bridge and bonding may require switch setup even if bonding without bridge does not.
 
kor3k
just joined
Posts: 9
Joined: Mon Dec 21, 2015 7:11 pm

Re: Bond interface(balance-rr) and bridging

Fri Jan 05, 2018 1:10 pm

It's fixed now. I set the switch to static aggregation or whatever the hp equivalent term for cisco's etherchannel is. The bond interface works in balance-rr and there are no mac errors. Also I removed the bogus macs that I've previously set on mikrotik. To others, please be advised that bridge and bonding may require switch setup even if bonding without bridge does not.
hello,

how did you fix it? we are having the same problem too. i noticed that mac address of the bonding equals mac of the first member port, this is supposed to be normal afaik.
 
User avatar
acruhl
Member
Member
Posts: 371
Joined: Fri Jul 03, 2015 7:22 pm

Re: Bond interface(balance-rr) and bridging

Fri Jan 05, 2018 2:59 pm

I'm doing some more testing meanwhile. CRS109-8G with cisco 2960g switch and 6.39.2 works with balance-rr and there are no errors. I'm setting the cisco with etherchannel though..i'll try more tinkering with the other switch( hp 2410-24g)
hello,

how did you fix it? we are having the same problem too. i noticed that mac address of the bonding equals mac of the first member port, this is supposed to be normal afaik.
For a long time, Cisco switches have only supported PAgP or LACP, so whatever the above poster did with his Cisco 2960g it is not compatible with balance-rr. If you want to be compatible between a MikroTik and any "enterprise" level switch you have to use LACP on both ends. Otherwise, I believe you would be using balance-rr only on the MikroTik end because a Cisco has no knowledge of this, it's only working on the MikroTik end.
 
tangram
Member Candidate
Member Candidate
Topic Author
Posts: 132
Joined: Wed Nov 16, 2016 9:55 pm

Re: Bond interface(balance-rr) and bridging

Fri Jan 05, 2018 3:22 pm

For a long time, Cisco switches have only supported PAgP or LACP, so whatever the above poster did with his Cisco 2960g it is not compatible with balance-rr. If you want to be compatible between a MikroTik and any "enterprise" level switch you have to use LACP on both ends. Otherwise, I believe you would be using balance-rr only on the MikroTik end because a Cisco has no knowledge of this, it's only working on the MikroTik end.
This is only partially true. Balance-rr assumes dumb switch on the other side, so it should work no matter what is on the other side. Problem is it doesn't, which is what I've found. You need to configure the switch with etherchannel for cisco or link aggregation for hp. If you don't configure the switch, you end up with mac-flap issues.
Curious thing is that it worked without switch configuration when having only the bond-interface. Problem appeared when creating a bridge with bond-interface and other ethernet interfaces of the same router. Mikrotik router is now at version 6.40.4 and all is working well , connected to HP-switch.