Community discussions

MikroTik App
 
wildbill442
Forum Guru
Forum Guru
Topic Author
Posts: 1055
Joined: Wed Dec 08, 2004 7:29 am
Location: Sacramento, CA

ECMP - Poor performance

Fri Aug 24, 2012 8:01 pm

See attached diagram.

I'm having an issue with poor performance across equal routes.

The Core Router and ATC router are linked by three 5GHz wireless links. OSPF is used throughout to distribute routes dynamically, and ECMP and failover is established correctly through OSPF.

Testing each 5GHz link (5G-A, B, and C) via their /32 routes all yield around ~110Mbps aggregate individually. ECMP appears to be working as I'm seeing traffic distributed evenly across all of the links. However I'm seeing poor performance from the customers perspective, as well as when plugged directly into the ATC or SW routers.

I see typically about 125Mbps aggregate at peak times, and when testing speeds I'm only seeing 3-6mbps from any location from speedtest.net, speakeasy.net/speedtest, etc.

Plugged into the core router I see 100+mbps (limited by the CPU on my small laptop.

All devices have public IP addresses, there is no NAT going on.

Hardware:

Core Router: RB1100AHx2
ATC Router: RB1100AHx2
SW Router: RB1100AHx2

5G Links: RB711GA-5HnD

Link from ATC to SW are Dual 11GHz Licensed Microwave links at 250Mbps each. I'm also using ECMP for aggregation and failover across the Licensed Microwave links.

Can anyone explain the poor performance? There's more than enough spectrum separation between the 5GHz links. I'm using 5.4 and 5.7 GHz channels, and as I said before they can push 100+mbps when doing a bandwidth test through the links.

I can post configs upon request.
You do not have the required permissions to view the files attached to this post.
 
wildbill442
Forum Guru
Forum Guru
Topic Author
Posts: 1055
Joined: Wed Dec 08, 2004 7:29 am
Location: Sacramento, CA

Re: ECMP - Poor performance

Fri Aug 24, 2012 8:15 pm

I should note that until yesterday the link between the Core Router and ATC Router was only a dual 5Ghz setup. I added a third 5Ghz link to see if we could increase throughput.

Prior to adding the third 5GHz link traffic was routed over the 2 5GHz links equally about ~50Mbps per link. Same aggregate was achieved of about 125Mbps. The third link just reduced the load now all links show about ~30mbps across each link however no net increase in throughput.
 
gregsowell
Member Candidate
Member Candidate
Posts: 128
Joined: Tue Aug 28, 2007 1:24 am
Contact:

Re: ECMP - Poor performance

Sun Aug 26, 2012 3:58 am

If you plug directly into each 5ghz li k and speed test, what does throughput look like?
 
wildbill442
Forum Guru
Forum Guru
Topic Author
Posts: 1055
Joined: Wed Dec 08, 2004 7:29 am
Location: Sacramento, CA

Re: ECMP - Poor performance

Fri Sep 14, 2012 8:18 pm

I scrapped the 5GHz links... Speeds were really sporadic it seems to be interference or cross talk between the three links. thats causing the poor performance. We're putting in a 24GHz UBNT link, and using the 5GHz as a redundant path. On and slow is better than down.

I also have an 11GHz licensed link, if the 24GHz AirFiber link doesn't perform as advertised.