Community discussions

MikroTik App
 
mtmx80
Frequent Visitor
Frequent Visitor
Topic Author
Posts: 87
Joined: Wed Mar 16, 2011 11:12 pm

[Solved] RB750G ROS 5.2 serious performance issue.

Sat May 14, 2011 10:01 pm

Hi Guys,

Its my first MT router. I have started up with factory default config and changed it to fit my requirements.
Factory default is:
1. port WAN, 2,3,4,5 grouped to Switch port.
Firewall NAT srcnat masquerade.

My change: 1. Port WAN Uplink - Bridged to DMZ VLAN
2,3,4,5 Ports - Default untagged traffic, DMZ VLAN


Problem is that traffic from WAN to LAN port is peaks at about 65Mbps, while traffic from LAN to WAN peaks at about 30Mbps.
CPU utilization is not high. (10-20%). - So it's 30% of 100Mbps link rate!
But if I try to reach the server attached to the LAN port of RB750G from distant location results are catastrophic.
In country traffic within 2-3 hop is up to 30Mbps,
European countries 4-8 hops (ping 30) ~6Mbps,
USA California 10+ hops (ping 180) 0.7 Mbps
Australia lot of hops (ping >300) 0.3 Mbps.

This is same on NAT-ed interface and Bridged interface too.
Same tests without MT Router are at least 10 times better; in country traffic are on stable 100Mbps.
Several tests are made with similar results. This one was http download of a 4GB file on a single thread. As additional threads are added performance is growing. So it looks like something is limiting throughput in MT router.

Checked things:
There are no queues defined or any limit applied.
CPU is not overloaded <50%.
Same results in NATed and Bridged mode.
MT Router is attached to a Cisco WS-C3750 and/or Cisco WS-C3550 switch. No difference. No frame/packet errors.
Both sided are in 100Full duplex by auto negotiation. - Changed all possibilities with no/or minor change. Best performance was using 10Mbps Full duplex !!!
After RouterOS downgrade to 4.17 everyting become about 3 times faster in local traffic, but as latency increases performance drop still drastic.
MikroTik BW test in TCP mode drops connection constantly, While in UDP mode (packet size 1500) between two PCs tops at 35 Mbps/ thread.

Please help.

Best regards,
r.
Last edited by mtmx80 on Fri May 20, 2011 12:37 pm, edited 2 times in total.
 
dadaniel
Member Candidate
Member Candidate
Posts: 221
Joined: Fri May 14, 2010 11:51 pm

Re: RB750G ROS 5.2 100/100 Mbps link serious performance iss

Sun May 15, 2011 12:59 am

This is a known problem with v5.2

switch back to the latest 4.x firmware and your problem is solved
 
mtmx80
Frequent Visitor
Frequent Visitor
Topic Author
Posts: 87
Joined: Wed Mar 16, 2011 11:12 pm

Re: RB750G ROS 5.2 100/100 Mbps link serious performance iss

Sun May 15, 2011 1:38 am

Thanks,

I agree. Downgrading to 4.17 helps much, but not as much as it should... It's a gigabyte router and it should easily push 100Mbps in bridged mode (since there is no much processing requirement for that). So I still unhappy even with 4.17 with its ~20Mbps/thread upload capability in real WAN environment.

I see demo2.mt.lv already use RouterOS 5.3 and hope this issue fill be fixed in it.
This is a known problem with v5.2

switch back to the latest 4.x firmware and your problem is solved
 
mtmx80
Frequent Visitor
Frequent Visitor
Topic Author
Posts: 87
Joined: Wed Mar 16, 2011 11:12 pm

Re: RB750G ROS 5.2 100/100 Mbps link serious performance iss

Mon May 16, 2011 3:12 pm

Is it possible to bridge two ports and achieve nearly wire speed (100Mbps) performance on RB750G? - WAN port should be bridged to a DMZ VLAN in my case. Could you please help?
 
fewi
Forum Guru
Forum Guru
Posts: 7717
Joined: Tue Aug 11, 2009 3:19 am

Re: RB750G ROS 5.2 100/100 Mbps link serious performance iss

Mon May 16, 2011 4:23 pm

Bridging goes through the CPU. Use the switch chip instead, that's all in hardware and will be wire speed at a gig.
 
mtmx80
Frequent Visitor
Frequent Visitor
Topic Author
Posts: 87
Joined: Wed Mar 16, 2011 11:12 pm

Re: RB750G ROS 5.2 100/100 Mbps link serious performance iss

Mon May 16, 2011 9:41 pm

Thanks for your reply, I would be happy to use switch chip but I can't found how to tag/untag VLAN traffic between WAN port and DMZ VLAN. Can you help me regarding this?

Additionally regardless if it goes through CPU or not specification states it can route up to 560Mbps. Bridging is not more CPU intensive than routing. CPU load is still low and throughput of the router still around 20-30 Mbps. In higher latency network its 2-3 Mbps! :( It's absolutely unacceptable. If I start upload on multiple threads I'm able to reach 100Mbps without any issue even more 300-400Mbps is reachable too. The question is why is it not able to put whole bandwidth on single thread while there are enough CPU resources?
Bridging goes through the CPU. Use the switch chip instead, that's all in hardware and will be wire speed at a gig.
 
kirshteins
MikroTik Support
MikroTik Support
Posts: 592
Joined: Tue Dec 02, 2008 10:55 am

Re: RB750G ROS 5.2 100/100 Mbps link serious performance iss

Tue May 17, 2011 9:03 am

Benchmark tests for 750G can be found here: http://www.routerboard.com/pdf/routerbo ... _tests.pdf

Mtmx80, please generate and send supout.rif file to support@mikrotik.com if you are experiencing much lower results.
http://wiki.mikrotik.com/wiki/Manual:Su ... utput_File
 
mtmx80
Frequent Visitor
Frequent Visitor
Topic Author
Posts: 87
Joined: Wed Mar 16, 2011 11:12 pm

Re: RB750G ROS 5.2 100/100 Mbps link serious performance iss

Tue May 17, 2011 6:34 pm

Thank you,
That's the one what I was researched to decide what to purchase.
Firewall On
Conntrack On
Mode: Bridging (There is no FW nor NAT on bridge)
Small packets: 32.93Mbps 50200 packets
Medium size packets: 199.28Mbps 47000 packets
Large packets: 505.19Mbps 41600 packets

I have div it with 2 due to two way communication and once more with 2 to be sure half of advertised should go for sure....but it doesn't. :( and its nothing to do with CPU performance. Its bug somewhere in packet processing/forwarding.

I have opened a ticket and sent the support.rif few days ago. I hope this issue is caused by my mistake in configuration and you will be able to pinpoint where it is.

Benchmark tests for 750G can be found here: http://www.routerboard.com/pdf/routerbo ... _tests.pdf

Mtmx80, please generate and send supout.rif file to support@mikrotik.com if you are experiencing much lower results.
http://wiki.mikrotik.com/wiki/Manual:Su ... utput_File
 
mtmx80
Frequent Visitor
Frequent Visitor
Topic Author
Posts: 87
Joined: Wed Mar 16, 2011 11:12 pm

Re: RB750G ROS 5.2 100/100 Mbps link serious performance iss

Wed May 18, 2011 5:20 pm

I found out this:

It could be issue with TCP Window sizes. We will probably hear that there is nothing to do with TCP window sizes in MT router, but I think differently. Cisco routers has TCP Wndow size/scaling support too, so there should be a good reason for that.

There is a quite good article on TCP throughput calculation depending on latency (WAN): http://bradhedlund.com/2008/12/19/how-t ... nce-links/
Mikrotik bridge:
05:58:32.136039 IP debian.44290 > 91.*.*.45.www: Flags [.], ack 1433521, win 708, options [nop,nop,TS val 16501354 ecr 86474990], length 0
05:58:32.136249 IP debian.44290 > 91.*.*.45.www: Flags [.], ack 1436417, win 708, options [nop,nop,TS val 16501355 ecr 86474999], length 0
05:58:32.136509 IP debian.44290 > 91.*.*.45.www: Flags [.], ack 1439313, win 708, options [nop,nop,TS val 16501355 ecr 86474999], length 0
05:58:32.176153 IP debian.44290 > 91.*.*.45.www: Flags [.], ack 1440761, win 708, options [nop,nop,TS val 16501365 ecr 86474999], length 0

Without MT:
06:03:03.815130 IP debian.43397 > 91.*.*.45.www: Flags [.], ack 15093757, win 9826, options [nop,nop,TS val 16569274 ecr 2004054506,nop,nop,sack 3 {16646013:16777597}{16640221:16643117}{16635877:16638773}], length 0
06:03:03.815137 IP debian.43397 > 91.*.*.45.www: Flags [.], ack 15096653, win 9823, options [nop,nop,TS val 16569274 ecr 2004054506,nop,nop,sack 3 {16646013:16777597}{16640221:16643117}{16635877:16638773}], length 0
06:03:03.815500 IP debian.43397 > 91.*.*.45.www: Flags [.], ack 15100997, win 9946, options [nop,nop,TS val 16569274 ecr 2004054506,nop,nop,sack 3 {16646013:16777597}{16640221:16643117}{16635877:16638773}], length 0
06:03:04.102241 IP debian.43397 > 91.*.*.45.www: Flags [.], ack 16777598, win 12014, options [nop,nop,TS val 16569346 ecr 2004054583], length 0
Performance is proportional with window size. It looks like MT blocks window size scaling and that is the reason of bad performance.
 
mtmx80
Frequent Visitor
Frequent Visitor
Topic Author
Posts: 87
Joined: Wed Mar 16, 2011 11:12 pm

Re: [Solved] RB750G ROS 5.2 serious performance issue.

Fri May 20, 2011 12:39 pm

Hi guys,

I can confirm that there is huge performance improvement in ROS 5.3 even compared to 4.17. So do not downgrade, it's better to wait few days and upgrade to 5.3.

Life is nice again :D
 
tchus
Member Candidate
Member Candidate
Posts: 111
Joined: Tue Jan 25, 2011 12:08 am

Re: [Solved] RB750G ROS 5.2 serious performance issue.

Sat May 21, 2011 6:45 am

So where's the 5.3? :shock:
 
suse
newbie
Posts: 28
Joined: Tue Mar 29, 2011 3:32 pm
Location: China

Re: [Solved] RB750G ROS 5.2 serious performance issue.

Sat May 21, 2011 9:45 am

So where's the 5.3? :shock:
send email to support. :D
 
rotten777
Frequent Visitor
Frequent Visitor
Posts: 99
Joined: Thu Dec 17, 2009 5:21 am

Re: [Solved] RB750G ROS 5.2 serious performance issue.

Sat May 21, 2011 5:09 pm

Hi guys,

I can confirm that there is huge performance improvement in ROS 5.3 even compared to 4.17. So do not downgrade, it's better to wait few days and upgrade to 5.3.

Life is nice again :D

that's good to hear! 8)
 
uscallesen
just joined
Posts: 15
Joined: Sun Sep 19, 2010 4:43 pm

Re: [Solved] RB750G ROS 5.2 serious performance issue.

Mon May 23, 2011 12:28 pm

I believe I'm having the same issue with my RB750G - with 4.17 everything was fine. I'm streaming HD videos across my RG750G from one local subnet to another and after upgrading to 5.2 I'm getting terrible performance (haven't done any 'scientific tests' but my video playback it suddenly very choppy.

Could anyone confirm that this is fixed in 5.3 ? Any word on when it is release to the general public ?
 
uscallesen
just joined
Posts: 15
Joined: Sun Sep 19, 2010 4:43 pm

Re: [Solved] RB750G ROS 5.2 serious performance issue.

Mon May 23, 2011 12:56 pm

I got 5.3 from support and it does indeed seem to fix the issue :)
 
RK
Long time Member
Long time Member
Posts: 565
Joined: Tue Nov 21, 2006 11:22 am
Location: Winnipeg, Canada and Central America

Re: [Solved] RB750G ROS 5.2 serious performance issue.

Thu Jun 30, 2011 1:56 am

Hi guys,

I can confirm that there is huge performance improvement in ROS 5.3 even compared to 4.17. So do not downgrade, it's better to wait few days and upgrade to 5.3.

Life is nice again :D

Is it also normal in 5.5 or only 5.3?

Who is online

Users browsing this forum: BartoszP, voytecky, wispmikrotik and 108 guests