Queue is not working fine with high bandwidth

tincboy · Thu Sep 06, 2012 10:25 pm

I'm using the simple queues to shape traffic of my servers ( cause I've only a 100 mbps link and I should manage it )
It's working fine for each IP to be shaped at less than 1Mbps speed but when I increase the limit to something more than 1M it cause the real usage bandwidth of each server to be less than 500K, so while I'm trying the increase the speed of a specific server it decrease the speed.
usually I need to shape traffic of each IP between 4Mbps and 30Mbps
Any suggestion on what can be wrong?

hassibi · Fri Sep 07, 2012 9:47 am

Hi
Please send your configuration and network diagram then i can help you better.RouterOS queue do not have any problem my friend.

tincboy · Mon Sep 10, 2012 8:56 pm

Hi
Please send your configuration and network diagram then i can help you better.RouterOS queue do not have any problem my friend.

what configuration you need?
network topology of mine is 10 servers with Mikrotik as their gateway

hassibi · Tue Sep 11, 2012 9:32 am

About your clients...how they connected to your servers? and send your queue configuration.

tincboy · Tue Sep 11, 2012 2:45 pm

About your clients...how they connected to your servers? and send your queue configuration.

The servers are connected to a switch which Mikrotik is connected to it too.

[admin@MikroTik] > queue simple print
Flags: X - disabled, I - invalid, D - dynamic
 0    name="74-20" target-addresses=xx.xx.xx.20/32 interface=all parent=none
      packet-marks="" direction=both priority=1
      queue=hotspot-default/hotspot-default limit-at=0/0 max-limit=64M/64M
      burst-limit=0/0 burst-threshold=0/0 burst-time=0s/0s
      total-queue=hotspot-default

TrollMan · Tue Sep 11, 2012 3:36 pm

Could you share some more info? RB HW, rB version and CPU profile?

tincboy · Tue Sep 11, 2012 4:09 pm

Could you share some more info? RB HW, rB version and CPU profile?

Mikrotik is installed on top of a Corei-7 CPU with a 4 GB DDR3 memory module, and Mikrotik version is 5.2

tincboy · Thu Sep 13, 2012 8:48 pm

Any Help?

Caci99 · Thu Sep 13, 2012 10:54 pm

The servers are connected to a switch which Mikrotik is connected to it too.

[admin@MikroTik] > queue simple print
Flags: X - disabled, I - invalid, D - dynamic
 0    name="74-20" target-addresses=xx.xx.xx.20/32 interface=all parent=none
      packet-marks="" direction=both priority=1
      queue=hotspot-default/hotspot-default limit-at=0/0 max-limit=64M/64M
      burst-limit=0/0 burst-threshold=0/0 burst-time=0s/0s
      total-queue=hotspot-default

Try changing the queue from hotsport-default to default-small or default.

tincboy · Fri Sep 14, 2012 6:57 am

Try changing the queue from hotsport-default to default-small or default.

I've tried all queue types and almost "hostspot-default" was the best in this case,

Caci99 · Fri Sep 14, 2012 12:02 pm

how are you testing the bandwidth on server? By just increasing the limit on the queue, I am sure you don't expect the traffic
to be larger by itself, you must be executing some bandwidth test to see if it can reach the limit or not.

As for the board you have chosen, I must say that it is not the best one. For a 100Mbps traffic a routerboard is
faster than any x86 board.

tincboy · Fri Sep 14, 2012 12:07 pm

how are you testing the bandwidth on server? By just increasing the limit on the queue, I am sure you don't expect the traffic
to be larger by itself, you must be executing some bandwidth test to see if it can reach the limit or not.

As for the board you have chosen, I must say that it is not the best one. For a 100Mbps traffic a routerboard is
faster than any x86 board.

I'm using scp command to transfer a file from other nearby server, the speed without shaping is about 100 mbps but enabling the rule with limit of 30 mbps will make it slower than 21 mbps
I guess the CPU is important factor so I decided to not use routerboard as the number of connections in my environment can simply exceed the 20000

Caci99 · Fri Sep 14, 2012 1:06 pm

Of course the CPU is important, but the x86 CPU borads, usually are not build for networking protocols,
unless of course you have ordered one specifically build for that purpose. I have seen better performance
from a 300MHz CPU of RB493 than from a Pentium 2GHz.
Anyway, back to your problem. When you hit the 21Mbps how much CPU is it using? At the moment of the test
is it the only traffic passing through?

tincboy · Fri Sep 14, 2012 1:10 pm

Of course the CPU is important, but the x86 CPU borads, usually are not build for networking protocols,
unless of course you have ordered one specifically build for that purpose. I have seen better performance
from a 300MHz CPU of RB493 than from a Pentium 2GHz.
Anyway, back to your problem. When you hit the 21Mbps how much CPU is it using? At the moment of the test
is it the only traffic passing through?

The cpu usage is less than 3% while traffic is 21 mbps, and I've no other traffic during the test

Caci99 · Fri Sep 14, 2012 8:04 pm

In the statistics of the queue, do you see any dropped packets?
Also, if you increase the max-limit, do you still get 21Mbps or you are getting roughly 70% of the queue
in any case?

tincboy · Fri Sep 14, 2012 8:56 pm

In the statistics of the queue, do you see any dropped packets?
Also, if you increase the max-limit, do you still get 21Mbps or you are getting roughly 70% of the queue
in any case?

The "total dropped" is zero, and the speed is always about 50-70% of max-limit as you said, it will increase to about 39 mbps when I set the max-limit to 64M

Caci99 · Fri Sep 14, 2012 10:02 pm

I am not able to understand the problem, so I would go by trying different solutions,
like change the interface in the queue, change the type of queue, or even marking packets
in mangle and then apply those packet marks in the queue.
The "hotspot-default" queue is based on sfq queue which I can not tell much about.
For simple queues, like yours, I would go with default-small or default queue.

tincboy · Sat Sep 15, 2012 5:19 am

I am not able to understand the problem, so I would go by trying different solutions,
like change the interface in the queue, change the type of queue, or even marking packets
in mangle and then apply those packet marks in the queue.
The "hotspot-default" queue is based on sfq queue which I can not tell much about.
For simple queues, like yours, I would go with default-small or default queue.

I already did changing all of these options but it didn't help at all

tincboy · Sun Sep 16, 2012 5:56 am

I really stuck in here, any help?
How can I contact Mikrotik support? I've emailed them 4 days ago but they didn't answer yet.

Caci99 · Sun Sep 16, 2012 10:59 am

I really stuck in here, any help?
How can I contact Mikrotik support? I've emailed them 4 days ago but they didn't answer yet.

Just write at support@mikrotik.com. They will answer within three business days, I believe.

samsung172 · Sun Sep 16, 2012 12:22 pm

how about upgrading to 5.20?

tincboy · Sun Sep 16, 2012 12:26 pm

how about upgrading to 5.20?

I'm using 5.20 already, thanks

Sun Sep 16, 2012 6:28 pm

I'd suggest moving away from Simple Queues, as they seem to be quite expensive on packet matching. Queue Tree should do the job much better, provided mangle rules are configured correctly.

Nutcracker · Tue Mar 05, 2013 8:28 am

Hi there

Sorry for the thread resurection, but we are experiencing the same issue with pppoe connections. Unfortunately we can not move over to queue tree, unless someone can show me how to do that with radius and pppoe connections.

A reply from MT on this would be appreciated.