HW offload and PPPoE - low speed.

marcin21 · Fri Feb 07, 2020 8:54 pm

I've found, or maybe I do something wrong, a problem:

PPPoe Server ---------- rb2011 -----------Router Mtik -- -- -- -- Wifi client

if I enable HW offload on eth ports of RB2011 (960PGS tested too) on way between PPPoE server and my mikrotik router, tests on wireless
drops from down 95mbps/ up95mbps to 30-40mbps /95 mbps.
problem is reproductible every time.
mark HWoffload Off on Rb2011 and it again makes 95/95mbps

Looks like HWoffload is not friendly with PPPoE tunnels, ordinary traffic works ok but PPPOe-session looks somehow slow.
Most bizzare is that it affects only download speed when using Mtik router/wireless. Using 3rd prty equipment it goes as low as 40/40 mbps.
The other thing is it affects only WIFI connection. connecting to ethernet ports of router works ok, near 95mbps both directions.

I've seend such a problem over my mikrotik/pppoe based network but I couldn't nail it down, till now.
low download and high upload.

Any idea?

jprietove · Fri Feb 07, 2020 9:09 pm

It could help if you post your bridge configuration in both scenarios: with hw-offload enabled and disabled. Maybe you are missing something.

marcin21 · Sat Feb 08, 2020 12:26 am

This is plain bridge on RB2011 (ROS 6.46.2 )doing switch job.

/interface bridge
add name=bridge1 protocol-mode=none
/interface bridge port
add bridge=bridge1 hw=no interface=ether1
add bridge=bridge1 hw=no interface=ether2

no fasttrack, fastpath ofcourse ON,
no conntrack, no filters on bridge, no nat, no RSTP, nothing.

and whenever It could be something in bridge, it's not being touched,
Just simple click HW-off and I get full ethernet speed on speedtester,
when HWoffload is ON, download drops to 30-40mbps.
And I've tested two different "switches" RB2011, Hex POE. Both identical situation.
Hex POE was reset to no default config and plain bridge with all ethernet ports.

important is this that it occurs only via WLAN interface of mikrotik router. I thought it may be related to
queue types on interfaces of router. Maybe.

neither the way this symptom i've seen many times in my network never realised the cause.
Now I see HW offload is not adviced when PPPoE tunnel is going through.

marcin21 · Sat Feb 08, 2020 12:53 am

We have internal speedtest server, and these are one by one tests on 5ghz router mtik to wireless client 802.11 ( 2 smartphones + Lenovo x201 laptop) all connected at 150/150 rate

HW-OFF

96.21 download Mbps
95.20 upload Mbps

HW-ON
35.66 download Mbps
95.22 upload Mbps

HW-OFF
95.07 download Mbps
93.93 upload Mbps

HW-ON
39.41 download Mbps
96.73 upload Mbps

HW-OFF
95.22 download Mbps
96.02 upload Mbps

92.09 download Mbps
95.65 upload Mbps

jprietove · Sat Feb 08, 2020 11:50 am

It's strange.. I'm sorry but I don't have a Rb2011 unit over here and I can't do any test until Monday. But, could it be..?

interface ethernet switch set switch1 cpu-flow-control=no

Enviado desde mi Mi A2 mediante Tapatalk

marcin21 · Sat Feb 08, 2020 1:54 pm

interface ethernet switch set switch1 cpu-flow-control=no

Nope, it didn't help. I've also tried to mark off
- Limit broadcasts -
as maybe PPPoE are seen as broadcast traffic, but no, it didn't help either.

jprietove · Sat Feb 08, 2020 4:48 pm

Well, according to https://wiki.mikrotik.com/wiki/Manual:I ... st_Forward conditions that MUST be met in order for Fast Forward to be active:

Bridge Hardware Offloading is disabled

So maybe this is the reason
I'll try to setup a lab next week to investigate it

Enviado desde mi Mi A2 mediante Tapatalk

marcin21 · Sat Feb 08, 2020 5:52 pm

Fast forward is no use, its a switch with more than 2 interfaces.

I suppose switch chip is doing something nasty with pppoe packets.
it looks like that on CRS series problem doesn't exist. So it's either switch chip
doesn't handle pppoe packet correctly or something in config that I can't see.

mada3k · Sat Feb 08, 2020 5:54 pm

PPPoE can never be offloaded by hardware

jprietove · Sat Feb 08, 2020 6:44 pm

Fast forward is no use, its a switch with more than 2 interfaces

Then you should put here complete configuration, not only the one you stated.

Enviado desde mi Mi A2 mediante Tapatalk

marcin21 · Sun Feb 09, 2020 4:00 am

@jprietove
here it is, complete config (xxx on vulnerable data):

xxx@xxx_MikroTik] > export hide-sensitive
# feb/09/2020 02:51:34 by RouterOS 6.46.2
# software id = xxxxxxxx
#
# model = 2011L
# serial number = 34380xxxxx
/interface bridge
add fast-forward=no name=bridge1 protocol-mode=none
/interface ethernet
set [ find default-name=ether1 ] name=xxxx speed=100Mbps
set [ find default-name=ether2 ] speed=100Mbps
set [ find default-name=ether3 ] disabled=yes name="xxxxx" speed=100Mbps
set [ find default-name=ether4 ] name=xxxx speed=100Mbps
set [ find default-name=ether5 ] speed=100Mbps
set [ find default-name=ether6 ] advertise=10M-half,10M-full,100M-half,100M-full,1000M-half,1000M-full name="xxxxx"
set [ find default-name=ether7 ] advertise=10M-half,10M-full,100M-half,100M-full,1000M-half,1000M-full loop-protect=on
set [ find default-name=ether8 ] advertise=10M-half,10M-full,100M-half,100M-full,1000M-half,1000M-full
set [ find default-name=ether9 ] advertise=10M-half,10M-full,100M-half,100M-full,1000M-half,1000M-full
set [ find default-name=ether10 ] advertise=10M-half,10M-full,100M-half,100M-full,1000M-half,1000M-full
/interface ethernet switch
set 0 cpu-flow-control=no
set 1 cpu-flow-control=no
/interface wireless security-profiles
set [ find default=yes ] supplicant-identity=MikroTik
/snmp community
set [ find default=yes ] addresses=xxxx.0/23
add addresses=xxxx/23 authentication-protocol=SHA1 name=xx security=authorized write-access=yes
add addresses=xxxx/23 name=xx
/system logging action
add email-to=xxx name=xxxxx target=email
/user group
set read policy=local,telnet,ssh,ftp,reboot,read,test,winbox,password,web,sniff,sensitive,api,romon,tikapp,!write,!policy,!dude
/interface bridge port
add bridge=bridge1 interface=ether1
add bridge=bridge1 interface=ether2
add bridge=bridge1 disabled=yes interface="ether3"
add bridge=bridge1 hw=no interface=ether4
add bridge=bridge1 interface=ether5
add bridge=bridge1 interface="ether6"
add bridge=bridge1 interface=ether7
add bridge=bridge1 interface=ether8
add bridge=bridge1 interface=ether9
add bridge=bridge1 interface=ether10
/ip address
add address=xx/24 interface=bridge1 network=xxx.0
/ip route
add comment="added by setup" distance=1 gateway=xxxxx
/ip ssh
set allow-none-crypto=yes forwarding-enabled=remote
/snmp
set contact=xxxx enabled=yes engine-id=xx location=xxx
/system clock
set time-zone-name=xxx
/system identity
set name=xx_MikroTik
/system logging
add action=xx prefix=xxx_MikroTik topics=warning
/system ntp client
set enabled=yes primary-ntp=xx
/tool e-mail
set address=xxx from=admin user=xxxx
/tool graphing resource
add

revilo · Sat Jul 18, 2020 1:20 am

I'm experiencing the same thing, pppoe also. Were you able ger to the bottom of whata happening here?

PortalNET · Mon Mar 20, 2023 12:03 am

I'm experiencing the same thing, pppoe also. Were you able ger to the bottom of whata happening here?

Hi guys

i know this is an old thread.. but basically i am facing a similar issue but on another hardware i am having the issue on a CCR1036 2S+ model 8GB ram rev2 version.

i am running ROS 6.48.x long-term

the device is beeing used as PPPOE-server only for fibre clients.. around 800 sessionas on this device.. CPU work loads average 10 to 15% max on peak times.. with average 1.5gbps traffic download..

i saw that my default queue on the pppoe-server profile uses.. the default parameters below.. and i also saw a wireless default queue.. but i guess is for wifi mikrotik devices correct? any ideias on how can improve this?

all 800 clients have average speeds fibre pppoe 300mbps and 500mbps..

we have wifi6 AX routers on clients side.. over fiber ONU devices.. vlan tagged.. pppoe running on the wifi6 ax device..

we plug pc on ethernet cable of wifi6 router.. and speeds normal 350mbps download and upload on 300mbps profile.. and 550mbps download and upload on 500Mbps profile..

when we test on wifi6 AX phone or wifi6 compatible notebooks.. average speeds are 250 to 400mbps max download.. and uploads allways go 550mbps normal..

we tested removing pppoe and setting up static IP on device and connect via static ip directly on another 1036 ethernet interface.. with no limit speeds.. we got 940mbps download on cable straight connected on the wifi6 routers.. and we got around 850Mbps max wifi on download and upload.. on the same phones S22+ and motorola edge30 devices connected on wifi6 on the AX1500mbps router.. but when we switch back to pppoe-client.. wifi speeds drop down to 250mbps up to 400mbps max.. same speeds we get on average wifi ac 5ghz phones..

Our pppoe-server have setup de default-queue from mikrotik

0 name="default" kind=pfifo pfifo-limit=50

and our ISP ERP system uses radius connection and it forwards to mikrotik the simple-queue with the correct speeds 500M and 300M .. no burst enabled on the simple queues like the pictures below attached.. i am not sure if this could be some sort of queue configuration missing... i have also tried changing MTUs.. from 1480 beblow up to 1432... and still same thing.. on PPPOE the wifi6 router download speeds.. are fairly slow compared to ethernet directly connected on wifi6 router.

PatrykLesniak · Thu Apr 06, 2023 9:05 pm

Hi, We have the same problem did you fix it on your setup?

PortalNET · Sun Apr 16, 2023 8:42 pm

Hi, We have the same problem did you fix it on your setup?

Hello unfortunatelly no solution which is the strangest.. we tried changing the queue-type default from PFIFO 10 or PFIFO 50 to SFQ with perturb 5 and allot 1514.. we got initially better results up to 400mbp download.. but nothing better then that...

the odd part is PPPOE-sever running.. secret setup with queue with no limit speeds.. we canot go over 400mbps download on wifi.. on rj45 port of router connected via PPPOE with gigabit ethernet pc.. we go speed download 940mbps easy on the exact same router.. we test again wifi 6 ax with 80mhz channel downloa drops to 280 to 400mbps max download.. and upload goes up to 700mbps ...

Our PPPOE-Server and OLT uplink port connected via SFP+ 10G full-duplex port..

once we remove router from PPPOE-server olt.. and plug router straight in 1gbps ethernet port from mikrotik and create a new PPPOE-SERVER specific for that ethernet port.. using gigabit cable from router to pc.. we get 940mbps directly.. wifi 400mbps max.. we remove pppoe-server from interface.. and plug static ip/30 with MTU 1500 betwenn wifi6 router and mikrotik ethernet cable.. we get 940mbps straight on download and upload on cable gigabit ethernet from router.. and on wifi6 same 80mhz channel width with same channel wifi6 we get 800mbps download and 850mbps upload.. which is double the average speeds on pppoe-server.. so its something triggering on the pppoe-server default configurations on the mikrotik or firmware version long-terms latest v6

we have tried searching for queue-types to check if there is anything different.. but still no sucess.. could TCP-MSS bytes have something do with it?

BTW we have tested PPPOE-SERVER with bridge normal and vlan-tagged mode.. same results on Wifi routers..issue seems to be just on wifi routers... we even went further and we tought ok .. is cell phones.. snapdrago cpus must not be enough and we ordered a wifi 6 ax 3000mbps slot card for our notebook.. after replacing old wifi5ghz with compatible wifi6ax nic adapter... we runned same tests on the notebook i5 8th generation cpu 12GB ram... and same results.. 280mbps to 400mbps wifi max.. on the same notebook with gigabit cable plugged on ethernet port... straight 940mbps download on same router connected via PPPOE-server

we tested all sorts and flavours of configurations... disabled RSTP , STP enabled and disabled also... broadcast on and off.. between both devices mikrotik ccr1036 and olt.. all firewall rules disabled... we even tested fast-path and fast-track enabled to remove all queues from all pppoe-clients.. we tried disabling even connection tracking ... and still same wifi results.. on pppoe-server.

untill we were nearly running out of ideas... when suddenly i had a chat with another ISP owner friend in our region.. and he is running NE40 hardware on PPPOE so we had a chat and i wen downt and took one of our wifi6 routers.. we connected the device on his PPPOE-server and we made some testing.. and voila... Wifi 6 running on pppoe-server 890 to 900mbps download and upload easy... , also on the network cable port 1gbps also 940mbps down and upload.. which we also had same results on the mikrotik ccr.. but wifi wen smoothly we run a ton of sequecend testing.. on wifi6 and all went over 850mbps download and upload every single time... This was when i had 100% guarantee it was something on the CCR1036 Long-term RoS 6.48.xx version running PPPOE-server. so in the end gave up..no more testing done on the CCR1036 sfp+

Can it be hardware limitation on the CCR? i don´t think so, because on same interface running wired cable we get the necessary results, só its 99% guaranteed software based configuration most likely.

EDIT- Forgot to mention.. same issue reproduced on RB4011 which has 1.8GHz cpu core frequency.... even with 1 single pppoe-session connected running same version long-term 6.48.xx just wifi connections speed issues..

And by the looks of this 3 year old thread.. it seems no one even bothered to look at it, i doubt someone will.. at least we know what we will do very soon... full swap out on our pppoe-server gear soon..

PatrykLesniak · Tue Apr 18, 2023 11:47 pm

Hi, We have the same problem did you fix it on your setup?
Hello unfortunatelly no solution which is the strangest.. we tried changing the queue-type default from PFIFO 10 or PFIFO 50 to SFQ with perturb 5 and allot 1514.. we got initially better results up to 400mbp download.. but nothing better then that...

the odd part is PPPOE-sever running.. secret setup with queue with no limit speeds.. we canot go over 400mbps download on wifi.. on rj45 port of router connected via PPPOE with gigabit ethernet pc.. we go speed download 940mbps easy on the exact same router.. we test again wifi 6 ax with 80mhz channel downloa drops to 280 to 400mbps max download.. and upload goes up to 700mbps ...

Our PPPOE-Server and OLT uplink port connected via SFP+ 10G full-duplex port..

once we remove router from PPPOE-server olt.. and plug router straight in 1gbps ethernet port from mikrotik and create a new PPPOE-SERVER specific for that ethernet port.. using gigabit cable from router to pc.. we get 940mbps directly.. wifi 400mbps max.. we remove pppoe-server from interface.. and plug static ip/30 with MTU 1500 betwenn wifi6 router and mikrotik ethernet cable.. we get 940mbps straight on download and upload on cable gigabit ethernet from router.. and on wifi6 same 80mhz channel width with same channel wifi6 we get 800mbps download and 850mbps upload.. which is double the average speeds on pppoe-server.. so its something triggering on the pppoe-server default configurations on the mikrotik or firmware version long-terms latest v6

we have tried searching for queue-types to check if there is anything different.. but still no sucess.. could TCP-MSS bytes have something do with it?

BTW we have tested PPPOE-SERVER with bridge normal and vlan-tagged mode.. same results on Wifi routers..issue seems to be just on wifi routers... we even went further and we tought ok .. is cell phones.. snapdrago cpus must not be enough and we ordered a wifi 6 ax 3000mbps slot card for our notebook.. after replacing old wifi5ghz with compatible wifi6ax nic adapter... we runned same tests on the notebook i5 8th generation cpu 12GB ram... and same results.. 280mbps to 400mbps wifi max.. on the same notebook with gigabit cable plugged on ethernet port... straight 940mbps download on same router connected via PPPOE-server

we tested all sorts and flavours of configurations... disabled RSTP , STP enabled and disabled also... broadcast on and off.. between both devices mikrotik ccr1036 and olt.. all firewall rules disabled... we even tested fast-path and fast-track enabled to remove all queues from all pppoe-clients.. we tried disabling even connection tracking ... and still same wifi results.. on pppoe-server.

untill we were nearly running out of ideas... when suddenly i had a chat with another ISP owner friend in our region.. and he is running NE40 hardware on PPPOE so we had a chat and i wen downt and took one of our wifi6 routers.. we connected the device on his PPPOE-server and we made some testing.. and voila... Wifi 6 running on pppoe-server 890 to 900mbps download and upload easy... , also on the network cable port 1gbps also 940mbps down and upload.. which we also had same results on the mikrotik ccr.. but wifi wen smoothly we run a ton of sequecend testing.. on wifi6 and all went over 850mbps download and upload every single time... This was when i had 100% guarantee it was something on the CCR1036 Long-term RoS 6.48.xx version running PPPOE-server. so in the end gave up..no more testing done on the CCR1036 sfp+

Can it be hardware limitation on the CCR? i don´t think so, because on same interface running wired cable we get the necessary results, só its 99% guaranteed software based configuration most likely.

EDIT- Forgot to mention.. same issue reproduced on RB4011 which has 1.8GHz cpu core frequency.... even with 1 single pppoe-session connected running same version long-term 6.48.xx just wifi connections speed issues..

And by the looks of this 3 year old thread.. it seems no one even bothered to look at it, i doubt someone will.. at least we know what we will do very soon... full swap out on our pppoe-server gear soon..

Where are you from? I wrote to the super admins and waiting for a reply. We have problem witch supermicro mikrotik server and wifi speed but on ccr 1036 ( old hardware now backup) wifi speed is max like 700/800. On ccr 1036 and supermicro is the same conf. Ccr is connect 10G to cisco extream then cisco 10G to olt ZTE and everything is good. Supermicro is connected 10G to cisco extream, olt zte 10g and on this setup is problem. Pppoe server or static ip we have still problem on wifi. On CCR 1036 on pppoe or static ip wifi on end router work perfect. If super admin will help us i write to you.

webtelza · Wed Jun 07, 2023 10:24 am

Has anybody received an update regarding this issue?

PortalNET · Tue Dec 12, 2023 1:54 pm

Hello unfortunatelly no solution which is the strangest.. we tried changing the queue-type default from PFIFO 10 or PFIFO 50 to SFQ with perturb 5 and allot 1514.. we got initially better results up to 400mbp download.. but nothing better then that...

the odd part is PPPOE-sever running.. secret setup with queue with no limit speeds.. we canot go over 400mbps download on wifi.. on rj45 port of router connected via PPPOE with gigabit ethernet pc.. we go speed download 940mbps easy on the exact same router.. we test again wifi 6 ax with 80mhz channel downloa drops to 280 to 400mbps max download.. and upload goes up to 700mbps ...

Our PPPOE-Server and OLT uplink port connected via SFP+ 10G full-duplex port..

once we remove router from PPPOE-server olt.. and plug router straight in 1gbps ethernet port from mikrotik and create a new PPPOE-SERVER specific for that ethernet port.. using gigabit cable from router to pc.. we get 940mbps directly.. wifi 400mbps max.. we remove pppoe-server from interface.. and plug static ip/30 with MTU 1500 betwenn wifi6 router and mikrotik ethernet cable.. we get 940mbps straight on download and upload on cable gigabit ethernet from router.. and on wifi6 same 80mhz channel width with same channel wifi6 we get 800mbps download and 850mbps upload.. which is double the average speeds on pppoe-server.. so its something triggering on the pppoe-server default configurations on the mikrotik or firmware version long-terms latest v6

we have tried searching for queue-types to check if there is anything different.. but still no sucess.. could TCP-MSS bytes have something do with it?

BTW we have tested PPPOE-SERVER with bridge normal and vlan-tagged mode.. same results on Wifi routers..issue seems to be just on wifi routers... we even went further and we tought ok .. is cell phones.. snapdrago cpus must not be enough and we ordered a wifi 6 ax 3000mbps slot card for our notebook.. after replacing old wifi5ghz with compatible wifi6ax nic adapter... we runned same tests on the notebook i5 8th generation cpu 12GB ram... and same results.. 280mbps to 400mbps wifi max.. on the same notebook with gigabit cable plugged on ethernet port... straight 940mbps download on same router connected via PPPOE-server

we tested all sorts and flavours of configurations... disabled RSTP , STP enabled and disabled also... broadcast on and off.. between both devices mikrotik ccr1036 and olt.. all firewall rules disabled... we even tested fast-path and fast-track enabled to remove all queues from all pppoe-clients.. we tried disabling even connection tracking ... and still same wifi results.. on pppoe-server.

untill we were nearly running out of ideas... when suddenly i had a chat with another ISP owner friend in our region.. and he is running NE40 hardware on PPPOE so we had a chat and i wen downt and took one of our wifi6 routers.. we connected the device on his PPPOE-server and we made some testing.. and voila... Wifi 6 running on pppoe-server 890 to 900mbps download and upload easy... , also on the network cable port 1gbps also 940mbps down and upload.. which we also had same results on the mikrotik ccr.. but wifi wen smoothly we run a ton of sequecend testing.. on wifi6 and all went over 850mbps download and upload every single time... This was when i had 100% guarantee it was something on the CCR1036 Long-term RoS 6.48.xx version running PPPOE-server. so in the end gave up..no more testing done on the CCR1036 sfp+

Can it be hardware limitation on the CCR? i don´t think so, because on same interface running wired cable we get the necessary results, só its 99% guaranteed software based configuration most likely.

EDIT- Forgot to mention.. same issue reproduced on RB4011 which has 1.8GHz cpu core frequency.... even with 1 single pppoe-session connected running same version long-term 6.48.xx just wifi connections speed issues..

And by the looks of this 3 year old thread.. it seems no one even bothered to look at it, i doubt someone will.. at least we know what we will do very soon... full swap out on our pppoe-server gear soon..
Where are you from? I wrote to the super admins and waiting for a reply. We have problem witch supermicro mikrotik server and wifi speed but on ccr 1036 ( old hardware now backup) wifi speed is max like 700/800. On ccr 1036 and supermicro is the same conf. Ccr is connect 10G to cisco extream then cisco 10G to olt ZTE and everything is good. Supermicro is connected 10G to cisco extream, olt zte 10g and on this setup is problem. Pppoe server or static ip we have still problem on wifi. On CCR 1036 on pppoe or static ip wifi on end router work perfect. If super admin will help us i write to you.

Hi friends

Sorry for late reply posting, i just checked the post today.. ok some updates regarding my issue posted a few months ago, in the end eventually we have manged to fix the issue..

after some checking on both devices configuration.. Mikrotik CCR1036 sfp+ port and our OLT device manufacturer 10G sfp+ uplink port, and our switch CRS317 running in SwitchOS mode.

we noticed the following..

1- Mikrotik CCR1036 SFP+ port had disabled flow control tx/rx
2- CRS317 switch had sfp+ ports flow control tx/rx also disabled
3- our OLT sfp+ uplink port also had disabled tx/rx

client pppoe-connected with wifi6 ax router.. via cable on PC.. internet speeds download 900mb and upload 900mb which is ok but running cable
client pppoe-connected with wifi6ax same router connected on mobile wifi6 device download speed allway low 220mbps download / 750mbps upload.

which confused me for a long time, because upload was allway better from upload and download allways low..

so we started checking all our network infra-structure, we checked MTU on OLT uplink interface, we checked L2MTU .. because we have VLANS.. so we could clear out all the MTU doubts we did increase L2MTU to 1598 bytes on OLT Uplink 10G port sfp+

we did the same on the SFP+ 10G mikrotik CCR1036 port we increased L2MTU to 1600 , so we could exclude any issue on VLAN PPPOE-SERVER side.

we run same tests again and same thing happened..

client pppoe-connected with wifi6 ax router via cable LAN gigabit on PC desktop.. internet speed download 900Mbps and upload 900mbps
client pppoe-connected with wifi6 ax router on wifi6 device mobile internet speed again 220mbps download max.. and uploads 750Mbps..

at this point we knew it was not VLAN related neither MTU..

Note: CRS317 Switch in switchOS mode.. we could not find MTU neither L2MTU section.. but we read the docs online stating it would increase automatically up to 10222 Jumbo frames.. so we did not worrie abou the CRS317 switch.

ok so next step after searching online with OLT manufacturer... we saw manufacturer stating to enable flow-control tx/rx on the uplink interface sfp+

so we went back and enabled Flow-control tx/rx on the OLT, and next we went to mikrotik ccr1036 sfp+ port and enabled also flow-control tx/rx

we ran some testing again

client pppoe-connected with wifi6 ax router via cable gigabit lan pc againa 900mbps donwload and 900mbps upload
client pppoe-connected with wifi6 ax router via wifi6 on mobile device again 220mbps download and 900mbps upload..

at this point we were already frustrated... running out of ideas.. until i remebered that the crs317 switch had option on SFP ports to enable and disable flow-control and i had disabled it before.. and because both mikrotik ccr1036 and olt uplink ports were connected on the crs317 switch via vlan.. i entered the switch and enabled the flow-control tx/rx on both interfaces connecting the same vlan from CCR1036 and OLT uplink port...

after i runned the speedtest again on wifi we reached 800Mbps download and 800Mbps upload near the same speed on cable gigabit on wifi6 routers..

At this time i was happy, because i had managed to get higher speeds from the sfp+ 10G gbps port for wifi scenarios on the pppoe clients connected.

but happiness was short.. after a few days.. we started having all sorts of problems... RX-PAUSES showing up on the CRS317 switch... this was a nightmare for on-demand streaming platforms... speedtest one time below 90mbps wifi , on the very next test 800mbps wifi, then make another repetitive test and speed go down again do 80mbps on wifi download.. and on the CRS switch we kept seeing LINK PAUSE on the interface connected to the mikrotik...

eventually we disabled the SFP+ 10G port on the OLT UPLINK.. and went back to use the 4 GE RJ45 gigabit eletric ports.. connected direclty each port to the mikrotik CCR1036 RJ45 gigabit ports.. each running separate vlan with separate PPPOE-server.. all flow-control disabled... and i can now get the normal 900mbps download on wifi6 router cable giggabit lan connected to PC.. and also on wifi6 mobile devices i can get around 850Mbps download speed and upload speed..

So what puzzle me is.. the correct SFP+ gig port cannot take advantage on the OLT -- > mikrotik but the Electrical RJ45 gigabit can...

between all this days of testing we tried playing with interface-queues... only-hardware, ethernet-default, multi-queue ...etc... and none had great effect... all the same..

just enabling flow-control on ccr and olt and switch on the sfp+ attached ports.. made some effect on wifi download speed for a few hours.. after high traffic started escalating over 1gbps traffic load.. issues started ..

PatrykLesniak · Sat Aug 17, 2024 8:43 pm

Where are you from? I wrote to the super admins and waiting for a reply. We have problem witch supermicro mikrotik server and wifi speed but on ccr 1036 ( old hardware now backup) wifi speed is max like 700/800. On ccr 1036 and supermicro is the same conf. Ccr is connect 10G to cisco extream then cisco 10G to olt ZTE and everything is good. Supermicro is connected 10G to cisco extream, olt zte 10g and on this setup is problem. Pppoe server or static ip we have still problem on wifi. On CCR 1036 on pppoe or static ip wifi on end router work perfect. If super admin will help us i write to you.

Hi friends

Sorry for late reply posting, i just checked the post today.. ok some updates regarding my issue posted a few months ago, in the end eventually we have manged to fix the issue..

after some checking on both devices configuration.. Mikrotik CCR1036 sfp+ port and our OLT device manufacturer 10G sfp+ uplink port, and our switch CRS317 running in SwitchOS mode.

we noticed the following..

1- Mikrotik CCR1036 SFP+ port had disabled flow control tx/rx
2- CRS317 switch had sfp+ ports flow control tx/rx also disabled
3- our OLT sfp+ uplink port also had disabled tx/rx

client pppoe-connected with wifi6 ax router.. via cable on PC.. internet speeds download 900mb and upload 900mb which is ok but running cable
client pppoe-connected with wifi6ax same router connected on mobile wifi6 device download speed allway low 220mbps download / 750mbps upload.

which confused me for a long time, because upload was allway better from upload and download allways low..

so we started checking all our network infra-structure, we checked MTU on OLT uplink interface, we checked L2MTU .. because we have VLANS.. so we could clear out all the MTU doubts we did increase L2MTU to 1598 bytes on OLT Uplink 10G port sfp+

we did the same on the SFP+ 10G mikrotik CCR1036 port we increased L2MTU to 1600 , so we could exclude any issue on VLAN PPPOE-SERVER side.

we run same tests again and same thing happened..

client pppoe-connected with wifi6 ax router via cable LAN gigabit on PC desktop.. internet speed download 900Mbps and upload 900mbps
client pppoe-connected with wifi6 ax router on wifi6 device mobile internet speed again 220mbps download max.. and uploads 750Mbps..

at this point we knew it was not VLAN related neither MTU..

Note: CRS317 Switch in switchOS mode.. we could not find MTU neither L2MTU section.. but we read the docs online stating it would increase automatically up to 10222 Jumbo frames.. so we did not worrie abou the CRS317 switch.

ok so next step after searching online with OLT manufacturer... we saw manufacturer stating to enable flow-control tx/rx on the uplink interface sfp+

so we went back and enabled Flow-control tx/rx on the OLT, and next we went to mikrotik ccr1036 sfp+ port and enabled also flow-control tx/rx

we ran some testing again

client pppoe-connected with wifi6 ax router via cable gigabit lan pc againa 900mbps donwload and 900mbps upload
client pppoe-connected with wifi6 ax router via wifi6 on mobile device again 220mbps download and 900mbps upload..

at this point we were already frustrated... running out of ideas.. until i remebered that the crs317 switch had option on SFP ports to enable and disable flow-control and i had disabled it before.. and because both mikrotik ccr1036 and olt uplink ports were connected on the crs317 switch via vlan.. i entered the switch and enabled the flow-control tx/rx on both interfaces connecting the same vlan from CCR1036 and OLT uplink port...

after i runned the speedtest again on wifi we reached 800Mbps download and 800Mbps upload near the same speed on cable gigabit on wifi6 routers..

At this time i was happy, because i had managed to get higher speeds from the sfp+ 10G gbps port for wifi scenarios on the pppoe clients connected.

but happiness was short.. after a few days.. we started having all sorts of problems... RX-PAUSES showing up on the CRS317 switch... this was a nightmare for on-demand streaming platforms... speedtest one time below 90mbps wifi , on the very next test 800mbps wifi, then make another repetitive test and speed go down again do 80mbps on wifi download.. and on the CRS switch we kept seeing LINK PAUSE on the interface connected to the mikrotik...

eventually we disabled the SFP+ 10G port on the OLT UPLINK.. and went back to use the 4 GE RJ45 gigabit eletric ports.. connected direclty each port to the mikrotik CCR1036 RJ45 gigabit ports.. each running separate vlan with separate PPPOE-server.. all flow-control disabled... and i can now get the normal 900mbps download on wifi6 router cable giggabit lan connected to PC.. and also on wifi6 mobile devices i can get around 850Mbps download speed and upload speed..

So what puzzle me is.. the correct SFP+ gig port cannot take advantage on the OLT -- > mikrotik but the Electrical RJ45 gigabit can...

between all this days of testing we tried playing with interface-queues... only-hardware, ethernet-default, multi-queue ...etc... and none had great effect... all the same..

just enabling flow-control on ccr and olt and switch on the sfp+ attached ports.. made some effect on wifi download speed for a few hours.. after high traffic started escalating over 1gbps traffic load.. issues started ..

Do you fix this problem?

PatrykLesniak · Tue Sep 03, 2024 4:44 pm

I fix this problem on ZTE OLT witch EPON Card - Update Firmware to CARD and update/active patche. Before 250/700Mbps on wifi. After update 900/900 on wifi

HW offload and PPPoE - low speed.

HW offload and PPPoE - low speed.

Re: HW offload and PPPoE - low speed.

Re: HW offload and PPPoE - low speed.

Re: HW offload and PPPoE - low speed.

Re: HW offload and PPPoE - low speed.

Re: HW offload and PPPoE - low speed.

Re: HW offload and PPPoE - low speed.

Re: HW offload and PPPoE - low speed.

Re: HW offload and PPPoE - low speed.

Re: HW offload and PPPoE - low speed.

Re: HW offload and PPPoE - low speed.

Re: HW offload and PPPoE - low speed.

Re: HW offload and PPPoE - low speed.

Re: HW offload and PPPoE - low speed.

Re: HW offload and PPPoE - low speed.

Re: HW offload and PPPoE - low speed.

Re: HW offload and PPPoE - low speed.

Re: HW offload and PPPoE - low speed.

Re: HW offload and PPPoE - low speed.

Re: HW offload and PPPoE - low speed.

Who is online