Hello,
Im reaching to this forum for help, because I'm lacking knowledge needed to set up things correctly.
Little background about my network:
I was happy user of combo NETIS WF2780 DSL + MIKROTIK CRS210-8G-2S+IN (netis can be ignored, it wasn't anything special, but "it worked").
I'm using Windows 10 machine with Mellanox Connect 10GbE NIC, and have QNAP NAS TS-932PX with 10GbE NIC adapters as well.
Windows machine and QNAP were connected using SFP+ cables to the CRS210-8G02S+IN (along other devices through 1GbE ethernet ports), and CRS210 was connected to the NETIS router, which was connected to the ISP gateway - everything worked fine, routing worked out of the box correctly, as it worked after I've introduced CRS2010 to my network (I have little-to-none of networking knowledge, except for "oh yes this connector fits this port and that's the IP address I need to input here) - I had 700MBps transfers to the QNAP nas raid storage, and that was really all I wanted, as i deal with large amount of media files in my work. I own MIKROTIK ROUTERBOARD RTB-CRS317-1G-16S+RM as well, which I used several times when I had to deal with several rendernodes crunching hundreds of gigabytes of data daily, but It's not connected at the moment, as higher priority for me is to restore transfer speeds between my main machines.
Things changed when I've bought MikroTik hAP ac3 RBD53iG-5HacD2HnD PoE - Naively I've expected everything to work correctly if the IP matched like in my previous router, namely:
Mikrotik hAP AC3 will be a router and wifi access point for my mobile devices, also will give everything connected to Mikrotik CRS210 access to internet, while CRS210 will handle 10GbE loads between my workstation and nas.
Sadly, it didn't happened - everything "works", as in - i have internet on all devices, WIFI works, everything sees each other in network, but Im experiencing below 1GbE (around 30-40MBps)transfers from workstation to NAS - im pretty sure both devices work correctly, as if i connect them without any switch/router between them I get expected transfers, so it points me to network/routing/switching issue rather than NAS/workstation issue.
Worth mentioning, after I've introduces Mikrotik hAP ac3 to my network in place of netis, I had to turn my CRS210 into switchboard otherwise i couldn't log in to the ac3 - having zero knowledge, I've followed _some_ youtube tutorial that indeed turned CRS210 into switch, but since then I can't log in into it with winbox, with error "cant connect" (please see attached image for how its seen in the network) https://i.imgur.com/YL2FJ40.jpg
I'll be glad for any help about how to configure my network to bring bac the 10GbE transfer speeds between my main workstation and QNAP nas.
Re: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
So many things can be wrongly configured I don't even know from where to start.
And that CRS is running RouterOS 6.18 (from 2014??) seriously?
Show a sanitized config export from both of them.
And that CRS is running RouterOS 6.18 (from 2014??) seriously?
Show a sanitized config export from both of them.
Re: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
As mentioned, everything worked before, so I didn't updated it since out of the box experience was ok.So many things can be wrongly configured I don't even know from where to start.
And that CRS is running RouterOS 6.18 (from 2014??) seriously?
Show a sanitized config export from both of them.
Since I've made this post, someone from other forum managed to help me log in to the CRS210 and update it to 7.2.3 - nothing changed in behavior though.
"Show a sanitized config export from both of them." - how can I export config to paste it here?
Re: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
Blindly upgrading that ancient switch to RouterOS v7 is among the worst things you could've done.
Code: Select all
/export file=whateverRe: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
Code: Select all
/interface bridge
add fast-forward=no mtu=1500 name=bridge
/interface ethernet
set [ find default-name=ether1 ] speed=100Mbps
set [ find default-name=ether2 ] speed=100Mbps
set [ find default-name=ether3 ] speed=100Mbps
set [ find default-name=ether4 ] speed=100Mbps
set [ find default-name=ether5 ] speed=100Mbps
set [ find default-name=ether6 ] speed=100Mbps
set [ find default-name=ether7 ] speed=100Mbps
set [ find default-name=ether8 ] speed=100Mbps
set [ find default-name=sfp-sfpplus1 ] advertise=\
10M-half,10M-full,100M-half,100M-full,1000M-half,1000M-full
set [ find default-name=sfpplus2 ] advertise=\
10M-half,10M-full,100M-half,100M-full,1000M-half,1000M-full
/interface wireless security-profiles
set [ find default=yes ] supplicant-identity=MikroTik
/ip ipsec proposal
set [ find default=yes ] enc-algorithms=aes-128-cbc
/port
set 0 name=serial0
/snmp community
set [ find default=yes ] addresses=0.0.0.0/0
/interface bridge port
add bridge=bridge hw=no interface=ether1
add bridge=bridge hw=no interface=ether2
add bridge=bridge hw=no interface=ether3
add bridge=bridge hw=no interface=ether4
add bridge=bridge hw=no interface=ether5
add bridge=bridge hw=no interface=ether6
add bridge=bridge hw=no interface=ether7
add bridge=bridge hw=no interface=ether8
add bridge=bridge interface=sfp-sfpplus1
add bridge=bridge interface=sfpplus2
/ip ipsec policy
set 0 dst-address=0.0.0.0/0 src-address=0.0.0.0/0
/system clock
set time-zone-autodetect=no
Re: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
I don't know why it doesn't have an IP addr set, but start with this:
Code: Select all
/interface bridge port set hw=yes [find]
Re: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
And this:
Code: Select all
/interface bridge set 0 fast-forward=yes
Re: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
Code: Select all
/interface bridge port set hw=yes [find]
Code: Select all
/interface bridge set 0 fast-forward=yes
however router seem to close connection to winbox, so I had to re-log in it.
No difference in transfer though.
Re: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
Are all devices connected to this CRS? If not, how are they connected?
Please post another config export from the CRS to see it with my own eyes that the above commands did nothing.
Also provide an export from hAP ac3.
Please post another config export from the CRS to see it with my own eyes that the above commands did nothing.
Also provide an export from hAP ac3.
Re: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
Code: Select all
/interface bridge
add mtu=1500 name=bridge
/interface ethernet
set [ find default-name=ether1 ] speed=100Mbps
set [ find default-name=ether2 ] speed=100Mbps
set [ find default-name=ether3 ] speed=100Mbps
set [ find default-name=ether4 ] speed=100Mbps
set [ find default-name=ether5 ] speed=100Mbps
set [ find default-name=ether6 ] speed=100Mbps
set [ find default-name=ether7 ] speed=100Mbps
set [ find default-name=ether8 ] speed=100Mbps
set [ find default-name=sfp-sfpplus1 ] advertise=\
10M-half,10M-full,100M-half,100M-full,1000M-half,1000M-full
set [ find default-name=sfpplus2 ] advertise=\
10M-half,10M-full,100M-half,100M-full,1000M-half,1000M-full
/interface wireless security-profiles
set [ find default=yes ] supplicant-identity=MikroTik
/ip ipsec proposal
set [ find default=yes ] enc-algorithms=aes-128-cbc
/port
set 0 name=serial0
/snmp community
set [ find default=yes ] addresses=0.0.0.0/0
/interface bridge port
add bridge=bridge interface=ether1
add bridge=bridge interface=ether2
add bridge=bridge interface=ether3
add bridge=bridge interface=ether4
add bridge=bridge interface=ether5
add bridge=bridge interface=ether6
add bridge=bridge interface=ether7
add bridge=bridge interface=ether8
add bridge=bridge interface=sfp-sfpplus1
add bridge=bridge interface=sfpplus2
/ip ipsec policy
set 0 dst-address=0.0.0.0/0 src-address=0.0.0.0/0
/system clock
set time-zone-autodetect=noI'll post hAP ac3 config later, sanitizing its content will take a while.
Re: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
So you've lied, the commands worked.
Anywhoo. if those two devices are in the same subnet I can't imagine how the hAP ac3 is affecting the transfer between them.
Anywhoo. if those two devices are in the same subnet I can't imagine how the hAP ac3 is affecting the transfer between them.
Re: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
Never lied, just said i got nothing in terminal after typing that, and that neither of commands affected the low transfer speeds - so it didnt really worked for me.So you've lied, the commands worked.
I dont know if thats the issue with hAP ac3, i think its more issue with configuration on CRS210, that somehow dont want to use full sfp+ speeds.Anywhoo. if those two devices are in the same subnet I can't imagine how the hAP ac3 is affecting the transfer between them.
Re: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
You can remove all the "noise" in your configuration pasting this on terminal:
Code: Select all
{
/interface bridge
set bridge mtu=auto
/interface ethernet
set [ find default-name=ether1 ] speed=1Gbps
set [ find default-name=ether2 ] speed=1Gbps
set [ find default-name=ether3 ] speed=1Gbps
set [ find default-name=ether4 ] speed=1Gbps
set [ find default-name=ether5 ] speed=1Gbps
set [ find default-name=ether6 ] speed=1Gbps
set [ find default-name=ether7 ] speed=1Gbps
set [ find default-name=ether8 ] speed=1Gbps
/ip ipsec proposal
set [ find default=yes ] enc-algorithms=aes-256-cbc,aes-192-cbc,aes-128-cbc
/snmp community
set [ find default=yes ] addresses=::/0
/ip ipsec policy
set 0 dst-address=::/0 src-address=::/0
}
Re: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
Code: Select all
/interface ethernet monitor [find] onceRe: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
Result of running command:Code: Select all/interface ethernet monitor [find] once
https://i.imgur.com/oA6hvYg.jpg
Thank you, it made everything much more readable:You can remove all the "noise" in your configuration pasting this on terminal:[...]
Code: Select all
/interface bridge
add name=bridge
/interface ethernet
set [ find default-name=sfp-sfpplus1 ] advertise=\
10M-half,10M-full,100M-half,100M-full,1000M-half,1000M-full
set [ find default-name=sfpplus2 ] advertise=\
10M-half,10M-full,100M-half,100M-full,1000M-half,1000M-full
/interface wireless security-profiles
set [ find default=yes ] supplicant-identity=MikroTik
/port
set 0 name=serial0
/interface bridge port
add bridge=bridge interface=ether1
add bridge=bridge interface=ether2
add bridge=bridge interface=ether3
add bridge=bridge interface=ether4
add bridge=bridge interface=ether5
add bridge=bridge interface=ether6
add bridge=bridge interface=ether7
add bridge=bridge interface=ether8
add bridge=bridge interface=sfp-sfpplus1
add bridge=bridge interface=sfpplus2
/system clock
set time-zone-autodetect=noRe: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
Both 10G? If you are sure:
Code: Select all
{
/interface ethernet
set [ find default-name=sfp-sfpplus1 ] advertise=10000M-full speed=10Gbps
set [ find default-name=sfpplus2 ] advertise=10000M-full speed=10Gbps
}
Re: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
Yes, both should be 10Gbps interfaces, as mentioned above, they worked fine giving me 700-800MBps speeds, now its much slower. If I disconnect everything from router and connect NAS with workstation directly using one cable, im getting speeds "from before".Both 10G? If you are sure:Code: Select all{ /interface ethernet set [ find default-name=sfp-sfpplus1 ] advertise=10000M-full speed=10Gbps set [ find default-name=sfpplus2 ] advertise=10000M-full speed=10Gbps }
After running above commands and downloading file from NAS, on single big file max what im getting is around 140MB/s:
Re: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
Can you show a printscreen that captures all the interfaces traffic during that test? and also the cpu usage.
thanks
thanks
Re: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
Not sure how to get cpu load in graph form, but it stay around 30-40% levels.
Thank you very much for your time btw.
Re: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
The interface speed... is interface speed... you must not see bridge for speed....
You have sfp-sfpplus1@1Gbit on TX and sfpsfpplus2@1Gb on RX....
all work at 1Gb....
I think @Znevna had already guessed it with his question...
You have sfp-sfpplus1@1Gbit on TX and sfpsfpplus2@1Gb on RX....
all work at 1Gb....
I think @Znevna had already guessed it with his question...
Re: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
Best guess, one of the links is running at 1Gbps and since sfp2 is 10Gbps only, I suspect sfp1.
Re: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
Ok, what you want me to screenshot then?
And yes, I suspect something is running at 1GBps since it doesn't work as 10GBps at it should, but I think talking about it is redundant at best, what i want is to both sfp to run with correct speeds.
All I want is to restore previous transfer speeds, that allowed me to transfer files between two machines with at least 700-800MB/s rate.
edit:
if that helps, both sfp interfaces are rated 10Gbps:
And yes, I suspect something is running at 1GBps since it doesn't work as 10GBps at it should, but I think talking about it is redundant at best, what i want is to both sfp to run with correct speeds.
All I want is to restore previous transfer speeds, that allowed me to transfer files between two machines with at least 700-800MB/s rate.
edit:
if that helps, both sfp interfaces are rated 10Gbps:
Sorry for creating confusion, might be a language thing - I've meant that I have both workstation and NAS connected to the CRS210 using SFP connectors, and in addition, CRS210 have connected other devices using 1Gbps ethernet ports, and their presence doesn't impact transfer rates (I've tried without any additional devices connected to CRS210)(along other devices through 1GbE ethernet ports)
Re: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
You already have pasted this on terminal?
after that, click on safe mode and try to disable auto-negotiation in sfpxxx / interface / ethernet
first the nas, if works then the workstation
Code: Select all
{
/interface ethernet
set [ find default-name=sfp-sfpplus1 ] advertise=10000M-full speed=10Gbps
set [ find default-name=sfpplus2 ] advertise=10000M-full speed=10Gbps
}
first the nas, if works then the workstation
Re: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
Yes, I've done it when you requested it, I didn't disabled auto negotiation before though.You already have pasted this on terminal?
after that, click on safe mode and try to disable auto-negotiation in sfpxxx / interface / ethernet
first the nas, if works then the workstation
Re-did it now, no change.
(for more clarity, I've renamed interface sfp-sfpplus1 to sfpplus1)
Re: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
try to invert the spf modules, if possible...
Re: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
By inverting modules you mean connect cable that's now in sfp1 to sfp2 and what's in sfp2 to sfp1 in CRS210, or physically invert the cables, so what's now in workstation NIC will be in CRS, and what's in CRS will be in workstation?try to invert the spf modules, if possible...
Re: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
Switch sfp + modules inside the RouterBOARD
Sorry, I have to go now, it's late, I hope you fix it.
Sorry, I have to go now, it's late, I hope you fix it.
Re: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
It is midnight here as well, I'll try to do that tomorrow. Thank you for your time.
Re: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
700-800 mbps on 10 gbps interfaces doesn't seem like 'worked fine' to me..
Yes, both should be 10Gbps interfaces, as mentioned above, they worked fine giving me 700-800MBps speeds, now its much slower. If I disconnect everything from router and connect NAS with workstation directly using one cable, im getting speeds "from before".
"now its much slower. If I disconnect everything from router and connect NAS with workstation directly using one cable, im getting speeds "from before"."
Re: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
How much 'custom' configuration do you have on your network?
Firewall rules, VLANs? Static IPs?
Being that you upgraded from a very old version to the newest.. I wonder if there are some issues hiding..
Consider resetting everything to defaults and seeing what happens?
But to confirm, you workstation and NAS are connected to the 10 gbps ports, can you please post screenshots of the SFP page of the interface, want to confirm they are both running at 10 gbps..
Second question.. Are the NAS and workstation ONLY connected with the SFP+ ports? Or are they also connected with twisted pair?
My first thought reading all of this is that your NAS or workstation (or both) are connected to the network also with a 1 gbps connection, when the router comes online and issues IPs, it changes which interface is used for traffic..
Lastly, what is the condition of your network cables? Check every interface on your switch and router, making sure they are all running at 1 gbps.
Firewall rules, VLANs? Static IPs?
Being that you upgraded from a very old version to the newest.. I wonder if there are some issues hiding..
Consider resetting everything to defaults and seeing what happens?
But to confirm, you workstation and NAS are connected to the 10 gbps ports, can you please post screenshots of the SFP page of the interface, want to confirm they are both running at 10 gbps..
Second question.. Are the NAS and workstation ONLY connected with the SFP+ ports? Or are they also connected with twisted pair?
My first thought reading all of this is that your NAS or workstation (or both) are connected to the network also with a 1 gbps connection, when the router comes online and issues IPs, it changes which interface is used for traffic..
Lastly, what is the condition of your network cables? Check every interface on your switch and router, making sure they are all running at 1 gbps.
Re: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
@kevinds
Thank you for your time.
MBps, not mbps, so around 5-6Gbps - not ideally, but way more than 150MBps. I did confirmed these speeds over weekend by attaching NAS directly to the Mellanox NIC in my workstation, also shuffled between various cables and NICs, and everything always worked as expected, so only one weak point is the MT switch in my opinion.700-800 mbps on 10 gbps interfaces doesn't seem like 'worked fine' to me..
none, freshly after reset, unless you consider WIFI hotspot a custom configuration.How much 'custom' configuration do you have on your network?
static IPs are on router, not on switch, and are same for machine from before router change - around 10 machines have static IPs, rest is on dynamic. Never touched VLANs or firewall rules, as core desired functionality of network (...10Gbps transfers) never worked for me.Firewall rules, VLANs? Static IPs?
that was first thing I did, even doing through netinstall so absolutely nothing are leftConsider resetting everything to defaults and seeing what happens?
please see attached image:But to confirm, you workstation and NAS are connected to the 10 gbps ports, can you please post screenshots of the SFP page of the interface, want to confirm they are both running at 10 gbps..
they are connected through only SFP+ portsSecond question.. Are the NAS and workstation ONLY connected with the SFP+ ports? Or are they also connected with twisted pair?
Thank you for your time.
Re: Low 10GbE transfer speeds after replacing old router with MikroTik hAP ac3
For anyone who ever have similar issue - disabling "Multiple Spanning Tree Protocol (MSTP)" on both of machines fixed everything.