Page 1 of 1

Separate ports in CRS354-48P-4S+2Q+ with HW-offload

Posted: Tue Oct 17, 2023 5:41 pm
by dzo
I have some VLANs, routing and so on working fine with other devices in our network here.
Now I got a CRS354 and I wanted to separate the ports and put them together with one uplink-port each (sfp-sfpplus):

Group A:
sfp-sfpplus1 with ports ether 1 - 24, 1-18 on VLAN 101, 19-24 trunk-ports for APs.
Group B:
sfp-sfpplus3 with ports ether 25-34, bounded by two (25+26, 27+28...) and connected to the CPU for management (all trunk ports)
Group C:
sfp-sfpplus4 with ports ether 35-48, also bounded by two (all trunk ports to other switches).

My configurate runs with hardware-offload, I see the "H" on the ports in the bridge, so it might everything be fine.
But just when I connect only one of this parts, if I connect one Bonding of ether 25-34 and one port ether 1-18, the network gets flapping.
I think, the data are not really separated.

I did:
One Bridge for VLAN-Management (two or more bridges will not be hardware offloaded.
And as mentioned in the Help (see "Isolated switch groups"): Port-Isolation in the switch-chip to separate the ports.

Everything else (VLANs, Bonding) works as expected, only the isolation is broken.

Here is my configuration:
# 2023-10-17 16:16:36 by RouterOS 7.11.2
#
# model = CRS354-48P-4S+2Q+
/interface bridge
add admin-mac=XX:XX:XX:XX:XX:7A auto-mac=no ingress-filtering=no name=bridge \
    protocol-mode=none pvid=101 vlan-filtering=yes
/interface ethernet
set [ find default-name=ether1 ] l2mtu=1592
[...]
set [ find default-name=ether24 ] l2mtu=1592
set [ find default-name=ether25 ] l2mtu=1592 poe-out=off
set [ find default-name=ether26 ] l2mtu=1592 poe-out=off
set [ find default-name=ether27 ] l2mtu=1592 poe-out=off
set [ find default-name=ether28 ] l2mtu=1592 poe-out=off
set [ find default-name=ether29 ] l2mtu=1592 poe-out=off
set [ find default-name=ether30 ] l2mtu=1592
set [ find default-name=ether31 ] l2mtu=1592 poe-out=off
[...]
set [ find default-name=ether48 ] l2mtu=1592
set [ find default-name=qsfpplus1-1 ] l2mtu=1592
set [ find default-name=qsfpplus1-2 ] l2mtu=1592
set [ find default-name=qsfpplus1-3 ] l2mtu=1592
set [ find default-name=qsfpplus1-4 ] l2mtu=1592
set [ find default-name=qsfpplus2-1 ] l2mtu=1592
set [ find default-name=qsfpplus2-2 ] l2mtu=1592
set [ find default-name=qsfpplus2-3 ] l2mtu=1592
set [ find default-name=qsfpplus2-4 ] l2mtu=1592
set [ find default-name=sfp-sfpplus1 ] auto-negotiation=no l2mtu=1592 speed=\
    10Gbps
set [ find default-name=sfp-sfpplus2 ] auto-negotiation=no l2mtu=1592 speed=\
    10Gbps
set [ find default-name=sfp-sfpplus3 ] auto-negotiation=no l2mtu=1592 speed=\
    10Gbps
set [ find default-name=sfp-sfpplus4 ] auto-negotiation=no l2mtu=1592 speed=\
    10Gbps

/interface vlan
add interface=bridge name=vlan101_OldMain vlan-id=101
add interface=ether49 name=vlan101_Port vlan-id=101
add interface=bridge name=vlan1000_Systemnetz vlan-id=1000

/interface bonding
add mode=802.3ad name=Bond1 slaves=ether26,ether25
add mode=802.3ad name=Bond2 slaves=ether27,ether28
add mode=802.3ad name=Bond3 slaves=ether29,ether30
add mode=802.3ad name=Bond4 slaves=ether31,ether32
add mode=802.3ad name=Bond5 slaves=ether33,ether34
add mode=802.3ad name=Bond6 slaves=ether35,ether36
add mode=802.3ad name=Bond7 slaves=ether37,ether38
add mode=802.3ad name=Bond8 slaves=ether39,ether40
add mode=802.3ad name=Bond9 slaves=ether41,ether42
add mode=802.3ad name=Bond10 slaves=ether43,ether44
add mode=802.3ad name=Bond11 slaves=ether45,ether46
add mode=802.3ad name=Bond12 slaves=ether47,ether48

/interface ethernet switch
set 0 l3-hw-offloading=yes
/interface lte apn
set [ find default=yes ] ip-type=ipv4 use-network-apn=no
/interface wireless security-profiles
set [ find default=yes ] supplicant-identity=MikroTik
/port
set 0 name=serial0
/interface bridge port
add auto-isolate=yes bridge=bridge frame-types=\
    admit-only-untagged-and-priority-tagged ingress-filtering=no interface=\
    ether1 pvid=101
add bridge=bridge frame-types=admit-only-untagged-and-priority-tagged \
    ingress-filtering=no interface=ether2 pvid=101
add bridge=bridge frame-types=admit-only-untagged-and-priority-tagged \
    ingress-filtering=no interface=ether3 pvid=101
add bridge=bridge frame-types=admit-only-untagged-and-priority-tagged \
    ingress-filtering=no interface=ether4 pvid=101
add bridge=bridge frame-types=admit-only-untagged-and-priority-tagged \
    ingress-filtering=no interface=ether6 pvid=101
add bridge=bridge frame-types=admit-only-untagged-and-priority-tagged \
    ingress-filtering=no interface=ether7 pvid=101
add bridge=bridge frame-types=admit-only-untagged-and-priority-tagged \
    ingress-filtering=no interface=ether8 pvid=101
add bridge=bridge frame-types=admit-only-untagged-and-priority-tagged \
    ingress-filtering=no interface=ether9 pvid=101
add auto-isolate=yes bridge=bridge frame-types=\
    admit-only-untagged-and-priority-tagged ingress-filtering=no interface=\
    ether10 pvid=101
add bridge=bridge frame-types=admit-only-untagged-and-priority-tagged \
    ingress-filtering=no interface=ether11 pvid=101
add bridge=bridge frame-types=admit-only-untagged-and-priority-tagged \
    ingress-filtering=no interface=ether12 pvid=101
add bridge=bridge frame-types=admit-only-untagged-and-priority-tagged \
    ingress-filtering=no interface=ether13 pvid=101
add bridge=bridge frame-types=admit-only-untagged-and-priority-tagged \
    ingress-filtering=no interface=ether14 pvid=101
add bridge=bridge frame-types=admit-only-untagged-and-priority-tagged \
    ingress-filtering=no interface=ether15 pvid=101
add bridge=bridge frame-types=admit-only-untagged-and-priority-tagged \
    ingress-filtering=no interface=ether16 pvid=101
add bridge=bridge frame-types=admit-only-untagged-and-priority-tagged \
    ingress-filtering=no interface=ether17 pvid=101
add bridge=bridge comment=101er frame-types=\
    admit-only-untagged-and-priority-tagged ingress-filtering=no interface=\
    ether18 pvid=101
add bridge=bridge frame-types=admit-only-vlan-tagged ingress-filtering=no \
    interface=ether19
add bridge=bridge frame-types=admit-only-vlan-tagged ingress-filtering=no \
    interface=ether20
add bridge=bridge frame-types=admit-only-vlan-tagged ingress-filtering=no \
    interface=ether21
add bridge=bridge frame-types=admit-only-vlan-tagged ingress-filtering=no \
    interface=ether22
add bridge=bridge frame-types=admit-only-vlan-tagged ingress-filtering=no \
    interface=ether23
add bridge=bridge comment=APs frame-types=admit-only-vlan-tagged \
    ingress-filtering=no interface=ether24
add bridge=bridge frame-types=admit-only-vlan-tagged ingress-filtering=no \
    interface=qsfpplus1-1
add bridge=bridge frame-types=admit-only-vlan-tagged ingress-filtering=no \
    interface=qsfpplus1-2
add bridge=bridge frame-types=admit-only-vlan-tagged ingress-filtering=no \
    interface=qsfpplus1-3
add bridge=bridge frame-types=admit-only-vlan-tagged ingress-filtering=no \
    interface=qsfpplus1-4
add bridge=bridge frame-types=admit-only-vlan-tagged ingress-filtering=no \
    interface=qsfpplus2-1
add bridge=bridge frame-types=admit-only-vlan-tagged ingress-filtering=no \
    interface=qsfpplus2-2
add bridge=bridge frame-types=admit-only-vlan-tagged ingress-filtering=no \
    interface=qsfpplus2-3
add bridge=bridge comment=MegaUplinks frame-types=admit-only-vlan-tagged \
    ingress-filtering=no interface=qsfpplus2-4
add auto-isolate=yes bridge=bridge frame-types=admit-only-vlan-tagged \
    ingress-filtering=no interface=sfp-sfpplus1
add bridge=bridge frame-types=admit-only-vlan-tagged ingress-filtering=no \
    interface=sfp-sfpplus2
add bridge=bridge frame-types=admit-only-vlan-tagged ingress-filtering=no \
    interface=sfp-sfpplus3
add bridge=bridge comment=Uplinks frame-types=admit-only-vlan-tagged \
    ingress-filtering=no interface=sfp-sfpplus4
add bridge=bridge comment=Bondings frame-types=admit-only-vlan-tagged \
    ingress-filtering=no interface=Bond12
add bridge=bridge frame-types=admit-only-vlan-tagged ingress-filtering=no \
    interface=Bond1
add bridge=bridge frame-types=admit-only-untagged-and-priority-tagged \
    ingress-filtering=no interface=ether5 pvid=101
add bridge=bridge frame-types=admit-only-vlan-tagged ingress-filtering=no \
    interface=Bond2
add bridge=bridge frame-types=admit-only-vlan-tagged ingress-filtering=no \
    interface=Bond3
add bridge=bridge frame-types=admit-only-vlan-tagged ingress-filtering=no \
    interface=Bond4
add bridge=bridge frame-types=admit-only-vlan-tagged ingress-filtering=no \
    interface=Bond5
add bridge=bridge frame-types=admit-only-vlan-tagged ingress-filtering=no \
    interface=Bond6
add bridge=bridge frame-types=admit-only-vlan-tagged ingress-filtering=no \
    interface=Bond7
add bridge=bridge frame-types=admit-only-vlan-tagged ingress-filtering=no \
    interface=Bond8
add bridge=bridge frame-types=admit-only-vlan-tagged ingress-filtering=no \
    interface=Bond9
add bridge=bridge frame-types=admit-only-vlan-tagged ingress-filtering=no \
    interface=Bond10
add bridge=bridge frame-types=admit-only-vlan-tagged ingress-filtering=no \
    interface=Bond11
/ip firewall connection tracking
set enabled=yes
/ip neighbor discovery-settings
set discover-interface-list=!dynamic
/ip settings
set max-neighbor-entries=8192
/ipv6 settings
set disable-ipv6=yes max-neighbor-entries=8192
/interface bridge vlan
add bridge=bridge comment=OldMain tagged="bridge,qsfpplus1-1,qsfpplus1-2,qsfpp\
    lus1-3,qsfpplus1-4,qsfpplus2-1,qsfpplus2-2,qsfpplus2-3,qsfpplus2-4,sfp-sfp\
    plus1,sfp-sfpplus2,sfp-sfpplus3,sfp-sfpplus4,Bond1,Bond2,Bond3,Bond4,Bond5\
    ,Bond6,Bond7,Bond8,Bond9,Bond10,Bond11,Bond12,ether19,ether20,ether21,ethe\
    r22,ether23,ether24" untagged="ether1,ether2,ether3,ether4,ether5,ether6,e\
    ther7,ether8,ether9,ether10,ether11,ether12,ether13,ether14,ether15,ether1\
    6,ether17,ether18" vlan-ids=101
add bridge=bridge comment=OldV2 tagged="qsfpplus1-1,qsfpplus1-2,qsfp\
    plus1-3,qsfpplus1-4,qsfpplus2-1,qsfpplus2-2,qsfpplus2-3,qsfpplus2-4,sfp-sf\
    pplus1,sfp-sfpplus2,sfp-sfpplus4,Bond6,Bond7,Bond8,Bond9,Bond10,Bond11,Bon\
    d12,ether19,ether20,ether21,ether22,ether23,ether24" vlan-ids=102,103
add bridge=bridge comment=OldV3 tagged="qsfpplus1-1,qsfpplus1-2,qsfpp\
    lus1-3,qsfpplus1-4,qsfpplus2-1,qsfpplus2-2,qsfpplus2-3,qsfpplus2-4,sfp-sfp\
    plus1,sfp-sfpplus2,sfp-sfpplus4,Bond6,Bond7,Bond8,Bond9,Bond10,Bond11,Bond\
    12,ether19,ether20,ether21,ether22,ether23,ether24" vlan-ids="110,111,112,\
    113,114,115,116,117,118,119,120,121,122,123,124,125,126,127,128,129"
add bridge=bridge comment=OldV4 tagged="qsfpplus1-1,qsfpplus1-2,qsfppl\
    us1-3,qsfpplus1-4,qsfpplus2-1,qsfpplus2-2,qsfpplus2-3,qsfpplus2-4,sfp-sfpp\
    lus1,sfp-sfpplus2,sfp-sfpplus4,Bond6,Bond7,Bond8,Bond9,Bond10,Bond11,Bond1\
    2,ether19,ether20,ether21,ether22,ether23,ether24" vlan-ids=\
    201,202,210,211,212
add bridge=bridge comment="VLAN Dep2" tagged="qsfpplus1-1,qsfpplus1-2,qsfppl\
    us1-3,qsfpplus1-4,qsfpplus2-1,qsfpplus2-2,qsfpplus2-3,qsfpplus2-4,sfp-sfpp\
    lus1,sfp-sfpplus2,sfp-sfpplus4,Bond6,Bond7,Bond8,Bond9,Bond10,Bond11,Bond1\
    2,ether19,ether20,ether21,ether22,ether23,ether24" vlan-ids=\
    1210,1220,1230,1240,1250,1260,1270
add bridge=bridge comment="VLAN Dep3" tagged="qsfpplus1-1,qsfpplus1-\
    2,qsfpplus1-3,qsfpplus1-4,qsfpplus2-1,qsfpplus2-2,qsfpplus2-3,qsfpplus2-4,\
    sfp-sfpplus1,sfp-sfpplus2,sfp-sfpplus4,Bond6,Bond7,Bond8,Bond9,Bond10,Bond\
    11,Bond12,ether19,ether20,ether21,ether22,ether23,ether24" vlan-ids=\
    1010,1013,1019
add bridge=bridge comment="VLAN V4" tagged="qsfpplus1-1,qsfpplus1-2,q\
    sfpplus1-3,qsfpplus1-4,qsfpplus2-1,qsfpplus2-2,qsfpplus2-3,qsfpplus2-4,sfp\
    -sfpplus1,sfp-sfpplus2,sfp-sfpplus4,Bond6,Bond7,Bond8,Bond9,Bond10,Bond11,\
    Bond12,ether19,ether20,ether21,ether22,ether23,ether24" vlan-ids=\
    1020,1030,1031,1032,1033
add bridge=bridge comment="VLAN Management New" tagged="qsfpplus1-1,qsfpplus1-2,qsfpplus\
    1-3,qsfpplus1-4,qsfpplus2-1,qsfpplus2-2,qsfpplus2-3,qsfpplus2-4,sfp-sfpplu\
    s1,sfp-sfpplus2,sfp-sfpplus4,Bond6,Bond7,Bond8,Bond9,Bond10,Bond11,Bond12,\
    ether19,ether20,ether21,ether22,ether23,ether24" vlan-ids=1100
add bridge=bridge comment="VLAN Dep5" tagged="qsfpplus1-1,qsfpplus1-2,qsfpplus\
    1-3,qsfpplus1-4,qsfpplus2-1,qsfpplus2-2,qsfpplus2-3,qsfpplus2-4,sfp-sfpplu\
    s1,sfp-sfpplus2,sfp-sfpplus4,Bond6,Bond7,Bond8,Bond9,Bond10,Bond11,Bond12,\
    ether19,ether20,ether21,ether22,ether23,ether24" vlan-ids=1110
add bridge=bridge comment="VLAN Hotspot" tagged="qsfpplus1-1,qsfpplus1-2,qsfpp\
    lus1-3,qsfpplus1-4,qsfpplus2-1,qsfpplus2-2,qsfpplus2-3,qsfpplus2-4,sfp-sfp\
    plus1,sfp-sfpplus2,sfp-sfpplus4,Bond6,Bond7,Bond8,Bond9,Bond10,Bond11,Bond\
    12,ether19,ether20,ether21,ether22,ether23,ether24" vlan-ids=2000
add bridge=bridge comment="VLAN Guest" tagged="qsfpplus1-1,qsfpplus1-2,qsfpp\
    lus1-3,qsfpplus1-4,qsfpplus2-1,qsfpplus2-2,qsfpplus2-3,qsfpplus2-4,sfp-sfp\
    plus1,sfp-sfpplus2,sfp-sfpplus4,Bond6,Bond7,Bond8,Bond9,Bond10,Bond11,Bond\
    12,ether19,ether20,ether21,ether22,ether23,ether24" vlan-ids=\
    3000,3100,3210,3220,3230,3240,3250,3260,3270
add bridge=bridge comment="VLAN FreeWifi" tagged="qsfpplus1-1,qsfpplus1-2,\
    qsfpplus1-3,qsfpplus1-4,qsfpplus2-1,qsfpplus2-2,qsfpplus2-3,qsfpplus2-4,sf\
    p-sfpplus1,sfp-sfpplus2,sfp-sfpplus4,Bond6,Bond7,Bond8,Bond9,Bond10,Bond11\
    ,Bond12,ether19,ether20,ether21,ether22,ether23,ether24" vlan-ids=4000
add bridge=bridge comment="Main System" tagged="bridge,qsfpplus1-1,qsfpplu\
    s1-2,qsfpplus1-3,qsfpplus1-4,qsfpplus2-1,qsfpplus2-2,qsfpplus2-3,qsfpplus2\
    -4,sfp-sfpplus1,sfp-sfpplus2,sfp-sfpplus4,Bond6,Bond7,Bond8,Bond9,Bond10,B\
    ond11,Bond12,ether19,ether20,ether21,ether22,ether23,ether24" vlan-ids=\
    1000
add bridge=bridge comment=Systemnetze tagged="qsfpplus1-1,qsfpplus1-2,qsfpplus\
    1-3,qsfpplus1-4,qsfpplus2-1,qsfpplus2-2,qsfpplus2-3,qsfpplus2-4,sfp-sfpplu\
    s1,sfp-sfpplus2,sfp-sfpplus4,Bond6,Bond7,Bond8,Bond9,Bond10,Bond11,Bond12,\
    ether19,ether20,ether21,ether22,ether23,ether24" vlan-ids=1001,1003,1009
add bridge=bridge comment="VLAN WAN" vlan-ids=500
/interface ovpn-server server
set auth=sha1,md5
/ip dhcp-client
add interface=vlan101_OldMain
add interface=vlan1000_Systemnetz
add interface=ether49
add interface=vlan101_Port
/routing bfd configuration
add disabled=no interfaces=all min-rx=200ms min-tx=200ms multiplier=5
/system identity
set name=Switch_POE

/interface ethernet switch
set 0 l3-hw-offloading=yes

/interface ethernet switch port-isolation
set 60 forwarding-override=switch2-cpu
set 0 forwarding-override=qsfpplus1-1
set 1 forwarding-override=qsfpplus1-2
set 2 forwarding-override=qsfpplus1-3
set 3 forwarding-override=qsfpplus1-4
set 4 forwarding-override=qsfpplus2-1
set 5 forwarding-override=qsfpplus2-2
set 6 forwarding-override=qsfpplus2-3
set 7 forwarding-override=qsfpplus2-4
set 8 forwarding-override="ether1,ether2,ether3,ether4,ether5,ether6,ether7,et\
    her8,ether9,ether10,ether11,ether12,ether13,ether14,ether15,ether16,ether1\
    7,ether18,ether19,ether20,ether21,ether22,ether23,ether24"
set 9 forwarding-override=sfp-sfpplus2
set 10 forwarding-override="ether25,ether26,ether27,ether28,ether29,ether30,et\
    her31,ether32,ether33,ether34,switch1-cpu"
set 11 forwarding-override="ether35,ether36,ether37,ether38,ether39,ether40,et\
    her41,ether42,ether43,ether44,ether45,ether46,ether47,ether48"
set 12 forwarding-override="sfp-sfpplus1,ether2,ether3,ether4,ether5,ether6,et\
    her7,ether8,ether9,ether10,ether11,ether12,ether13,ether14,ether15,ether16\
    ,ether17,ether18,ether19,ether20,ether21,ether22,ether23,ether24"
set 13 forwarding-override="sfp-sfpplus1,ether1,ether3,ether4,ether5,ether6,et\
    her7,ether8,ether9,ether10,ether11,ether12,ether13,ether14,ether15,ether16\
    ,ether17,ether18,ether19,ether20,ether21,ether22,ether23,ether24"
set 14 forwarding-override="sfp-sfpplus1,ether1,ether2,ether4,ether5,ether6,et\
    her7,ether8,ether9,ether10,ether11,ether12,ether13,ether14,ether15,ether16\
    ,ether17,ether18,ether19,ether20,ether21,ether22,ether23,ether24"
set 15 forwarding-override="sfp-sfpplus1,ether1,ether2,ether3,ether5,ether6,et\
    her7,ether8,ether9,ether10,ether11,ether12,ether13,ether14,ether15,ether16\
    ,ether17,ether18,ether19,ether20,ether21,ether22,ether23,ether24"
set 16 forwarding-override="sfp-sfpplus1,ether1,ether2,ether3,ether4,ether6,et\
    her7,ether8,ether9,ether10,ether11,ether12,ether13,ether14,ether15,ether16\
    ,ether17,ether18,ether19,ether20,ether21,ether22,ether23,ether24"
set 17 forwarding-override="sfp-sfpplus1,ether1,ether2,ether3,ether4,ether5,et\
    her7,ether8,ether9,ether10,ether11,ether12,ether13,ether14,ether15,ether16\
    ,ether17,ether18,ether19,ether20,ether21,ether22,ether23,ether24"
set 18 forwarding-override="sfp-sfpplus1,ether1,ether2,ether3,ether4,ether5,et\
    her6,ether8,ether9,ether10,ether11,ether12,ether13,ether14,ether15,ether16\
    ,ether17,ether18,ether19,ether20,ether21,ether22,ether23,ether24"
set 19 forwarding-override="sfp-sfpplus1,ether1,ether2,ether3,ether4,ether5,et\
    her6,ether7,ether9,ether10,ether11,ether12,ether13,ether14,ether15,ether16\
    ,ether17,ether18,ether19,ether20,ether21,ether22,ether23,ether24"
set 20 forwarding-override="sfp-sfpplus1,ether1,ether2,ether3,ether4,ether5,et\
    her6,ether7,ether8,ether10,ether11,ether12,ether13,ether14,ether15,ether16\
    ,ether17,ether18,ether19,ether20,ether21,ether22,ether23,ether24"
set 21 forwarding-override="sfp-sfpplus1,ether1,ether2,ether3,ether4,ether5,et\
    her6,ether7,ether8,ether9,ether11,ether12,ether13,ether14,ether15,ether16,\
    ether17,ether18,ether19,ether20,ether21,ether22,ether23,ether24"
set 22 forwarding-override="sfp-sfpplus1,ether1,ether2,ether3,ether4,ether5,et\
    her6,ether7,ether8,ether9,ether10,ether12,ether13,ether14,ether15,ether16,\
    ether17,ether18,ether19,ether20,ether21,ether22,ether23,ether24"
set 23 forwarding-override="sfp-sfpplus1,ether1,ether2,ether3,ether4,ether5,et\
    her6,ether7,ether8,ether9,ether10,ether11,ether13,ether14,ether15,ether16,\
    ether17,ether18,ether19,ether20,ether21,ether22,ether23,ether24"
set 24 forwarding-override="sfp-sfpplus1,ether1,ether2,ether3,ether4,ether5,et\
    her6,ether7,ether8,ether9,ether10,ether11,ether12,ether14,ether15,ether16,\
    ether17,ether18,ether19,ether20,ether21,ether22,ether23,ether24"
set 25 forwarding-override="sfp-sfpplus1,ether1,ether2,ether3,ether4,ether5,et\
    her6,ether7,ether8,ether9,ether10,ether11,ether12,ether13,ether15,ether16,\
    ether17,ether18,ether19,ether20,ether21,ether22,ether23,ether24"
set 26 forwarding-override="sfp-sfpplus1,ether1,ether2,ether3,ether4,ether5,et\
    her6,ether7,ether8,ether9,ether10,ether11,ether12,ether13,ether14,ether16,\
    ether17,ether18,ether19,ether20,ether21,ether22,ether23,ether24"
set 27 forwarding-override="sfp-sfpplus1,ether1,ether2,ether3,ether4,ether5,et\
    her6,ether7,ether8,ether9,ether10,ether11,ether12,ether13,ether14,ether15,\
    ether17,ether18,ether19,ether20,ether21,ether22,ether23,ether24"
set 28 forwarding-override="sfp-sfpplus1,ether1,ether2,ether3,ether4,ether5,et\
    her6,ether7,ether8,ether9,ether10,ether11,ether12,ether13,ether14,ether15,\
    ether16,ether18,ether19,ether20,ether21,ether22,ether23,ether24"
set 29 forwarding-override="sfp-sfpplus1,ether1,ether2,ether3,ether4,ether5,et\
    her6,ether7,ether8,ether9,ether10,ether11,ether12,ether13,ether14,ether15,\
    ether16,ether17,ether19,ether20,ether21,ether22,ether23,ether24"
set 30 forwarding-override="sfp-sfpplus1,ether1,ether2,ether3,ether4,ether5,et\
    her6,ether7,ether8,ether9,ether10,ether11,ether12,ether13,ether14,ether15,\
    ether16,ether17,ether18,ether20,ether21,ether22,ether23,ether24"
set 31 forwarding-override="sfp-sfpplus1,ether1,ether2,ether3,ether4,ether5,et\
    her6,ether7,ether8,ether9,ether10,ether11,ether12,ether13,ether14,ether15,\
    ether16,ether17,ether18,ether19,ether21,ether22,ether23,ether24"
set 32 forwarding-override="sfp-sfpplus1,ether1,ether2,ether3,ether4,ether5,et\
    her6,ether7,ether8,ether9,ether10,ether11,ether12,ether13,ether14,ether15,\
    ether16,ether17,ether18,ether19,ether20,ether22,ether23,ether24"
set 33 forwarding-override="sfp-sfpplus1,ether1,ether2,ether3,ether4,ether5,et\
    her6,ether7,ether8,ether9,ether10,ether11,ether12,ether13,ether14,ether15,\
    ether16,ether17,ether18,ether19,ether20,ether21,ether23,ether24"
set 34 forwarding-override="sfp-sfpplus1,ether1,ether2,ether3,ether4,ether5,et\
    her6,ether7,ether8,ether9,ether10,ether11,ether12,ether13,ether14,ether15,\
    ether16,ether17,ether18,ether19,ether20,ether21,ether22,ether24"
set 35 forwarding-override="sfp-sfpplus1,ether1,ether2,ether3,ether4,ether5,et\
    her6,ether7,ether8,ether9,ether10,ether11,ether12,ether13,ether14,ether15,\
    ether16,ether17,ether18,ether19,ether20,ether21,ether22,ether23"
set 36 forwarding-override="sfp-sfpplus3,ether26,ether27,ether28,ether29,ether\
    30,ether31,ether32,ether33,ether34,switch1-cpu"
set 37 forwarding-override="sfp-sfpplus3,ether25,ether27,ether28,ether29,ether\
    30,ether31,ether32,ether33,ether34,switch1-cpu"
set 38 forwarding-override="sfp-sfpplus3,ether25,ether26,ether28,ether29,ether\
    30,ether31,ether32,ether33,ether34,switch1-cpu"
set 39 forwarding-override="sfp-sfpplus3,ether25,ether26,ether27,ether29,ether\
    30,ether31,ether32,ether33,ether34,switch1-cpu"
set 40 forwarding-override="sfp-sfpplus3,ether25,ether26,ether27,ether28,ether\
    30,ether31,ether32,ether33,ether34,switch1-cpu"
set 41 forwarding-override="sfp-sfpplus3,ether25,ether26,ether27,ether28,ether\
    29,ether31,ether32,ether33,ether34,switch1-cpu"
set 42 forwarding-override="sfp-sfpplus3,ether25,ether26,ether27,ether28,ether\
    29,ether30,ether32,ether33,ether34,switch1-cpu"
set 43 forwarding-override="sfp-sfpplus3,ether25,ether26,ether27,ether28,ether\
    29,ether30,ether31,ether33,ether34,switch1-cpu"
set 44 forwarding-override="sfp-sfpplus3,ether25,ether26,ether27,ether28,ether\
    29,ether30,ether31,ether32,ether34,switch1-cpu"
set 45 forwarding-override="sfp-sfpplus3,ether25,ether26,ether27,ether28,ether\
    29,ether30,ether31,ether32,ether33,switch1-cpu"
set 46 forwarding-override="sfp-sfpplus4,ether36,ether37,ether38,ether39,ether\
    40,ether41,ether42,ether43,ether44,ether45,ether46,ether47,ether48"
set 47 forwarding-override="sfp-sfpplus4,ether35,ether37,ether38,ether39,ether\
    40,ether41,ether42,ether43,ether44,ether45,ether46,ether47,ether48"
set 48 forwarding-override="sfp-sfpplus4,ether35,ether36,ether38,ether39,ether\
    40,ether41,ether42,ether43,ether44,ether45,ether46,ether47,ether48"
set 49 forwarding-override="sfp-sfpplus4,ether35,ether36,ether37,ether39,ether\
    40,ether41,ether42,ether43,ether44,ether45,ether46,ether47,ether48"
set 50 forwarding-override="sfp-sfpplus4,ether35,ether36,ether37,ether38,ether\
    40,ether41,ether42,ether43,ether44,ether45,ether46,ether47,ether48"
set 51 forwarding-override="sfp-sfpplus4,ether35,ether36,ether37,ether38,ether\
    39,ether41,ether42,ether43,ether44,ether45,ether46,ether47,ether48"
set 52 forwarding-override="sfp-sfpplus4,ether35,ether36,ether37,ether38,ether\
    39,ether40,ether42,ether43,ether44,ether45,ether46,ether47,ether48"
set 53 forwarding-override="sfp-sfpplus4,ether35,ether36,ether37,ether38,ether\
    39,ether40,ether41,ether43,ether44,ether45,ether46,ether47,ether48"
set 54 forwarding-override="sfp-sfpplus4,ether35,ether36,ether37,ether38,ether\
    39,ether40,ether41,ether42,ether44,ether45,ether46,ether47,ether48"
set 55 forwarding-override="sfp-sfpplus4,ether35,ether36,ether37,ether38,ether\
    39,ether40,ether41,ether42,ether43,ether45,ether46,ether47,ether48"
set 56 forwarding-override="sfp-sfpplus4,ether35,ether36,ether37,ether38,ether\
    39,ether40,ether41,ether42,ether43,ether44,ether46,ether47,ether48"
set 57 forwarding-override="sfp-sfpplus4,ether35,ether36,ether37,ether38,ether\
    39,ether40,ether41,ether42,ether43,ether44,ether45,ether47,ether48"
set 58 forwarding-override="sfp-sfpplus4,ether35,ether36,ether37,ether38,ether\
    39,ether40,ether41,ether42,ether43,ether44,ether45,ether46,ether48"
set 59 forwarding-override="sfp-sfpplus4,ether35,ether36,ether37,ether38,ether\
    39,ether40,ether41,ether42,ether43,ether44,ether45,ether46,ether47"

The /interface ethernet section is shortened, 55+ ports are quite a lot.
Ports not in use are forwarded to themselves (/interface ethernet switch port-isolation set 0 forwarding-override=qsfpplus1-1) - its not a bug.

Because I do not see why my configuration is not working as expected, I think I have a problem in my understanding of the functionality of the bridge and the port-isolation. I would be glad, if anyone can help me.

PS: Port 49 is for management purpose only, I use it just when I'm next to the switch, otherwise I will go on VLAN 101 (today, in future VLAN 1000).

Re: Separate ports in CRS354-48P-4S+2Q+ with HW-offload

Posted: Fri Oct 20, 2023 1:48 am
by dzo
New idea for this problem:

Maybe the limitation of only one bridge for this chip is a problem. So I use the one bridge for VLAN-controlled ports, the other ports I link together per forwarding-override.

My test: sfp-sfpplus4 will be trunk port, I can combine it with other trunk ports (ether19 to ether22), and on these ports is no need to control the vlan on this switch - the other switches on the way of the packets there will be the control of the vlan (in my case, I test a few APs that where mostly unused, so a little downtime didn't matter)

All ports are on the bridge, without forwarding-override turned on.
EXEPT:
A few trunk-ports are not on the bridge (ether19, ether20, ether21, ether22 and sfp-sfpplus4).
"Forwarding override" is turned on on these ports, so they - and only they - can communicate together, hopefully without bridge.

All the other ports might communicate by the bridge.

Part "Forwarding-override":
/interface ethernet switch port-isolation
set 11 forwarding-override="ether19,ether20,ether21,ether22"
set 30 forwarding-override="sfp-sfpplus4,ether20,ether21,ether22"
set 31 forwarding-override="sfp-sfpplus4,ether19,ether21,ether22"
set 32 forwarding-override="sfp-sfpplus4,ether19,ether20,ether22"
set 33 forwarding-override="sfp-sfpplus4,ether19,ether20,ether21"
Very sad, it doesn't work, I didn't found a way to seperate ports with HW-offload to different groups with different sfp-sfpplus uplinks on this switch.
These ports were not reachable any more.

:cry: :-?