Sat Jul 26, 2008 12:15 am
I'm seeing issues on ROS v3.11 similar to those reported by dohkoo. I've read every post I could find with vrrp as a topic but have not been able to find a solution where vrrp works, so I am hoping someone has this solved and will share their configuration or further troubleshooting suggestions.
My set up is:
-RB433 as "backup" and RB450 as "master" (both routers running v3.11)
-Each router connects to different ISP on the "outside" interface which is not configured for vrrp
-Each router has a private subnet "inside" that is not configured for vrrp
-Both Routers have a common subnet "etherHA" configured for vrrp. IP address 192.168.100.0/24 I'm only doing vrrp on this interface to develop a working configuration.
-The "etherHA" interface on each router connects to a switch where client PCs are also connected.
I've tried various configurations to get the desired behavior, but none of them has been productive.
Attempt 1 resulted in both routers claiming they are masters despite the priority setting of 255 on the RB450 master. Traffic from the etherHA network is attracted to the router that last has etherHA disabled/enabled, not the router with the highest priority. In this iteration I did not use scripting to toggle the interfaces.
Sniffs show that vrrp handshakes from both routers are seen by the backup's vrrp interface and the backup's etherHA interface, and the master's etherHA interface. But the master's vrrp interface only sees handshakes from the backup router's etherHA interface.
Config details:
"Backup" Router-vrrp configured with no scripts-------------------------
[admin@RB433-test-MT] > /interface ethernet print detail
Flags: X - disabled, R - running, S - slave
0 R name="inside" mtu=1500 mac-address=00:0C:42:28:8D:4A arp=enabled
auto-negotiation=yes full-duplex=yes speed=100Mbps
1 R name="outside" mtu=1500 mac-address=00:0C:42:28:8D:4B arp=enabled
auto-negotiation=yes full-duplex=yes speed=100Mbps master-port=none
bandwidth=unlimited/unlimited switch=0
2 R name="etherHA" mtu=1500 mac-address=00:0C:42:28:8D:4C arp=enabled
auto-negotiation=yes full-duplex=yes speed=100Mbps master-port=none
bandwidth=unlimited/unlimited switch=0
[admin@RB433-test-MT] > /interface vrrp print detail
Flags: X - disabled, I - invalid, R - running, M - master, B - backup
0 RM name="vrrp1" mtu=1500 mac-address=00:00:5E:00:01:01 arp=enabled
interface=etherHA vrid=1 priority=100 interval=1 preemption-mode=no
authentication=none password="" on-backup="" on-master=""
[admin@RB433-test-MT] > /ip address print detail
Flags: X - disabled, I - invalid, D - dynamic
0 ;;; Inside Subnet
address=10.255.192.1/24 network=10.255.192.0 broadcast=10.255.192.255
interface=inside actual-interface=inside
1 D address=72.148.42.30/32 network=68.216.218.62 broadcast=0.0.0.0
interface=pppoe-OUT actual-interface=pppoe-OUT
2 address=192.168.100.3/24 network=192.168.100.0 broadcast=192.168.100.255
interface=etherHA actual-interface=etherHA
3 address=192.168.100.1/24 network=192.168.100.0 broadcast=192.168.100.255
interface=vrrp1 actual-interface=vrrp1
[admin@RB433-test-MT] > /ip route print detail
Flags: X - disabled, A - active, D - dynamic,
C - connect, S - static, r - rip, b - bgp, o - ospf, m - mme,
B - blackhole, U - unreachable, P - prohibit
0 ADS dst-address=0.0.0.0/0 gateway=68.216.218.62 interface=pppoe-OUT
gateway-state=reachable distance=1 scope=30 target-scope=10
1 ADC dst-address=10.255.192.0/24 pref-src=10.255.192.1 interface=inside
distance=0 scope=10
2 ADC dst-address=68.216.218.16/32 pref-src=72.148.42.30
interface=pppoe-OUT distance=0 scope=10
3 ADC dst-address=192.168.100.0/24 pref-src=192.168.100.3 interface=etherHA
distance=0 scope=10
4 DC dst-address=192.168.100.0/24 pref-src=192.168.100.1 interface=vrrp1
distance=0 scope=10
"Master" Router - vrrp configured with no scripts---------------------------------
[admin@RB450-test-MT] > /interface ethernet print detail
Flags: X - disabled, R - running, S - slave
0 R name="outside" mtu=1500 mac-address=00:0C:42:2E:85:D2 arp=enabled auto-negotiation=yes full-duplex=yes speed=100Mbps
1 R name="inside" mtu=1500 mac-address=00:0C:42:2E:85:D3 arp=enabled auto-negotiation=yes full-duplex=yes speed=100Mbps master-port=none
bandwidth=unlimited/unlimited switch=0
2 R name="etherHA" mtu=1500 mac-address=00:0C:42:2E:85:D4 arp=enabled auto-negotiation=yes full-duplex=yes speed=100Mbps master-port=none
bandwidth=unlimited/unlimited switch=0
3 X name="ether4" mtu=1500 mac-address=00:0C:42:2E:85:D5 arp=enabled auto-negotiation=yes full-duplex=yes speed=100Mbps master-port=none
bandwidth=unlimited/unlimited switch=0
4 X name="ether5" mtu=1500 mac-address=00:0C:42:2E:85:D6 arp=enabled auto-negotiation=yes full-duplex=yes speed=100Mbps master-port=none
bandwidth=unlimited/unlimited switch=0
[admin@RB450-test-MT] > /interface vrrp print detail
Flags: X - disabled, I - invalid, R - running, M - master, B - backup
0 RM name="vrrp1" mtu=1500 mac-address=00:00:5E:00:01:01 arp=enabled interface=etherHA vrid=1 priority=255 interval=1 preemption-mode=no
authentication=none password="" on-backup="" on-master=""
[admin@RB450-test-MT] > /ip address print detail
Flags: X - disabled, I - invalid, D - dynamic
0 ;;; Inside Subnet
address=10.1.1.1/24 network=10.1.1.0 broadcast=10.1.1.255 interface=inside actual-interface=inside
1 D address=24.88.250.82/23 network=24.88.250.0 broadcast=24.88.251.255 interface=outside actual-interface=outside
2 address=192.168.100.2/24 network=192.168.100.0 broadcast=192.168.100.255 interface=etherHA actual-interface=etherHA
3 address=192.168.100.1/24 network=192.168.100.0 broadcast=192.168.100.255 interface=vrrp1 actual-interface=vrrp1
[admin@RB450-test-MT] > /ip route print detail
Flags: X - disabled, A - active, D - dynamic, C - connect, S - static, r - rip, b - bgp, o - ospf, m - mme,
B - blackhole, U - unreachable, P - prohibit
0 ADS dst-address=0.0.0.0/0 gateway=24.88.250.1 interface=outside gateway-state=reachable distance=0 scope=30 target-scope=10
1 ADC dst-address=10.1.1.0/24 pref-src=10.1.1.1 interface=inside distance=0 scope=10
2 ADC dst-address=24.88.250.0/23 pref-src=24.88.250.82 interface=outside distance=0 scope=10
3 ADC dst-address=192.168.100.0/24 pref-src=192.168.100.1 interface=vrrp1 distance=0 scope=10
4 DC dst-address=192.168.100.0/24 pref-src=192.168.100.2 interface=etherHA distance=0 scope=10
-----------------------------------------
On Attempt 2, I added the interface down/up scripts suggested by several other posts on VRRP topics. The backup router changes to backup status, but traffic from the etherHA subnet fails because the ARP for 00:00:5E:00:01:01 is not advertised by either router until the master's etherHA interface is disabled/enabled. I have also observed that if the backup router's etherHA interface is bounced last, traffic is attracted to it. And, if the master is shut down, the backup never becomes master.
The scripts for on-backup and on-master cause the vrrp1 interface's ARP to bounce back and forth between routers (because the interface is flapping) and to also disappear so traffic flow is constantly interrupted and eventually fails altogether. This occurs with clients and MikroTik routers connected to a managed switch as well as a workgroup switch. I have also tried both scenarios with a vlan as the parent interface for the vrrp interface, but I get the same behavior.
Sniffs show that The backup's etherHA interface is receiving vrrp handshakes from the master's etherHA and the master's vrrp1 interface is receiving vrrp handshakes from the backup router's etherHA interface. But vrrp handshakes from both routers are seen by the the master's etherHA interface.
Config details:
"master" router-------------
[admin@RB450-test-MT] > /interface vrrp print detail
Flags: X - disabled, I - invalid, R - running, M - master, B - backup
0 RM name="vrrp1" mtu=1500 mac-address=00:00:5E:00:01:01 arp=enabled interface=etherHA vrid=1 priority=255 interval=1 preemption-mode=no
authentication=none password="" on-backup=/interface ethernet set etherHA disabled=yes\r\n/interface ethernet set etherHA disabled=no
on-master=/interface ethernet set etherHA disabled=yes\r\n/interface ethernet set etherHA disabled=no
"backup" router---------------
[admin@RB433-test-MT] /interface vrrp> print detail
Flags: X - disabled, I - invalid, R - running, M - master, B - backup
0 B name="vrrp1" mtu=1500 mac-address=00:00:5E:00:01:01 arp=enabled interface=etherHA vrid=1 priority=100 interval=1 preemption-mode=no
authentication=none password="" on-backup=/interface ethernet set etherHA disabled=yes\r\n/interface ethernet set etherHA disabled=no
on-master=/interface ethernet set etherHA disabled=yes\r\n/interface ethernet set etherHA disabled=no
Routes and IP addresses are identical to Attempt 1 except they toggle from up to down and back with the script on the backup router.
Any suggestions or ideas would be much appreciated. I don't want to use Cisco routers/HSRP to provide a Highly Available default gateway for the hosts on this subnet.
Regards,
lamorrell