Community discussions

MikroTik App
 
User avatar
DogHead
Member Candidate
Member Candidate
Topic Author
Posts: 196
Joined: Thu Jan 03, 2008 9:36 pm
Location: Anywhere you want me to be

HWMP Mesh - Is it possible

Thu Jan 15, 2009 8:50 pm

Has anyone successfully implemented HWMP mesh using WDS dynamic-mesh mode with more than 4 nodes?

Seems like it suffers from exactly the same issues as just bridging WDS with RSTP.

We really want to create layer 2 mesh that scales well using MT, but without using ad-hoc mode (like all other mesh solutions) it seems impossible.

See my earlier post for more details on what we have tested.
 
User avatar
DogHead
Member Candidate
Member Candidate
Topic Author
Posts: 196
Joined: Thu Jan 03, 2008 9:36 pm
Location: Anywhere you want me to be

Re: HWMP Mesh - Is it possible

Fri Jan 23, 2009 12:50 am

One Last Try...I have posted this several times with no response from anyone. I have sent in to support with no response. So from the deafening silence it seems that on one has an answer...

We are trying to set up mobile mesh networks using HWMP and are not having good success. The network needs to be very dynamic and capable of choosing paths, recalculating paths in the event of obstruction, and deal with potentially many paths from one point to the other.

We would like to be able to get to 10-12 nodes in a mesh.

Our platform is the Alix 3d2 board which is AMD LX800 with 256MB ram. We are using MT 3.19. We have also tried with RB333 boards with same results.lic

We have tried with a variety of radio modules including SR5, SR2, EMP-8602, CM9 all with same results. So we are pretty convinced that our issues in software configuration.

We first started with just a basic WDS bridged mesh network with RSTP. We would set the wireless interface to run with WDS dynamic. This would scale up to 3 or 4 nodes, but when we added a 5th node, the network would pretty much stop working. We determined that looping and the lack of a FDB kept frames from transiting properly.

So we next tried using MME in a dual radio configuration. This seems to run into the same limitation of relying on WDS scalability for the mesh backhaul. Also, it introduces a level of complexity for our customers which is not desirable.

So we moved on to HWMP, which, as we understand it, should scale much better than just plain WDS with RSTP. However we are seeing similar types of scaling issues.

The attached exported configuration should give you an idea of what all of our settings are on the mesh portal node. For non-portal nodes, we simply turn off the mesh portal value.

First we set up 4 nodes, all with great SNR, low noise floor etc. For about 5 minutes we can ping any one for the nodes from the portal node without problem. After 5 minutes or so, we start seeing pings fail and FDB entries disappearing. ARP tables get all messed up on client connected PC.

All nodes are seen in wireless scan and we have tx powers adjusted to low so that we have low noise floor.

We thought the problem might be with ANI, as we saw CPU utilization reach 90% so we disabled it. CPU utilization dropped back to below 10%. Should we be using ANI at all?

But even after disabling ANI, we still cannot get even 4 nodes to work with HWMP, let alone 6 or more.

Do you have suggestions on a configuration which will work? Do you have an example configuration for a HWMP mesh that will work with 6 or more nodes?

If we can’t get this resolved, our customer is going to go over to firetide.

# jan/01/2002 01:19:12 by RouterOS 3.19
#
/interface ethernet
set 0 arp=enabled auto-negotiation=yes cable-settings=default comment="" \
disable-running-check=yes disabled=no full-duplex=yes mac-address=\
00:0D:B9:12:55:64 mtu=1500 name=ether1 speed=100Mbps
/interface mesh
add admin-mac=00:00:00:00:00:00 arp=enabled auto-mac=yes comment="" disabled=\
no hwmp-default-hoplimit=32 hwmp-prep-lifetime=5m \
hwmp-preq-destination-only=yes hwmp-preq-reply-and-forward=yes \
hwmp-preq-retries=2 hwmp-preq-waiting-time=4s hwmp-rann-interval=10s \
hwmp-rann-lifetime=22s hwmp-rann-propagation-delay=0.5 mesh-portal=yes \
mtu=1500 name=mesh1 reoptimize-paths=yes
/interface wireless security-profiles
set default authentication-types="" eap-methods=passthrough group-ciphers="" \
group-key-update=5m interim-update=0s mode=none name=default \
radius-eap-accounting=no radius-mac-accounting=no \
radius-mac-authentication=no radius-mac-caching=disabled \
radius-mac-format=XX:XX:XX:XX:XX:XX radius-mac-mode=as-username \
static-algo-0=none static-algo-1=none static-algo-2=none static-algo-3=\
none static-key-0="" static-key-1="" static-key-2="" static-key-3="" \
static-sta-private-algo=none static-sta-private-key="" \
static-transmit-key=key-0 supplicant-identity=xxx tls-certificate=\
none tls-mode=no-certificates unicast-ciphers="" wpa-pre-shared-key="" \
wpa2-pre-shared-key=""
add authentication-types="" eap-methods=passthrough group-ciphers="" \
group-key-update=5m interim-update=0s mode=none name=device2 \
radius-eap-accounting=no radius-mac-accounting=no \
radius-mac-authentication=no radius-mac-caching=disabled \
radius-mac-format=XX:XX:XX:XX:XX:XX radius-mac-mode=as-username \
static-algo-0=none static-algo-1=none static-algo-2=none static-algo-3=\
none static-key-0="" static-key-1="" static-key-2="" static-key-3="" \
static-sta-private-algo=none static-sta-private-key="" \
static-transmit-key=key-0 supplicant-identity=xxx tls-certificate=\
none tls-mode=no-certificates unicast-ciphers="" wpa-pre-shared-key="" \
wpa2-pre-shared-key=""
/interface wireless
set 0 ack-timeout=dynamic adaptive-noise-immunity=none \
allow-sharedkey=no antenna-gain=0 antenna-mode=ant-a area="" arp=enabled \
band=2.4ghz-b/g basic-rates-a/g=6Mbps basic-rates-b=1Mbps burst-time=\
disabled comment="" compression=no country=no_country_set \
default-ap-tx-limit=0 default-authentication=yes default-client-tx-limit=\
0 default-forwarding=yes dfs-mode=none disable-running-check=no disabled=\
no disconnect-timeout=3s frame-lifetime=0 frequency=2412 frequency-mode=\
manual-txpower hide-ssid=no hw-retries=4 mac-address=00:02:6F:44:B7:BA \
max-station-count=2007 mode=ap-bridge mtu=1500 name=wlan1 \
noise-floor-threshold=default on-fail-retry-time=100ms \
periodic-calibration=default periodic-calibration-interval=60 \
preamble-mode=both proprietary-extensions=post-2.9.25 radio-name=\
00026F44B7BA rate-set=default scan-list=default security-profile=device2 \
ssid=xxx station-bridge-clone-mac=00:00:00:00:00:00 \
supported-rates-a/g=6Mbps,9Mbps,12Mbps,18Mbps,24Mbps,36Mbps,48Mbps,54Mbps \
supported-rates-b=1Mbps,2Mbps,5.5Mbps,11Mbps tx-power-mode=default \
update-stats-interval=disabled wds-cost-range=50-150 wds-default-bridge=\
mesh1 wds-default-cost=100 wds-ignore-ssid=no wds-mode=dynamic-mesh \
wmm-support=enabled
/interface wireless manual-tx-power-table
set wlan1 comment="" manual-tx-powers="1Mbps:17,2Mbps:17,5.5Mbps:17,11Mbps:17,\
6Mbps:17,9Mbps:17,12Mbps:17,18Mbps:17,24Mbps:17,36Mbps:17,48Mbps:17,54Mbps\
:17,HT20-1:0,HT20-2:0,HT20-3:0,HT20-4:0,HT20-5:0,HT20-6:0,HT20-7:0,HT20-8:\
0,HT40-1:0,HT40-2:0,HT40-3:0,HT40-4:0,HT40-5:0,HT40-6:0,HT40-7:0,HT40-8:0"
/interface wireless nstreme
set wlan1 comment="" disable-csma=yes enable-nstreme=no enable-polling=yes \
framer-limit=3200 framer-policy=best-fit
/ip ipsec proposal
set default auth-algorithms=sha1 disabled=no enc-algorithms=3des lifetime=30m \
name=default pfs-group=modp1024
/port
set 0 baud-rate=115200 data-bits=8 flow-control=none name=serial0 parity=none \
stop-bits=1
/queue type
set default kind=pfifo name=default pfifo-limit=50
set ethernet-default kind=pfifo name=ethernet-default pfifo-limit=50
set wireless-default kind=sfq name=wireless-default sfq-allot=1514 \
sfq-perturb=5
set synchronous-default kind=red name=synchronous-default red-avg-packet=1000 \
red-burst=20 red-limit=60 red-max-threshold=50 red-min-threshold=10
set hotspot-default kind=sfq name=hotspot-default sfq-allot=1514 sfq-perturb=\
5
set default-small kind=pfifo name=default-small pfifo-limit=10
/snmp
set contact=support@xxx.com enabled=yes engine-boots=3 engine-id="" \
location=xxx time-window=15 trap-sink=0.0.0.0 trap-version=1
/snmp community
set public address=0.0.0.0/0 authentication-password="" \
authentication-protocol=MD5 encryption-password="" encryption-protocol=\
DES name=public read-access=yes security=none write-access=no
/system logging action
set memory memory-lines=100 memory-stop-on-full=no name=memory target=memory
set disk disk-lines=100 disk-stop-on-full=no name=disk target=disk
set echo name=echo remember=yes target=echo
set remote name=remote remote=0.0.0.0:514 target=remote
/user group
add name=read policy="local,telnet,ssh,reboot,read,test,winbox,password,web,sn\
iff,!ftp,!write,!policy"
add name=write policy="local,telnet,ssh,reboot,read,write,test,winbox,password\
,web,sniff,!ftp,!policy"
add name=full policy="local,telnet,ssh,ftp,reboot,read,write,policy,test,winbo\
x,password,web,sniff"
add name=webbox policy="local,reboot,read,write,policy,test,password,web,sniff\
,!telnet,!ssh,!ftp,!winbox"
/user
add address=0.0.0.0/0 comment="system default user" disabled=no group=full \
name=admin
add address=0.0.0.0/0 comment="" disabled=no group=full name=xxx
add address=0.0.0.0/0 comment="" disabled=no group=webbox name=install
/interface bridge settings
set use-ip-firewall=no use-ip-firewall-for-vlan=no
/interface ethernet mirror
set
/interface mesh port
add comment="" disabled=no hello-interval=10s interface=wlan1 mesh=mesh1 \
path-cost=10 port-type=auto
add comment="" disabled=no hello-interval=10s interface=ether1 mesh=mesh1 \
path-cost=10 port-type=auto
/interface wireless align
set active-mode=yes audio-max=-20 audio-min=-100 audio-monitor=\
00:00:00:00:00:00 filter-mac=00:00:00:00:00:00 frame-size=300 \
frames-per-second=25 receive-all=no ssid-all=no
/interface wireless sniffer
set channel-time=200ms file-limit=10 file-name="" memory-limit=10 \
multiple-channels=no only-headers=no receive-errors=no streaming-enabled=\
no streaming-max-rate=0 streaming-server=0.0.0.0
/interface wireless snooper
set channel-time=200ms multiple-channels=yes receive-errors=no
/ip accounting
set account-local-traffic=no enabled=no threshold=256
/ip accounting web-access
set accessible-via-web=no address=0.0.0.0/0
/ip address
add address=192.168.1.1/24 broadcast=192.168.1.255 comment="" disabled=no \
interface=mesh1 network=192.168.1.0
/ip dhcp-server config
set store-leases-disk=5m
/ip dns
set allow-remote-requests=yes cache-max-ttl=1w cache-size=2048KiB \
max-udp-packet-size=512 primary-dns=208.67.222.222 secondary-dns=\
208.67.220.220
/ip firewall connection tracking
set enabled=yes generic-timeout=10m icmp-timeout=10s tcp-close-timeout=10s \
tcp-close-wait-timeout=10s tcp-established-timeout=1d \
tcp-fin-wait-timeout=10s tcp-last-ack-timeout=10s \
tcp-syn-received-timeout=5s tcp-syn-sent-timeout=5s tcp-syncookie=no \
tcp-time-wait-timeout=10s udp-stream-timeout=3m udp-timeout=10s
/ip firewall service-port
set ftp disabled=no ports=21
set tftp disabled=no ports=69
set irc disabled=no ports=6667
set h323 disabled=no
set sip disabled=no ports=5060,5061
set pptp disabled=no
/ip neighbor discovery
set ether1 discover=yes
set wlan1 discover=no
set mesh1 discover=yes
/ip proxy
set always-from-cache=no cache-administrator=webmaster cache-hit-dscp=4 \
cache-on-disk=no enabled=no max-cache-size=unlimited \
max-client-connections=600 max-fresh-time=3d max-server-connections=600 \
parent-proxy=0.0.0.0 parent-proxy-port=0 port=8080 serialize-connections=\
no src-address=0.0.0.0
/ip service
set telnet address=0.0.0.0/0 disabled=no port=23
set ftp address=0.0.0.0/0 disabled=no port=21
set www address=0.0.0.0/0 disabled=no port=80
set ssh address=0.0.0.0/0 disabled=no port=22
set www-ssl address=0.0.0.0/0 certificate=none disabled=yes port=443
set api address=0.0.0.0/0 disabled=yes port=8728
set winbox address=0.0.0.0/0 disabled=no port=8291
/ip socks
set connection-idle-timeout=2m enabled=no max-connections=200 port=1080
/ip traffic-flow
set active-flow-timeout=30m cache-entries=4k enabled=no \
inactive-flow-timeout=15s interfaces=all
/ip upnp
set allow-disable-external-interface=yes enabled=no show-dummy-rule=yes
/queue interface
set ether1 queue=ethernet-default
set wlan1 queue=wireless-default
set mesh1 queue=default
/radius incoming
set accept=no port=3799
/store
add comment="" disabled=no disk=primary-master name=web-proxy1 type=web-proxy
/system clock manual
set dst-delta=+00:00 dst-end="jan/01/1970 00:00:00" dst-start=\
"jan/01/1970 00:00:00" time-zone=+00:00
/system console
add disabled=no port=serial0 term=vt102
set [ find vcno=1 ] disabled=no term=linux
set [ find vcno=2 ] disabled=no term=linux
set [ find vcno=3 ] disabled=no term=linux
set [ find vcno=4 ] disabled=no term=linux
set [ find vcno=5 ] disabled=no term=linux
set [ find vcno=6 ] disabled=no term=linux
set [ find vcno=7 ] disabled=no term=linux
set [ find vcno=8 ] disabled=no term=linux
/system console screen
set line-count=25
/system hardware
set multi-cpu=no
/system health
set state-after-reboot=enabled
/system identity
set name=xxx
/system logging
add action=memory disabled=no prefix="" topics=info
add action=memory disabled=no prefix="" topics=error
add action=memory disabled=no prefix="" topics=warning
add action=echo disabled=no prefix="" topics=critical
/system note
set note="" show-at-login=yes
/system ntp client
set enabled=yes mode=unicast primary-ntp=192.83.249.28 secondary-ntp=\
204.74.68.55
/system ntp server
set broadcast=no enabled=yes manycast=yes multicast=no
/system routerboard bios
set
/system upgrade mirror
set check-interval=1d enabled=no primary-server=0.0.0.0 secondary-server=\
0.0.0.0 user=""
/system watchdog
set auto-send-supout=no automatic-supout=yes no-ping-delay=5m watch-address=\
none watchdog-timer=yes
/tool bandwidth-server
set allocate-udp-ports-from=2000 authenticate=yes enabled=yes max-sessions=10
/tool e-mail
set from=<> server=0.0.0.0
/tool graphing
set store-every=5min
/tool graphing interface
add allow-address=0.0.0.0/0 disabled=no interface=all store-on-disk=yes
/tool mac-server
add disabled=no interface=all
/tool mac-server ping
set enabled=yes
/tool sniffer
set file-limit=10 file-name="" filter-address1=0.0.0.0/0:0-65535 \
filter-address2=0.0.0.0/0:0-65535 filter-protocol=ip-only filter-stream=\
yes interface=all memory-limit=10 only-headers=no streaming-enabled=no \
streaming-server=0.0.0.0
/user aaa
set accounting=yes default-group=read interim-update=0s use-radius=no
 
tierpath
newbie
Posts: 47
Joined: Wed Oct 22, 2008 5:24 am

Re: HWMP Mesh - Is it possible

Fri Jan 23, 2009 4:51 am

Firetides Use Adhoc and 5ghz range, maybe if you posted a layout it would help, just having the router config doesn't do much when your talking about a problem such as this.

Firetides are pretty neat, but they are usually not setup fully meshed as that creates to much traffic, I know this as I have seen 5 diff firetide installs at malls with 20 units setup in mesh mode at one time. It's not a simple as plug n play.

Layout and hardware specs make it much easier, otherwise we don't know if your doing this mountain top to mount top or apartment to apartment.