Community discussions

MikroTik App
 
SomeYoungGuy
Frequent Visitor
Frequent Visitor
Topic Author
Posts: 73
Joined: Mon Oct 22, 2012 10:18 am

Mikrotik RAIN

Thu Jun 26, 2014 5:02 pm

There is a concept called RAIN:
Redundant Array of Internet Nodes
Redundant Array of Independent Nodes
Redundant Array of inexpensive Networks
Redundant Array of Internet Networks


How ever you want to phrase it, the point is that the concept refers in some way creating a Network along multiple paths. Much like the well know RAID, that may use more than 1 disk to store information, RAIN would use more then one ISP to transmit information.

Yes, i know... there is already a number of fail-over and routing options that can make your network seem like a RAIN network, but im interested in achieving a RAIN network, from a Mikrotik to a Mikrotik via an array of Networks with the absolute emphasis on packet loss. This means that a packet is sent over each link (in both directions) and a buffer captures the packets, reorders them selecting the first available packet and transmits them on. The links can be any speed, and since the packets are all sent across all links the resulting speed will be the speed of the fastest network, whatever link that may be.

Typically this would be setup in a client - server arrangement, and the clients may "connect" at random from any unknown location (with an ip provided by that ISP. The client may be behind a firewall, but the server probably not.

Has anyone achieved this using two Mikrotik routers? Or can someone advise me what the best way to achieve this is?

This is what i have so far:

To solve the ISP provided IP address issue, and the client firewall, I selected a VPN to create the initial connection, creating predictable IPs between server and clients.

In order to duplicate packets across the 2 or more VPN connections, I have selected an EOIP tunnel over each VPN respectively, and bonded these using the standard bonding, and using broadcast as the type. (You don't appear to be able to bond anything other then EOIP or actual Ethernet adapters)

The tests showed that duplicate packets flow over each VPN and back correctly as intended, and this mechanism works correctly - in theory. However, use in the real world, packets in the underlying data stream (RTP) are reported as lost - even if the VPN and EOIP tunnels report no loss.

The intended use is for RTP streaming, like VoIP

Any further assistance with this would be appreciated.
 
coylh
Member Candidate
Member Candidate
Posts: 159
Joined: Tue Jul 12, 2011 12:11 am

Re: Mikrotik RAIN

Fri Jun 27, 2014 1:01 am

Take a look at http://www.talari.com/technology/

You can mirror packets across multiple wan links like raid1.
 
ytuxedo002
Frequent Visitor
Frequent Visitor
Posts: 62
Joined: Fri Apr 13, 2012 11:36 pm

Re: Mikrotik RAIN

Fri Jun 27, 2014 1:09 am

There is a concept called RAIN:
Redundant Array of Internet Nodes
Redundant Array of Independent Nodes
Redundant Array of inexpensive Networks
Redundant Array of Internet Networks


How ever you want to phrase it, the point is that the concept refers in some way creating a Network along multiple paths. Much like the well know RAID, that may use more than 1 disk to store information, RAIN would use more then one ISP to transmit information.

Yes, i know... there is already a number of fail-over and routing options that can make your network seem like a RAIN network, but im interested in achieving a RAIN network, from a Mikrotik to a Mikrotik via an array of Networks with the absolute emphasis on packet loss. This means that a packet is sent over each link (in both directions) and a buffer captures the packets, reorders them selecting the first available packet and transmits them on. The links can be any speed, and since the packets are all sent across all links the resulting speed will be the speed of the fastest network, whatever link that may be.

Typically this would be setup in a client - server arrangement, and the clients may "connect" at random from any unknown location (with an ip provided by that ISP. The client may be behind a firewall, but the server probably not.

Has anyone achieved this using two Mikrotik routers? Or can someone advise me what the best way to achieve this is?

This is what i have so far:

To solve the ISP provided IP address issue, and the client firewall, I selected a VPN to create the initial connection, creating predictable IPs between server and clients.

In order to duplicate packets across the 2 or more VPN connections, I have selected an EOIP tunnel over each VPN respectively, and bonded these using the standard bonding, and using broadcast as the type. (You don't appear to be able to bond anything other then EOIP or actual Ethernet adapters)

The tests showed that duplicate packets flow over each VPN and back correctly as intended, and this mechanism works correctly - in theory. However, use in the real world, packets in the underlying data stream (RTP) are reported as lost - even if the VPN and EOIP tunnels report no loss.

The intended use is for RTP streaming, like VoIP

Any further assistance with this would be appreciated.

I too am looking for this same solution and i would like to get it to work with Mikrotiks in stead of adding another piece of hardware to the puzzle.

Through my research i found a company that does this with Mikrotik hardware but using their own software loaded on them. You can see what I mean here: http://www.getvibe.info/how-vibe-works/

What I have done in my LAB is:
1- I've created two EOIP tunnels across two WANs between CPE and the VPN router (supposedly at your office). I've assumed both CPE and the VPN router are using two WANs (from different service providers).
Note: the problem with EOIP is that both ends including the customer must have static public IP addresses. Since customers usually don't have this, I've created a PPTP tunnel and then EOIP over that. PPTP by itself can't be added to the bonding interface.
2- Put them in bonding interface and tried different bonding modes to enable fault tolerance. There are many bonding modes but you need to test them over time to decide on the best method.
3- Have the bonding interface (consisting of two EOIP interfaces across two WANs) to act as the IP gateway between customer Phone devices and your SIP server.

So as you can see I've used EOIP, PPTP, Bonding and Routing and depending on your scenario we need QoS and Firewall mangle to work together to implement something similar to what you asked.

Let me know if any of this helps and if you are able to get it working.
 
SomeYoungGuy
Frequent Visitor
Frequent Visitor
Topic Author
Posts: 73
Joined: Mon Oct 22, 2012 10:18 am

Re: Mikrotik RAIN

Fri Jun 27, 2014 1:21 pm

Hi ytuxedo002, yes, i know ViBE well, we do in fact use it.

This solution is intended for clients that are not prepared to pay the license fees changed by Voipex, but want some kind of dual voice link to us.

I'm at exactly the same point as you - but my findings showed that the underlying RTP stream suffered from considerable packet loss. The loss was noticeable on the phone, especial when you impose limitation to one for the VPN's to simulate degraded internet.

What was the results of your tests, in the real world (non-lab)?
 
SomeYoungGuy
Frequent Visitor
Frequent Visitor
Topic Author
Posts: 73
Joined: Mon Oct 22, 2012 10:18 am

Re: Mikrotik RAIN

Mon Aug 04, 2014 1:34 pm

My final thoughts on this is that bonding EOIP links seems like the right way to do this - but the problem is that on either side there is no "buffer" to re-order the packets or drop the late duplicates - if there is there sure isnt any setting -ie "buffer in milliseconds: XXX". So until this is a feature of the Mikrotik OS - im doubtful this will work well - though it may be acceptable, just not great.

PS, the additional overhead created by the PPTP, and the EOIP also create for a much heavier load. For a single call the G729 payload, starts off with 8KB/s, then Asterisk puts on headers etc, passes it onto the router, and puts on its own PPTP headers, and the EOIP also, by the time its traveling over the EOIP, the same call is at a massive 43kb/s.

So all in all - not looking so great ;(

Who is online

Users browsing this forum: holvoetn, yhfung and 31 guests