Page 1 of 1

Keyword Filtering

Posted: Mon Nov 28, 2011 3:50 am
by rekholm
I saw this post in the archives (http://forum.mikrotik.com/viewtopic.php ... ter#p18028)that talked about how to achieve Keyword Filtering.. It works great. However I don't think I want to create a rule for each and every new word that I find I want to filter!! I there a good way in ROS, that you have found to do a list of words? Or some way to filter multiple words?

Here is the rule I have created so far:
chain=forward action=reject reject-with=icmp-admin-prohibited protocol=tcp port=80 content=+WORD
The problem is if for instance I do a google search for SOMETHING, it may not come back with word, but the web site may come back with WORD.. Hope this makes sense..

Thoughts? Ideas??
Thanks!

Re: Keyword Filtering

Posted: Fri Oct 21, 2016 8:03 am
by kimdonghwan
I saw this post in the archives (http://forum.mikrotik.com/viewtopic.php ... ter#p18028)that talked about how to achieve Keyword Filtering.. It works great. However I don't think I want to create a rule for each and every new word that I find I want to filter!! I there a good way in ROS, that you have found to do a list of words? Or some way to filter multiple words?

Here is the rule I have created so far:
chain=forward action=reject reject-with=icmp-admin-prohibited protocol=tcp port=80 content=+WORD
The problem is if for instance I do a google search for SOMETHING, it may not come back with word, but the web site may come back with WORD.. Hope this makes sense..

Thoughts? Ideas??
Thanks!
@rekholm

Sadly, after so many updates in ROS, from the beginning until version 6.37..
with so many Mikrotik experts nowadays..

We still couldn't block sites with specific keyword
:( :( :(

i have tried everything, from simple Content filtering in Firewall, through the NAT & Layer7 things..
none of them works..

The Web Proxy feature, can only block for as long as that specific keyword is located between www and .com
Keyword "PORN" for example, if we put *porn* or :porn in the Dst.Host, it can block only:

www.PORNblablabla.com
www.blablablaPORN.net

while others like:

en.wikipedia.com/porn
youtube.com/blabla/porn/watch
vimeo.com/pornblabla/blibli

as well as millions of sites like that, can still be accessed..

What i want is, block any sites or video streaming which contains political things, religion things, terrorism, isis, bombing, suicides, etc
and because it's impossible to list millions of sites like that, we can do it only with KEYWORD filtering.

But the Great Mikrotik RouterOS along with all of its experts around the world,
cannot do a simple "Keyword Filtering"

While a simple router like TP-Link or D-Link, can do it like a charm..
Unfortunately, we have more than 50 TP-Link Wireless Router connected to Mikrotik in our building.

i have to set up every TP-Link to do the "Keyword Filtering" because Mikrotik couldn't...

Re: Keyword Filtering

Posted: Fri Oct 21, 2016 9:04 am
by jarda
... and I am glad it is not possible.

Guys, what sense of Internet would you see if it was censored?

At least there is ssl encryption that prevents you to see the content of the web pages.

Re: Keyword Filtering

Posted: Fri Oct 21, 2016 9:52 am
by kimdonghwan
... and I am glad it is not possible.

Guys, what sense of Internet would you see if it was censored?

At least there is ssl encryption that prevents you to see the content of the web pages.
it was supposed to block only sensitive keywords..
we have more than 400 employees..

all of them are allowed to use internet but some keywords are prohibited such as "porn",
i want to block the Google Search with "porn"..

They can still access it using their own Mobile Data Package..or anywhere outside our work environment..
but as a System Administrator, i have to block it because my Boss told me so..

Pity that ROS 6.37.1 still couldn't do that..

Re: Keyword Filtering

Posted: Fri Oct 21, 2016 9:58 am
by jarda
Google uses ssl. A web site having word porn somewhere is not necessarily containing anything that you would like to block while other web page without it could be full of naked pictures. You cannot effectively deal with it.

Re: Keyword Filtering

Posted: Fri Oct 21, 2016 1:04 pm
by kimdonghwan
Google uses ssl. A web site having word porn somewhere is not necessarily containing anything that you would like to block while other web page without it could be full of naked pictures. You cannot effectively deal with it.
Okay..i understand..

is it still possible to do Keyword Filtering?
i mean we can still do Google Search with keyword "Porn" for example..
Google can show as many "porn" material as possible, no problem..
but to block users from clicking any of the search results further (contain "porn" string), is what i really wanted..

can we do it that way?
Thanks :)

Re: Keyword Filtering

Posted: Fri Oct 21, 2016 2:51 pm
by jarda
Well. A sort of it you can try to make with web proxy enabled and something maybe with L7 filtering on dns packets. Maybe something a bit more but not much. Rather to think about web filtering standalone proxy server with https interception, if the mikrotik way will seem not so effective. Try the web proxy first.

Re: Keyword Filtering

Posted: Mon Oct 24, 2016 6:25 am
by kimdonghwan
Well. A sort of it you can try to make with web proxy enabled and something maybe with L7 filtering on dns packets. Maybe something a bit more but not much. Rather to think about web filtering standalone proxy server with https interception, if the mikrotik way will seem not so effective. Try the web proxy first.
i'm using RB2011UiAS-2HnD (ROS v6.37.1)

The CPU always hit 9x% to 100% when the built-in web proxy was enabled.
We don't have a spare PC as a dedicated web proxy..

i have tried also a free account of OpenDNS..using the NAT feature to redirect..but looks like OpenDNS has no such feature (Keyword Filtering)..
so i use a complete URL like this:

i did Youtube search and grab the URL
https://www.youtube.com/results?search_query=terrorist

i put it on OpenDNS to block the whole URL..but it doesn't work..i can only block Youtube.com

Do you have any idea to block such URL?

Thank you very much for your replies..

Re: Keyword Filtering

Posted: Mon Oct 24, 2016 9:41 am
by jarda
You don't need any special pc for that, you can run everything virtually. Some real horse power is necessary for such filtering.