Community discussions

MikroTik App
 
jamecollins
just joined
Topic Author
Posts: 18
Joined: Tue Apr 11, 2017 1:00 pm

Collect client url

Sun Oct 14, 2018 5:02 am

For monitor and checking my client, I want to log all website my client was access. How can I do that with mikrotik.?
Thanks.
 
User avatar
Jotne
Forum Guru
Forum Guru
Posts: 3348
Joined: Sat Dec 24, 2016 11:17 am
Location: Magrathean

Re: Collect client url

Sun Oct 14, 2018 10:25 am

You kan look at my Splunk for Mikrotik project here: viewtopic.php?t=137338
With this you can log all DNS request that every client does. (look at picture for DNS logs)
Requesting DNS does not actually means that the client do visit a site, but gives a good idea of what is going on.
Remember that when a client visit a site like ex www.cnn.com it opens loots of tracker when opening the cnn.com

As you see below, when you do visit on site in your browser, you open actually at least 20+ sites.
It will also be DNS request for all this.

This I do always use Ghostery plugin for Chrome, to get a control of this and block most of this site.

Eks for www.cnn.com

Advertising
* Quantcast
* Amazon Associates
* DoubleClick
* NetRatings SiteCensus
* Bing Ads
* Outbrain
* KruxDigital
* Integral Ad Science
* ShareThrough
* Bounce Exchange
* Twitter Advertising
* Outbrain Amplify
Comments
* Livefyre
Customer Interaction
* Gigya Socialize
* Usabilla
Site Analytics
* Omniture (Adobe Analytics)
* Chartbeat
* Optimizely
* Index Exhchange
* Gigya
* Optimizely Geographical Tracking
Social Media
* Facebook Connect


PS for this forum (Mikrotik), you also visit Google Analytics.
 
jamecollins
just joined
Topic Author
Posts: 18
Joined: Tue Apr 11, 2017 1:00 pm

Re: Collect client url

Fri Oct 19, 2018 10:52 am

You kan look at my Splunk for Mikrotik project here: viewtopic.php?t=137338
With this you can log all DNS request that every client does. (look at picture for DNS logs)
Requesting DNS does not actually means that the client do visit a site, but gives a good idea of what is going on.
Remember that when a client visit a site like ex www.cnn.com it opens loots of tracker when opening the cnn.com

As you see below, when you do visit on site in your browser, you open actually at least 20+ sites.
It will also be DNS request for all this.

This I do always use Ghostery plugin for Chrome, to get a control of this and block most of this site.

Eks for www.cnn.com

Advertising
* Quantcast
* Amazon Associates
* DoubleClick
* NetRatings SiteCensus
* Bing Ads
* Outbrain
* KruxDigital
* Integral Ad Science
* ShareThrough
* Bounce Exchange
* Twitter Advertising
* Outbrain Amplify
Comments
* Livefyre
Customer Interaction
* Gigya Socialize
* Usabilla
Site Analytics
* Omniture (Adobe Analytics)
* Chartbeat
* Optimizely
* Index Exhchange
* Gigya
* Optimizely Geographical Tracking
Social Media
* Facebook Connect


PS for this forum (Mikrotik), you also visit Google Analytics.
Thanks Jotne. I know that problem when user request to website have 3rd tracking service. Your project very interesting, but does this can log the what exactly url what user access, such as abc.com/page1.html in case this website using http or https.
Thanks.
 
User avatar
Jotne
Forum Guru
Forum Guru
Posts: 3348
Joined: Sat Dec 24, 2016 11:17 am
Location: Magrathean

Re: Collect client url

Fri Oct 19, 2018 5:51 pm

No, it will only get DNS. In the Splunk project I did add a Webproxy page. This does logg full url, but only for HTTP and not HTTPS.
Since most of the web request today do use HTTPS, you will not get this info using MikriTik router.