hi ppl
how can I cache all EXE.ZIP.RAR etc etc file downloading so ppl dont have to redownload second time?
I have around 800gb hard disk (4x200gb) for doing so...
mikrotik can detect that? I haven't tried to put it together.
-
-
wildbill442
Forum Guru
- Posts: 1055
- Joined:
- Location: Sacramento, CA
All you need to cache EXE.ZIP.RAR should be all setup once you specify a cache drive, appropriate disk space to use and enable the web proxy. Objects/urls to be excluded from cache can be specified in the /ip web-proxy cache command. You need to decide and make a choice on maximum size of object (determines max size of EXE.ZIP.RAR) that the web-proxy keeps in cache. its a choice on speed vs bandwidth saving (more hits).but how can I cache all EXE.ZIP.RAR etc etc file downloading?
What I do is run a version of squid patched with TOS option marking for cached hits (see http://www.it-academy.bg/zph/) in another box. You can mark the cache hits with any TOS value of choice and then have a mangle rule in Mikrotik further mark packets with this TOS byte. The cache mangle rule stays above every other rule. You can then use Queue trees (2.8 and above) or simple Queues (2.9 and above) to decide how fast a user downloads the cached object. My config here has a Mikrotik as a bridge and bandwidth manager while the second box is Redhat 9 with transparent squid proxy patched with ZPH TOS marking. Been working great for me.well i am also intersted in this topic. if it could be done, can i let the costumers use full speed for such downloads cause i limit the connection using pcq rules, if that works it would be great cause i will stop using microsoft isa for caching. hoping to see some answers
It will be nice to have mikrotik include this patch (as optional web-proxy-tos.NPK or so) and provide a configurable option to specify TOS of choice for cached hits. will be glad to throw away my second box and stick to Mikrotik's web-proxy.
Anybody doing this in another way?
Sonny
My settings...
This is my settings. we are running Hotspot on 192.168.254.1 on port 80 and the proxy is on IP 192.168.254.4 and port 8080.
And this setting works for like Http downloads from Microsoft etc..
******On the Main GW MT Router*****
/ ip firewall dst-nat
add src-address=192.168.0.0/16 in-interface=Ether2 dst-address=!192.168.254.1/32:80 protocol=tcp \
connection=!hs-auth action=redirect to-dst-port=8080 comment="Transparent Proxy" disabled=no
/ ip web-proxy
set enabled=yes src-address=0.0.0.0 port=8080 hostname="proxy" transparent-proxy=yes \
parent-proxy=192.168.254.4:8080 cache-administrator="Email adress" max-object-size="0 kB" \
cache-drive=system max-cache-size=none
/ ip web-proxy access
add dst-port=!443 method=connect action=deny comment="allow CONNECT only to SSL ports 443 \
\[https\] and 563 \[snews\]" disabled=no
add src-address=192.168.0.0/16 action=allow comment="Our Customers" disabled=no
add dst-port=23-25 action=deny comment="Deny using us as telnet ans SNMP relay" disabled=no
add action=deny comment="Deny everything else" disabled=no
/ ip web-proxy cache
add url="cgi-bin \\?" action=deny comment="don't cache dynamic http pages" disabled=no
*****On the Proxy MT router****
/ ip web-proxy
set enabled=yes src-address=0.0.0.0 port=8080 hostname="192.168.254.4" transparent-proxy=no \
parent-proxy=0.0.0.0:0 cache-administrator="email adress" max-object-size="200000 kB" \
cache-drive=secondary-master max-cache-size=unlimited
/ ip web-proxy access
add dst-port=!443 method=connect action=deny comment="allow CONNECT only to SSL ports 443 \
\[https\] and 563 \[snews\]" disabled=no
add src-address=192.168.0.0/16 action=allow comment="" disabled=no
add action=deny comment="" disabled=no
/ ip web-proxy cache
add url="cgi-bin \\?" action=deny comment="" disabled=no
add url="\\.exe\$" action=allow comment="" disabled=no
add url="\\.zip\$" action=allow comment="" disabled=no
add url="\\.mpeg\$" action=allow comment="" disabled=no
add url="\\.mp3\$" action=allow comment="" disabled=no
add url="\\.avi\$" action=allow comment="" disabled=no
add url="\\.pdf\$" action=allow comment="" disabled=no
add url="\\.rar\$" action=allow comment="" disabled=no
add url="\\.mov\$" action=allow comment="" disabled=no
add url="\\.mpg\$" action=allow comment="" disabled=no
add url="\\.dat\$" action=allow comment="" disabled=no
add action=deny comment="" disabled=no
And this setting works for like Http downloads from Microsoft etc..
******On the Main GW MT Router*****
/ ip firewall dst-nat
add src-address=192.168.0.0/16 in-interface=Ether2 dst-address=!192.168.254.1/32:80 protocol=tcp \
connection=!hs-auth action=redirect to-dst-port=8080 comment="Transparent Proxy" disabled=no
/ ip web-proxy
set enabled=yes src-address=0.0.0.0 port=8080 hostname="proxy" transparent-proxy=yes \
parent-proxy=192.168.254.4:8080 cache-administrator="Email adress" max-object-size="0 kB" \
cache-drive=system max-cache-size=none
/ ip web-proxy access
add dst-port=!443 method=connect action=deny comment="allow CONNECT only to SSL ports 443 \
\[https\] and 563 \[snews\]" disabled=no
add src-address=192.168.0.0/16 action=allow comment="Our Customers" disabled=no
add dst-port=23-25 action=deny comment="Deny using us as telnet ans SNMP relay" disabled=no
add action=deny comment="Deny everything else" disabled=no
/ ip web-proxy cache
add url="cgi-bin \\?" action=deny comment="don't cache dynamic http pages" disabled=no
*****On the Proxy MT router****
/ ip web-proxy
set enabled=yes src-address=0.0.0.0 port=8080 hostname="192.168.254.4" transparent-proxy=no \
parent-proxy=0.0.0.0:0 cache-administrator="email adress" max-object-size="200000 kB" \
cache-drive=secondary-master max-cache-size=unlimited
/ ip web-proxy access
add dst-port=!443 method=connect action=deny comment="allow CONNECT only to SSL ports 443 \
\[https\] and 563 \[snews\]" disabled=no
add src-address=192.168.0.0/16 action=allow comment="" disabled=no
add action=deny comment="" disabled=no
/ ip web-proxy cache
add url="cgi-bin \\?" action=deny comment="" disabled=no
add url="\\.exe\$" action=allow comment="" disabled=no
add url="\\.zip\$" action=allow comment="" disabled=no
add url="\\.mpeg\$" action=allow comment="" disabled=no
add url="\\.mp3\$" action=allow comment="" disabled=no
add url="\\.avi\$" action=allow comment="" disabled=no
add url="\\.pdf\$" action=allow comment="" disabled=no
add url="\\.rar\$" action=allow comment="" disabled=no
add url="\\.mov\$" action=allow comment="" disabled=no
add url="\\.mpg\$" action=allow comment="" disabled=no
add url="\\.dat\$" action=allow comment="" disabled=no
add action=deny comment="" disabled=no