Ir al contenido principal

Squid-Prefetch

Received : 2016-04-22T20:39:43.238Z
User-Agent: Squid-Prefetch
Language :
IP-Address: 201.251.104.194
Country : Argentina (AR)
Referer :
URI : http://www.grippo.com.ar/user/2189762.html
Web site : www.grippo.com.ar

A simple vista Squid es un proxy, asique me pregunto ¿por qué no forwardea ni Cookie ni Language? Si alguien sabe, por favor comentar. Como siempre lo que se trata de determinar es si hay que throttearlo / bloquearlo, o dejarlo crawlear libremente.


Comentarios

Publicar un comentario

Coméntalo.

Entradas populares de este blog

Lista de user-agents considerados robots

"Mozilla/5.0 (compatible; AhrefsBot/5.0; + http://ahrefs.com/robot/ ) "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/534+ (KHTML, like Gecko) MsnBot-Media /1.0b" (Adsense Bot Banned | Click advertising Adsense) - To stop clicks to send 25 Litecoin ( litecoin.org ) wallet: Le3Y4Ktc8wSEH1FvmojoVt7d8RPKa5JCNU and direct transfer details and website address to mail googlebote@yahoo.com | After receiving the coins bot wi =Mozilla/5.0 (compatible; Googlebot/2.1; + http://www.google.com/bot.html ) AdsBot-Google (+ http://www.google.com/adsbot.html ) AdsBot-Google-Mobile (+ http://www.google.com/mobile/adsbot.html ) Mozilla (iPhone; U; CPU iPhone OS 3 0 like Mac OS X) AppleWebKit (KHTML, like Gecko) Mobile Safari Alexa Verification Agent alexa-crawler Amazon Simple Notification Service Agent Apple-iPhone4C1/1001.523 (compatible;acapbot/0.1;treat like Googlebot) BacklinkCrawler ( http://www.backlinktest.com/crawler.html ) BaiduSpider Baiduspider+ ( http://www.baidu.com/search/
Publicar un comentario
Leer más

Mozilla/5.0 (compatible; SemrushBot/1.1~bl; +http://www.semrush.com/bot.html)

Received : 2016-05-27T00:16:44.564Z User-Agent: Mozilla/5.0 (compatible; SemrushBot/1.1~bl; + http://www.semrush.com/bot.html ) Language : IP-Address: 192.243.55.135 Country : () Referer : URI : http://www.grippo.es/ad/20100708.html Web site : www.grippo.es *** archivado como robot bueno
Publicar un comentario
Leer más