41 different robots | Hits | Bandwidth | Last visit |
Unknown robot (identified by 'crawl') | 49,541+52 | 697.65 MB | 31 May 2015 - 18:55 |
Googlebot | 25,141+60 | 534.10 MB | 31 May 2015 - 23:59 |
Yandex bot | 11,594+106 | 175.57 MB | 31 May 2015 - 23:55 |
bingbot | 8,211+110 | 114.55 MB | 31 May 2015 - 23:45 |
Unknown robot (identified by 'robot') | 5,890+2 | 83.16 MB | 31 May 2015 - 23:55 |
MJ12bot | 5,093+297 | 86.95 MB | 31 May 2015 - 23:46 |
Unknown robot (identified by 'bot*') | 2,442+220 | 46.84 MB | 31 May 2015 - 22:06 |
Unknown robot (identified by empty user agent string) | 2,214+4 | 4.72 MB | 30 May 2015 - 02:10 |
Mail.ru bot | 1,441+37 | 5.81 MB | 31 May 2015 - 23:57 |
StackRambler | 808 | 6.51 MB | 14 May 2015 - 01:20 |
BaiDuSpider | 383 | 5.72 MB | 31 May 2015 - 23:53 |
Yahoo Slurp | 244+22 | 3.50 MB | 31 May 2015 - 23:04 |
Unknown robot (identified by '*bot') | 232 | 5.99 MB | 12 May 2015 - 23:49 |
Alexa (IA Archiver) | 155+11 | 12.56 MB | 17 May 2015 - 04:10 |
Bing Preview bot | 150 | 3.57 MB | 31 May 2015 - 04:14 |
Unknown robot (identified by 'spider') | 87+8 | 952.86 KB | 29 May 2015 - 12:55 |
Phantom | 80 | 1.10 MB | 30 May 2015 - 14:17 |
Unknown robot (identified by hit on 'robots.txt') | 0+60 | 127.79 KB | 31 May 2015 - 06:20 |
FavIconizer | 56 | 1.07 MB | 31 May 2015 - 11:12 |
Suspected bot masqurading as Mozilla | 54 | 741.83 KB | 22 May 2015 - 14:03 |
Unknown robot (identified by 'discovery') | 53 | 3.08 MB | 27 May 2015 - 18:14 |
MSIECrawler | 50 | 718.52 KB | 13 May 2015 - 20:23 |
Sogou Spider | 15+16 | 277.35 KB | 27 May 2015 - 14:56 |
Web Core / Roots | 21 | 237.98 KB | 24 May 2015 - 11:28 |
nextgensearchbot | 19+1 | 856.06 KB | 18 May 2015 - 02:49 |
Nutch | 8+12 | 160.99 KB | 21 May 2015 - 03:16 |
Exabot | 8+10 | 152.65 KB | 31 May 2015 - 08:20 |
CFNetwork | 17 | 115.35 KB | 28 May 2015 - 16:12 |
archive.org bot | 4+9 | 158.10 KB | 31 May 2015 - 15:20 |
Common *nix tool for automating web document retireval. Most likely a bot. | 8 | 0 | 11 May 2015 - 09:10 |
Fish search | 8 | 141.46 KB | 12 May 2015 - 20:52 |
Java (Often spam bot) | 7 | 578.92 KB | 20 May 2015 - 16:19 |
NG 1.x (Exalead) | 4 | 89.81 KB | 01 May 2015 - 21:45 |
SurveyBot | 2+2 | 38.52 KB | 18 May 2015 - 12:36 |
MSNBot-media | 4 | 48.45 KB | 22 May 2015 - 05:24 |
Python-urllib | 2+2 | 16.94 KB | 28 May 2015 - 01:27 |
proximic | 1+2 | 68.28 KB | 31 May 2015 - 11:16 |
WGet tools | 3 | 391.67 KB | 29 May 2015 - 20:41 |
Suspected bot masqurading as Mozilla | 3 | 174.59 KB | 31 May 2015 - 18:14 |
Powermarks | 2 | 182.07 KB | 25 May 2015 - 13:06 |
Tarantula | 1 | 91.13 KB | 25 May 2015 - 13:03 |
|