Robots |
1 | 321 | 29.78 | MJ12bot/v1.4.8 |
2 | 215 | 19.94 | compatible Mozilla/5.0 |
3 | 126 | 11.69 | SemrushBot/7~bl |
4 | 99 | 9.18 | Googlebot/2.1 |
5 | 96 | 8.91 | AhrefsBot/7.0 |
6 | 53 | 4.92 | YandexBot/3.0 |
7 | 41 | 3.80 | bingbot/2.0 |
8 | 34 | 3.15 | DotBot/1.2 |
9 | 22 | 2.04 | BLEXBot/1.0 |
10 | 12 | 1.11 | Adsbot/3.1 |
11 | 10 | 0.93 | linkdexbot/2.0 |
12 | 10 | 0.93 | CCBot/2.0 (https://commoncrawl.org/faq/) |
13 | 8 | 0.74 | Linux x86_64 |
14 | 5 | 0.46 | Barkrowler/0.9 |
15 | 4 | 0.37 | MauiBot (crawler.feedback+wc@gmail.com) |
16 | 4 | 0.37 | facebookexternalhit/1.1 (+http://www.fac... |
17 | 4 | 0.37 | Riddler (http://riddler.io/about) |
18 | 4 | 0.37 | Firefox/1.0 |
19 | 2 | 0.19 | DomainStatsBot/1.0 (https://domainstats.... |
20 | 2 | 0.19 | SemrushBot-BA |
21 | 2 | 0.19 | Python-urllib/3.7 |
22 | 2 | 0.19 | Go-http-client/1.1 |
23 | 2 | 0.19 | ltx71 - (http://ltx71.com/) |