| User Agent | Number of hits | Data Transferred (Kb) |
| facebookexternalhit/1.1 ( http://www.facebook.com/externalhit_uatext.php) | 467 | 14,002 |
| WikiDo/1.1 (http://wikido.com; crawler@wikido.com) | 329 | 1,703 |
| wp_is_mobile | 241 | 94 |
| panscient.com | 235 | 1,404 |
| python-requests/2.26.0 | 195 | 228 |
| YelpBot (https://www.yelp.com/) | 192 | 932 |
| imgproxy/2.16.7 | 136 | 3,324 |
| DF Bot 1.0 | 81 | 417 |
| Python/3.9 aiohttp/3.8.1 | 80 | 276 |
| ltx71 - (http://ltx71.com/) | 75 | 221 |
| CCBot/2.0 (https://commoncrawl.org/faq/) | 75 | 285 |
| HubSpot Connect 2.0 (http://dev.hubspot.com/) - BizOpsCompanies-Tq2-BizCoDomainValidationAudit | 64 | 18 |
| Expanse indexes the network perimeters of our customers. If you have any questions or concerns, please reach out to: scaninfo@expanseinc.com | 40 | 558 |
| cortex/1.0 | 38 | 2,970 |
| GuzzleHttp/6.5.5 curl/7.47.0 PHP/7.4.16 | 34 | 1,297 |
| python-requests/2.27.1 | 33 | 36 |
| Expanse, a Palo Alto Networks company, searches across the global IPv4 space multiple times per day to identify customers' presences on the Internet. If you would like to be excluded from our scans, please send IP addresses/domains to: scaninfo@paloal | 29 | 296 |
| clark-crawler2/Nutch-1.19-SNAPSHOT | 27 | 100 |
| CheckMarkNetwork/1.0 ( http://www.checkmarknetwork.com/spider.html) | 26 | 151 |
| DnBCrawler-Analytics | 20 | 86 |
| Intently.co | 18 | 6 |
| The Knowledge AI | 18 | 8 |
| python-requests/2.25.1 | 17 | 756 |
| ALittle Client | 16 | 8 |
| ultimate_sitemap_parser/0.5 | 15 | 7 |
| python-requests/2.19.1 | 12 | 53 |
| python-requests/2.9.1 | 10 | 4 |
| Ruby | 10 | 48 |
| axios/0.21.1 | 10 | 189 |
| curl/7.38.0 | 8 | 232 |
| Rome Client (http://tinyurl.com/64t5n) Ver: UNKNOWN | 8 | 3 |
| python-requests/2.18.4 | 8 | 3 |
| colly - https://github.com/gocolly/colly/v2 | 8 | 38 |
| okhttp/3.6.0 | 6 | 29 |
| DuckDuckBot/1.1; ( http://duckduckgo.com/duckduckbot.html) | 6 | 43 |
| curl/7.35.0 | 6 | 174 |
| curl/7.58.0 | 6 | 116 |
| Python-urllib/3.7 | 5 | 3 |
| Go-http-client/1.1 | 5 | 34 |
| python-requests/2.22.0 | 5 | 9 |
| Others | 85 | 581 |
| Total | 2,699 | 30,742 |
