Extended user agent bot detector list.
This commit is contained in:
parent
8fdafcdf1d
commit
1539872bf2
1 changed files with 32 additions and 6 deletions
|
@ -1,45 +1,71 @@
|
|||
AhrefsBot
|
||||
^ALittle Client
|
||||
^Apache-HttpClient/
|
||||
Barkrowler/
|
||||
bot
|
||||
BingPreview
|
||||
^Conversations/
|
||||
crawler
|
||||
^curl/
|
||||
^Discourse Forum
|
||||
^DuckDuckGo
|
||||
^Expanse
|
||||
^facebookexternalhit
|
||||
^fasthttp
|
||||
^FediList
|
||||
^Friendica
|
||||
^Gajim
|
||||
^git/
|
||||
^github-camo
|
||||
^Go-http-client
|
||||
^got
|
||||
^GoModuleMirror/
|
||||
^hackney/
|
||||
HeadlessChrome/
|
||||
^http.rb/
|
||||
^FediList
|
||||
^Go-http-client
|
||||
^GoModuleMirror/
|
||||
^Hello
|
||||
^HotJava/
|
||||
^http.rb/
|
||||
internal dummy connection
|
||||
^Java/
|
||||
^JGit/
|
||||
^libcurl-agent
|
||||
^libwww-perl
|
||||
Let's Encrypt validation server;
|
||||
ltx71
|
||||
ltx71
|
||||
^masscan
|
||||
^MastoPeek
|
||||
^mattermost-
|
||||
^Misskey/
|
||||
- Mobilizon
|
||||
monitoring
|
||||
^nbxmpp/
|
||||
^newspaper/
|
||||
^node-fetch/
|
||||
Nutch-
|
||||
^okhttp/
|
||||
^PeerTube/
|
||||
^PHP/
|
||||
^PHPCrawl
|
||||
^Pleroma
|
||||
^PrivateBinDirectoryBot
|
||||
^python-httpx
|
||||
^python-requests/
|
||||
^python/
|
||||
^Python/
|
||||
^Python-urllib/
|
||||
^Python-urllib
|
||||
^Report Runner
|
||||
^RSS Discovery Engine
|
||||
SemrushBot
|
||||
^Snikket/
|
||||
StatoolInfos
|
||||
^Synapse/
|
||||
^test
|
||||
TinyStatus
|
||||
^Tusky/
|
||||
^Uptime-Kuma
|
||||
^W3C_Validator
|
||||
^Wget/
|
||||
^WhatsApp/
|
||||
^wp_is_mobile
|
||||
YisouSpider
|
||||
zgrab/
|
||||
|
|
Loading…
Reference in a new issue