Extended user agent bot detector list.

This commit is contained in:
Christian P. MOMON 2023-02-26 11:00:58 +01:00
parent 8fdafcdf1d
commit 1539872bf2

View file

@ -1,45 +1,71 @@
AhrefsBot
^ALittle Client
^Apache-HttpClient/
Barkrowler/
bot
BingPreview
^Conversations/
crawler
^curl/
^Discourse Forum
^DuckDuckGo
^Expanse
^facebookexternalhit
^fasthttp
^FediList
^Friendica
^Gajim
^git/
^github-camo
^Go-http-client
^got
^GoModuleMirror/
^hackney/
HeadlessChrome/
^http.rb/
^FediList
^Go-http-client
^GoModuleMirror/
^Hello
^HotJava/
^http.rb/
internal dummy connection
^Java/
^JGit/
^libcurl-agent
^libwww-perl
Let's Encrypt validation server;
ltx71
^masscan
^MastoPeek
^mattermost-
^Misskey/
- Mobilizon
monitoring
^nbxmpp/
^newspaper/
^node-fetch/
Nutch-
^okhttp/
^PeerTube/
^PHP/
^PHPCrawl
^Pleroma
^PrivateBinDirectoryBot
^python-httpx
^python-requests/
^python/
^Python/
^Python-urllib/
^Python-urllib
^Report Runner
^RSS Discovery Engine
SemrushBot
^Snikket/
StatoolInfos
^Synapse/
^test
TinyStatus
^Tusky/
^Uptime-Kuma
^W3C_Validator
^Wget/
^WhatsApp/
^wp_is_mobile
YisouSpider
zgrab/