Extended user agent bot detector list.

This commit is contained in:
Christian P. MOMON 2023-02-26 11:00:58 +01:00
parent 8fdafcdf1d
commit 1539872bf2

View file

@ -1,45 +1,71 @@
AhrefsBot AhrefsBot
^ALittle Client
^Apache-HttpClient/ ^Apache-HttpClient/
Barkrowler/ Barkrowler/
bot bot
BingPreview BingPreview
^Conversations/
crawler crawler
^curl/ ^curl/
^Discourse Forum
^DuckDuckGo
^Expanse
^facebookexternalhit
^fasthttp
^FediList
^Friendica ^Friendica
^Gajim
^git/ ^git/
^github-camo ^github-camo
^Go-http-client
^got
^GoModuleMirror/
^hackney/ ^hackney/
HeadlessChrome/ HeadlessChrome/
^http.rb/ ^Hello
^FediList
^Go-http-client
^GoModuleMirror/
^HotJava/ ^HotJava/
^http.rb/
internal dummy connection internal dummy connection
^Java/ ^Java/
^JGit/ ^JGit/
^libcurl-agent
^libwww-perl
Let's Encrypt validation server; Let's Encrypt validation server;
ltx71 ltx71
^masscan
^MastoPeek ^MastoPeek
^mattermost- ^mattermost-
^Misskey/ ^Misskey/
- Mobilizon - Mobilizon
monitoring monitoring
^nbxmpp/
^newspaper/ ^newspaper/
^node-fetch/ ^node-fetch/
Nutch- Nutch-
^okhttp/ ^okhttp/
^PeerTube/ ^PeerTube/
^PHP/ ^PHP/
^PHPCrawl
^Pleroma ^Pleroma
^PrivateBinDirectoryBot
^python-httpx
^python-requests/ ^python-requests/
^python/ ^python/
^Python/ ^Python/
^Python-urllib/ ^Python-urllib
^Report Runner
^RSS Discovery Engine
SemrushBot SemrushBot
^Snikket/
StatoolInfos
^Synapse/ ^Synapse/
^test
TinyStatus TinyStatus
^Tusky/ ^Tusky/
^Uptime-Kuma ^Uptime-Kuma
^W3C_Validator
^Wget/
^WhatsApp/
^wp_is_mobile
YisouSpider YisouSpider
zgrab/ zgrab/