Improved bot detection.

This commit is contained in:
Christian P. MOMON 2022-02-15 01:31:42 +01:00
parent 224470e609
commit e64872aa9a

View file

@ -1,4 +1,6 @@
AhrefsBot
^Apache-HttpClient/ ^Apache-HttpClient/
Barkrowler/
bot bot
BingPreview BingPreview
crawler crawler
@ -17,6 +19,7 @@ internal dummy connection
^Java/ ^Java/
^JGit/ ^JGit/
Let's Encrypt validation server; Let's Encrypt validation server;
ltx71
^MastoPeek ^MastoPeek
^mattermost- ^mattermost-
^Misskey/ ^Misskey/
@ -24,6 +27,7 @@ internal dummy connection
monitoring monitoring
^newspaper/ ^newspaper/
^node-fetch/ ^node-fetch/
Nutch-
^okhttp/ ^okhttp/
^PeerTube/ ^PeerTube/
^PHP/ ^PHP/
@ -31,6 +35,9 @@ monitoring
^python-requests/ ^python-requests/
^python/ ^python/
^Python/ ^Python/
^Python-urllib/
SemrushBot
^Synapse/ ^Synapse/
^Tusky/ ^Tusky/
YisouSpider YisouSpider
zgrab/