Improved bot detection.
This commit is contained in:
parent
224470e609
commit
e64872aa9a
1 changed files with 7 additions and 0 deletions
|
@ -1,4 +1,6 @@
|
||||||
|
AhrefsBot
|
||||||
^Apache-HttpClient/
|
^Apache-HttpClient/
|
||||||
|
Barkrowler/
|
||||||
bot
|
bot
|
||||||
BingPreview
|
BingPreview
|
||||||
crawler
|
crawler
|
||||||
|
@ -17,6 +19,7 @@ internal dummy connection
|
||||||
^Java/
|
^Java/
|
||||||
^JGit/
|
^JGit/
|
||||||
Let's Encrypt validation server;
|
Let's Encrypt validation server;
|
||||||
|
ltx71
|
||||||
^MastoPeek
|
^MastoPeek
|
||||||
^mattermost-
|
^mattermost-
|
||||||
^Misskey/
|
^Misskey/
|
||||||
|
@ -24,6 +27,7 @@ internal dummy connection
|
||||||
monitoring
|
monitoring
|
||||||
^newspaper/
|
^newspaper/
|
||||||
^node-fetch/
|
^node-fetch/
|
||||||
|
Nutch-
|
||||||
^okhttp/
|
^okhttp/
|
||||||
^PeerTube/
|
^PeerTube/
|
||||||
^PHP/
|
^PHP/
|
||||||
|
@ -31,6 +35,9 @@ monitoring
|
||||||
^python-requests/
|
^python-requests/
|
||||||
^python/
|
^python/
|
||||||
^Python/
|
^Python/
|
||||||
|
^Python-urllib/
|
||||||
|
SemrushBot
|
||||||
^Synapse/
|
^Synapse/
|
||||||
^Tusky/
|
^Tusky/
|
||||||
YisouSpider
|
YisouSpider
|
||||||
|
zgrab/
|
||||||
|
|
Loading…
Reference in a new issue