From 1539872bf2ebc9026b5c67589748db06b90ac81d Mon Sep 17 00:00:00 2001 From: "Christian P. MOMON" Date: Sun, 26 Feb 2023 11:00:58 +0100 Subject: [PATCH] Extended user agent bot detector list. --- .../metrics/http/userAgentBotDetectorData.txt | 38 ++++++++++++++++--- 1 file changed, 32 insertions(+), 6 deletions(-) diff --git a/src/fr/devinsy/statoolinfos/metrics/http/userAgentBotDetectorData.txt b/src/fr/devinsy/statoolinfos/metrics/http/userAgentBotDetectorData.txt index 398bef0..ac6809e 100644 --- a/src/fr/devinsy/statoolinfos/metrics/http/userAgentBotDetectorData.txt +++ b/src/fr/devinsy/statoolinfos/metrics/http/userAgentBotDetectorData.txt @@ -1,45 +1,71 @@ AhrefsBot +^ALittle Client ^Apache-HttpClient/ Barkrowler/ bot BingPreview +^Conversations/ crawler ^curl/ +^Discourse Forum +^DuckDuckGo +^Expanse +^facebookexternalhit +^fasthttp +^FediList ^Friendica +^Gajim ^git/ ^github-camo +^Go-http-client +^got +^GoModuleMirror/ ^hackney/ HeadlessChrome/ -^http.rb/ -^FediList -^Go-http-client -^GoModuleMirror/ +^Hello ^HotJava/ +^http.rb/ internal dummy connection ^Java/ ^JGit/ +^libcurl-agent +^libwww-perl Let's Encrypt validation server; -ltx71 +ltx71 +^masscan ^MastoPeek ^mattermost- ^Misskey/ - Mobilizon monitoring +^nbxmpp/ ^newspaper/ ^node-fetch/ Nutch- ^okhttp/ ^PeerTube/ ^PHP/ +^PHPCrawl ^Pleroma +^PrivateBinDirectoryBot +^python-httpx ^python-requests/ ^python/ ^Python/ -^Python-urllib/ +^Python-urllib +^Report Runner +^RSS Discovery Engine SemrushBot +^Snikket/ + StatoolInfos ^Synapse/ +^test TinyStatus ^Tusky/ ^Uptime-Kuma +^W3C_Validator +^Wget/ +^WhatsApp/ +^wp_is_mobile YisouSpider zgrab/