From 8619c59a65647456271635cb2d37c91514613856 Mon Sep 17 00:00:00 2001 From: "Christian P. MOMON" Date: Mon, 3 Jul 2023 14:38:36 +0200 Subject: [PATCH] Improved user agent bot list. --- .../statoolinfos/metrics/http/userAgentBotDetectorData.txt | 5 +++++ 1 file changed, 5 insertions(+) diff --git a/src/fr/devinsy/statoolinfos/metrics/http/userAgentBotDetectorData.txt b/src/fr/devinsy/statoolinfos/metrics/http/userAgentBotDetectorData.txt index 2f81af1..51e7fe4 100644 --- a/src/fr/devinsy/statoolinfos/metrics/http/userAgentBotDetectorData.txt +++ b/src/fr/devinsy/statoolinfos/metrics/http/userAgentBotDetectorData.txt @@ -3,8 +3,11 @@ AhrefsBot ^ALittle Client ^Apache-HttpClient/ Barkrowler/ +Baiduspider bot BingPreview +Bytespider +CensysInspect ^Conversations/ crawler ^curl/ @@ -21,6 +24,7 @@ crawler ^Go-http-client ^got ^GoModuleMirror/ +InternetMeasurement ^hackney/ HeadlessChrome/ ^Hello @@ -54,6 +58,7 @@ Nutch- ^python/ ^Python/ ^Python-urllib +Qwantify ^Report Runner ^RSS Discovery Engine SemrushBot