Commit graph

404 commits

Author SHA1 Message Date
d7fc746719 Added criteria about user agent bot detection. 2021-06-06 03:35:19 +02:00
1d5179a5c3 Added column in stat ua command. 2021-06-06 03:32:26 +02:00
8e38a03eb0 Added duration column in stat visitors. 2021-06-06 01:00:59 +02:00
c8e4dcad0c Added BingPreview and YisouSpider as bot criteria detection in user
agent.
2021-06-06 01:00:30 +02:00
6eaff00f81 Added Curl, Mattermost, PHP, okhttp, Synapse and newspaper as bot
criteria detection in user agent.
2021-06-06 00:12:40 +02:00
19292bddf2 Added HeadlessChrome as bot criteria detection. 2021-06-05 17:56:36 +02:00
be4635d8cb Added list and stat commands. 2021-06-05 17:56:07 +02:00
68f9b6fa93 Improved bot detection code. 2021-06-05 00:36:46 +02:00
b4b53d839a Added Fabrice61 as contributor. 2021-06-04 23:33:20 +02:00
d901bfe101 Extended bot detection. 2021-06-04 17:38:59 +02:00
cccd606ac7 Fixed n/a sort and date sort. 2021-06-04 16:51:57 +02:00
b1434d284b Changed order of type menu in metrics pages. 2021-06-03 16:30:09 +02:00
6cfc5a9184 Added visit count and user count in federation page. 2021-06-03 04:50:51 +02:00
6ea3e87cec Added federation metrics generate. 2021-06-03 04:25:16 +02:00
29a2d97468 Added federatio header view to federation stats page. 2021-06-03 03:08:22 +02:00
82c7d3f3ed Splitted federation header view. 2021-06-03 03:05:12 +02:00
920709bd66 Fixed icon image member help in service list view. 2021-06-02 23:49:56 +02:00
66c7a9132e Refactored organization metric generate. 2021-06-02 18:36:02 +02:00
2de94e2a44 Refactored service metrics generate. 2021-06-02 16:10:09 +02:00
73fae00b63 Improved Y axes readness in Bar Chart. 2021-05-30 04:59:51 +02:00
ab85c5f1fd Refactored service metrics page class names. 2021-05-30 03:05:16 +02:00
8027becdfe Added icons for link survey feature. 2021-05-30 02:51:55 +02:00
26a7f25e1d Added subs list button in federation/organization/service. 2021-05-30 02:51:34 +02:00
03df54abb5 Fixed service count display service list view. 2021-05-30 02:25:13 +02:00
c9f0b7ed81 Added animated option on Bar Charts. 2021-05-29 11:18:51 +02:00
f179c75281 Refactored stats and metrics for organization and service. 2021-05-29 02:23:15 +02:00
8f03507fb0 Fixed column width and logo URL in social netwtwork page. 2021-05-27 17:50:54 +02:00
b4b01f5610 Refactored stats menu in organization and service. 2021-05-27 05:08:19 +02:00
ddf4132386 Added organization stats with metrics. 2021-05-27 04:02:34 +02:00
0e3dbd7e05 Added service stats page. 2021-05-26 02:06:15 +02:00
08a88600ef Fixed registration type stats. 2021-05-26 02:05:45 +02:00
453d1c51bc Clean code. 2021-05-26 00:58:55 +02:00
8b6e6a1d54 Improved order metric display. 2021-05-26 00:42:45 +02:00
8ab33c0277 Improved visit probing with status code 200 restriction. 2021-05-26 00:36:27 +02:00
65c359cfb8 Renamed metric menu item from Categorie to Type. 2021-05-26 00:27:14 +02:00
b9f3d6b600 Added crawler as user agent token identifier for bot. 2021-05-26 00:22:06 +02:00
18bed6289d Fixed http log file census for probing. 2021-05-25 21:41:21 +02:00
345ec7aba5 Improve probing setting management. 2021-05-25 18:16:50 +02:00
847a430f22 Added user agent '-' as bot in log analyze. 2021-05-25 17:21:02 +02:00
060f9d8c6e Clean code. 2021-05-25 16:30:52 +02:00
18b2c3eecc Cleaned Javadoc. 2021-05-25 16:30:44 +02:00
ae36d922f4 Fixed label. 2021-05-25 16:22:16 +02:00
6b4611f3b2 Improved out message in probing and htmlize. 2021-05-25 15:06:15 +02:00
078a6909a5 Improved bot log detection. 2021-05-25 15:04:44 +02:00
330e81c02b Refactored service page and views. Added metric menu. 2021-05-24 17:46:07 +02:00
ded6ccf056 Improved probing. 2021-05-23 02:59:08 +02:00
0bd23e09ab Improved metric bar chart computation. 2021-05-23 02:58:57 +02:00
fb4ff4483f Added some more metric to probe. 2021-05-23 02:02:31 +02:00
5ece10ea2a Fixed human date display (YYYY vs yyyy). 2021-05-23 02:02:15 +02:00
0c51e9d257 Refactored chart htmlizing. 2021-05-22 20:20:59 +02:00
e8b479f386 Step in metrics charts feature. 2021-05-22 01:38:55 +02:00
152af0d74a Improved page metric computation in probing. 2021-05-22 01:11:04 +02:00
a2cbf2d762 Fixed ip, ipv4 and ipv6 final count in probing. 2021-05-21 03:51:32 +02:00
0793a616f6 Added metrics property file management. 2021-05-20 16:03:29 +02:00
d8e2aa2cec Improved stats display. 2021-05-20 00:14:16 +02:00
d8cbad2845 Added header lines in targer metrics file. 2021-05-19 22:47:26 +02:00
e262bf2b7b Added inputURL in local crawl journal. 2021-05-19 15:22:37 +02:00
68906ed88a Added crawl page for organizations and services. 2021-05-18 19:40:29 +02:00
bf81404746 Refactored crawl code. Add crawl journal page. 2021-05-18 04:35:25 +02:00
47d4a62ac7 Updated crawled file compute in case of 1970 date. 2021-05-16 11:54:18 +02:00
9a23ad5551 Improved date format display. 2021-05-15 23:58:09 +02:00
5e208beb9a Set default logger level to INFO. 2021-05-15 17:08:10 +02:00
cc141d81aa Added tagdate and format commands. 2021-05-15 16:59:04 +02:00
24fbcd46a8 Set default logger level to ERROR. 2021-05-14 18:11:42 +02:00
395b9c6034 Improved CLI code. 2021-05-14 17:20:52 +02:00
a9cf905788 Refactored check and check alerts. Add check alerts for federation. 2021-05-14 02:40:15 +02:00
54203f50a0 Set insensitive case for rule check. 2021-05-13 14:56:46 +02:00
c672fed930 Fixed bad metrics prefix. 2021-05-04 12:31:00 +02:00
24620cca99 Improved Javadoc. 2021-04-22 17:55:01 +02:00
0d1f570b3a Improved wording. 2021-04-15 13:22:10 +02:00
77c77dada4 Changed service.startdate to mandatory. 2021-04-15 05:24:16 +02:00
10e5aef037 Added service.registration.load feature. 2021-04-15 04:39:38 +02:00
e14e6da6aa Added service.registration.load check. 2021-04-15 03:56:56 +02:00
cfc1b78c99 Improved code. 2021-04-15 03:55:18 +02:00
a18fab99dc Improved probe code. Managed the 53th week case. 2021-03-11 13:25:38 +01:00
eb7adda168 Fixed lower case value for country code in property checker. 2021-03-05 02:44:22 +01:00
56ac707b17 Added lower case value for country code in property checker. 2021-03-05 02:30:06 +01:00
41061a791a Fixed graphic labels. 2021-03-05 02:04:45 +01:00
85ea317bfe Improved age display in service page. 2021-03-01 04:42:59 +01:00
a957413bc2 Made a Javadoc review. 2021-03-01 03:42:48 +01:00
abf0aebedf Fixed bad extension computing wigh SVG file without xml header line. 2021-03-01 02:02:33 +01:00
6b227a9d12 Added space management in service.registration check. 2021-03-01 01:13:38 +01:00
37a04848ef Improved graphics. 2021-02-28 03:31:57 +01:00
5e1f2d68d4 Improved access log pattern. 2021-02-24 14:56:32 +01:00
c2fd782860 Improved escape JSON in charts. 2021-02-21 03:08:52 +01:00
62390fd4a0 Added host chart. 2021-02-21 00:51:58 +01:00
0bc73f661e Added category distribution charts. Improved software charts. 2021-02-20 21:34:04 +01:00
34b574b023 Changed first date of service counter charts. 2021-02-20 11:47:37 +01:00
9caf349639 Improved service count federation chart and added organization ones. 2021-02-20 04:32:56 +01:00
e8be6ba8d1 Added service count chart and service date status chart. 2021-02-20 03:57:21 +01:00
5e4829d315 Improved code. 2021-02-20 02:01:24 +01:00
4ee90a3671 Added http error log analyze. 2021-02-20 02:00:00 +01:00
45d797ea06 Refactored metrics package. Added tests. 2021-02-19 02:16:56 +01:00
029a9f563d Added code for http log analyze. 2021-02-18 05:33:27 +01:00
ca61c62c0f Fixed head date displaying in organization and service page. 2021-02-11 23:35:38 +01:00
a638a5abd5 Improved service date displaying. 2021-02-11 03:20:40 +01:00
51b656d434 Improved display of date in organization header page. 2021-02-11 03:00:58 +01:00
22addc634f Step in probe devs. 2021-02-11 02:36:03 +01:00
e4d122bbe4 Added counter check button in service page. Improved organization one. 2021-02-05 03:43:01 +01:00
39ffde8632 Improved date displaying. 2021-02-05 03:42:27 +01:00
eab4316102 Add nav tags in menu code. 2021-02-05 03:42:10 +01:00
cb2e06ebf0 Fixed label. 2021-01-28 19:54:53 +01:00
2ce73a5d27 Added TOOLING in service install type graphics. 2021-01-28 19:42:59 +01:00
a075d038f4 Added TOOLING value in service.install.type. 2021-01-28 02:44:01 +01:00
dd6f941456 Improved JSON export with organization.name and software.categories in
services properties.
2021-01-27 18:08:41 +01:00
1e0b2e3ac3 Add alert check page for organization. 2021-01-25 04:51:07 +01:00
560fe0f861 Added alert check counts in organization page. 2021-01-25 04:32:32 +01:00
5822c9260a Improved date display in organization page. 2021-01-25 02:02:04 +01:00
5c30a45346 Cleaned code. 2021-01-24 04:38:30 +01:00
fdb805e80b Fixed Javadoc. 2021-01-24 04:21:08 +01:00
551b5b83d0 Added ODS export. Refactored CSV export. 2021-01-24 04:18:30 +01:00
9e53a184e6 Added CSV export. 2021-01-23 20:06:42 +01:00
adc7146644 Added self made file icons. 2021-01-23 17:32:38 +01:00
6e3b73938e Added multi-datasets bar chart. Added organization in/out chart. 2021-01-23 04:41:23 +01:00
6a02eec24b Refactored bar chart. 2021-01-23 04:09:41 +01:00
235c8faace Fixed button label typing error. 2021-01-21 19:11:49 +01:00
17a95249cb Managed more exception in crawling. 2021-01-21 19:08:50 +01:00
464284d479 Fixed upper case for organization country. 2021-01-21 06:25:05 +01:00
ce6cf6620f Added JSON export management. 2021-01-21 06:01:24 +01:00
802e0c568f Added csv/json/ods logos and license in README file. 2021-01-21 06:01:04 +01:00
0eb6af852b Updated *.country.* check settings. 2021-01-21 04:52:04 +01:00
a083687777 Fixed description width in service page. 2021-01-21 03:04:56 +01:00
4b9de167e0 Improved color management for country chart. Back to rgb colors. 2021-01-17 05:49:28 +01:00
979ebac18d Fixed color management in country chart. 2021-01-16 11:12:11 +01:00
ee67a18f0d Fixed country code management. 2021-01-16 04:43:40 +01:00
28fe19914c Improved PathPropertyList methods. 2021-01-16 03:25:00 +01:00
abb9822cb1 Added organization.funding.* check. 2021-01-15 19:19:28 +01:00
3c095c47fe Added member count chart in federation stats. 2021-01-15 18:00:29 +01:00
bb7472efab Fixed bug in list building. 2021-01-15 17:59:22 +01:00
54b6275b9d Added country chart about organizations and services. 2021-01-15 05:49:47 +01:00
b479308383 Replaced CYAN with TURQUOISE. 2021-01-15 05:19:30 +01:00
dd593ceb14 Added ISO 3166-1 for country code checks. 2021-01-15 05:18:55 +01:00
fe471608fe Added alert check pages. 2021-01-15 04:58:55 +01:00
3a8103bcfa Replaced color codes with hexa values. 2021-01-15 03:34:02 +01:00
b2be90a946 Improved name in properties file page. 2021-01-14 00:51:08 +01:00
a4b4516f61 Added service install type stats. 2021-01-13 02:33:51 +01:00
040f855647 Fixed sub file class same than parent case in crawling. 2021-01-13 02:20:28 +01:00
51a46a5ed4 Improved empty crawled file case. 2021-01-12 00:24:26 +01:00
80fce490ce Added service.install.type property check. 2021-01-11 19:28:58 +01:00
726f4fccfa Fixed empty file crawled. 2021-01-11 19:24:43 +01:00
36f6d67d8a Fixed federation property check. 2021-01-10 00:04:35 +01:00
b4ef57bd7d Extended datetime property checking. 2021-01-09 05:53:26 +01:00
5afdd07c2b Improved bad organization file management. 2021-01-08 04:19:21 +01:00
d525cfcb8d Fixed naming. 2021-01-08 03:18:18 +01:00
843b8b1d46 Managed empty data case in check page. 2021-01-08 03:15:11 +01:00
f5ffce2fbf Fixed and improved social networks table. 2021-01-08 01:16:17 +01:00
25540fa329 Fixed XHTML code in menu. 2021-01-08 01:15:53 +01:00
6a42ea5383 Fix. 2021-01-07 18:35:38 +01:00
035304bce9 Added alert filter in check page. 2021-01-07 18:26:19 +01:00
88d54c0279 Added alert filter in check page. 2021-01-07 17:49:57 +01:00