Commit Graph

23 Commits (9d181d56540ad849913d6cf34ff6f3c0d07612fe)

Author SHA1 Message Date
Bob Mottram a4602fa8d7 Version 1.5.0 2024-01-21 19:01:20 +00:00
Bob Mottram 4c04d0f0ea Block some ai crawlers 2024-01-12 12:42:33 +00:00
Bob Mottram 62b893dd8d Block some ai crawlers 2024-01-12 12:03:44 +00:00
Bob Mottram ac3b417b62 Content warnings for military-industrial usa 2023-12-12 18:30:31 +00:00
Bob Mottram 58f110e65d Extra bot 2023-08-07 10:08:14 +01:00
Bob Mottram 3119e0a33f pixelfedbot is I assume a legit aspect of pixelfed instances 2023-08-04 17:16:04 +01:00
Bob Mottram e227c58ef4 Optionally block military user agents 2023-07-18 15:55:26 +01:00
Bob Mottram 09fad61a53 Reject no user agent 2023-03-23 20:45:12 +00:00
Bob Mottram b91a876b75 v1.4.0 2023-01-21 23:03:30 +00:00
Bob Mottram cd442d1415 Block scanner 2022-11-06 09:56:42 +00:00
Bob Mottram 65d9b0680a Function for line ending characters 2022-06-21 12:58:50 +01:00
Bob Mottram 4308f7501a Explicitly set file encoding 2022-06-09 15:46:30 +01:00
Bob Mottram c395688c18 Improve user agent blocking 2022-03-31 17:14:19 +01:00
Bob Mottram c9cd6ea9ab Improve blocking of user agent domains 2022-03-31 16:18:42 +01:00
Bob Mottram 92b9942183 Improve blocking of user agent domains 2022-03-31 16:12:30 +01:00
Bob Mottram 118571ae3f Extra check for search bots 2022-03-08 20:03:41 +00:00
Bob Mottram 8070d2a276 More robot strings 2022-03-08 12:40:15 +00:00
Bob Mottram 89a9ece062 Change filename for consistency 2022-03-06 14:21:49 +00:00
Bob Mottram 5b218919b3 Change variable name to avoid confusion 2022-03-06 14:20:25 +00:00
Bob Mottram 5f1f973d85 Use a different filename to distinguish from api/nodeinfo access 2022-03-06 14:11:11 +00:00
Bob Mottram 9be61c2b38 Save a list of known web crawlers 2022-03-06 14:02:26 +00:00
Bob Mottram 885a2b82c9 Comment 2022-03-06 13:26:06 +00:00
Bob Mottram f4fc143b3a Add crawlers module 2022-03-06 12:56:26 +00:00