epicyon

Author	SHA1	Message	Date
Bob Mottram	58f110e65d	Extra bot	2023-08-07 10:08:14 +01:00
Bob Mottram	3119e0a33f	pixelfedbot is I assume a legit aspect of pixelfed instances	2023-08-04 17:16:04 +01:00
Bob Mottram	e227c58ef4	Optionally block military user agents	2023-07-18 15:55:26 +01:00
Bob Mottram	09fad61a53	Reject no user agent	2023-03-23 20:45:12 +00:00
Bob Mottram	b91a876b75	v1.4.0	2023-01-21 23:03:30 +00:00
Bob Mottram	cd442d1415	Block scanner	2022-11-06 09:56:42 +00:00
Bob Mottram	65d9b0680a	Function for line ending characters	2022-06-21 12:58:50 +01:00
Bob Mottram	4308f7501a	Explicitly set file encoding	2022-06-09 15:46:30 +01:00
Bob Mottram	c395688c18	Improve user agent blocking	2022-03-31 17:14:19 +01:00
Bob Mottram	c9cd6ea9ab	Improve blocking of user agent domains	2022-03-31 16:18:42 +01:00
Bob Mottram	92b9942183	Improve blocking of user agent domains	2022-03-31 16:12:30 +01:00
Bob Mottram	118571ae3f	Extra check for search bots	2022-03-08 20:03:41 +00:00
Bob Mottram	8070d2a276	More robot strings	2022-03-08 12:40:15 +00:00
Bob Mottram	89a9ece062	Change filename for consistency	2022-03-06 14:21:49 +00:00
Bob Mottram	5b218919b3	Change variable name to avoid confusion	2022-03-06 14:20:25 +00:00
Bob Mottram	5f1f973d85	Use a different filename to distinguish from api/nodeinfo access	2022-03-06 14:11:11 +00:00
Bob Mottram	9be61c2b38	Save a list of known web crawlers	2022-03-06 14:02:26 +00:00
Bob Mottram	885a2b82c9	Comment	2022-03-06 13:26:06 +00:00
Bob Mottram	f4fc143b3a	Add crawlers module	2022-03-06 12:56:26 +00:00