indymedia
/
epicyon
mirror of https://gitlab.com/bashrc2/epicyon
7
4
Fork 1
Code Issues 14 Releases Wiki Activity
15,460 Commits
3 Branches
2 Tags
467 MiB
Commit Graph

43 Commits (4ad92bb6d8c4a9f63f1cd0a3a8b601ca417c6f19)

Author SHA1 Message Date
Bob Mottram 550e81d32d Comment 2024-09-03 13:52:04 +01:00
Bob Mottram 60c15d2358 Extra LLM crawlers 2024-09-01 21:05:34 +01:00
Bob Mottram 0ec43c6323 Extra LLM crawler 2024-09-01 20:42:19 +01:00
Bob Mottram 2f0b527881 Another LLM crawler (sigh) 2024-08-21 13:33:06 +01:00
Bob Mottram 3852e8dbe7 More LLM user agents 2024-08-19 19:32:38 +01:00
Bob Mottram caade2aa2b More LLM user agents 2024-08-19 19:23:54 +01:00
Bob Mottram 9d3bad77e1 Poison some other LLM scrapers 2024-08-17 21:15:08 +01:00
Bob Mottram 7015f41bd7 Extra default blocks 2024-06-24 17:01:16 +01:00
Bob Mottram f20eaefa94 Function for accounts data directory 2024-05-12 13:35:26 +01:00
Bob Mottram 327c218986 Return type 2024-05-07 12:45:43 +01:00
Bob Mottram 75aece258f Return types 2024-05-07 12:43:31 +01:00
Bob Mottram a215fe2e6a Less indentation 2024-05-07 10:20:10 +01:00
Bob Mottram 6a9aea9a3c duplicate 2024-05-06 23:24:48 +01:00
Bob Mottram 18508fab89 More crawlers 2024-05-06 23:16:56 +01:00
Bob Mottram 2ea94354da More crawlers 2024-05-06 22:39:59 +01:00
Bob Mottram 9057c542f1 More crawlers 2024-05-06 22:32:11 +01:00
Bob Mottram c60fb9b467 Check for unused function arguments 2024-04-08 15:00:47 +01:00
Bob Mottram 86d17c5f17 Too many arguments 2024-02-11 13:52:25 +00:00
Bob Mottram a5a6521c7d Improve support for federated blocks 2024-02-11 13:42:15 +00:00
Bob Mottram 2ba05bc7ae Use federated block domains 2024-02-09 21:25:40 +00:00
Bob Mottram a4602fa8d7 Version 1.5.0 2024-01-21 19:01:20 +00:00
Bob Mottram 4c04d0f0ea Block some ai crawlers 2024-01-12 12:42:33 +00:00
Bob Mottram 62b893dd8d Block some ai crawlers 2024-01-12 12:03:44 +00:00
Bob Mottram ac3b417b62 Content warnings for military-industrial usa 2023-12-12 18:30:31 +00:00
Bob Mottram 58f110e65d Extra bot 2023-08-07 10:08:14 +01:00
Bob Mottram 3119e0a33f pixelfedbot is I assume a legit aspect of pixelfed instances 2023-08-04 17:16:04 +01:00
Bob Mottram e227c58ef4 Optionally block military user agents 2023-07-18 15:55:26 +01:00
Bob Mottram 09fad61a53 Reject no user agent 2023-03-23 20:45:12 +00:00
Bob Mottram b91a876b75 v1.4.0 2023-01-21 23:03:30 +00:00
Bob Mottram cd442d1415 Block scanner 2022-11-06 09:56:42 +00:00
Bob Mottram 65d9b0680a Function for line ending characters 2022-06-21 12:58:50 +01:00
Bob Mottram 4308f7501a Explicitly set file encoding 2022-06-09 15:46:30 +01:00
Bob Mottram c395688c18 Improve user agent blocking 2022-03-31 17:14:19 +01:00
Bob Mottram c9cd6ea9ab Improve blocking of user agent domains 2022-03-31 16:18:42 +01:00
Bob Mottram 92b9942183 Improve blocking of user agent domains 2022-03-31 16:12:30 +01:00
Bob Mottram 118571ae3f Extra check for search bots 2022-03-08 20:03:41 +00:00
Bob Mottram 8070d2a276 More robot strings 2022-03-08 12:40:15 +00:00
Bob Mottram 89a9ece062 Change filename for consistency 2022-03-06 14:21:49 +00:00
Bob Mottram 5b218919b3 Change variable name to avoid confusion 2022-03-06 14:20:25 +00:00
Bob Mottram 5f1f973d85 Use a different filename to distinguish from api/nodeinfo access 2022-03-06 14:11:11 +00:00
Bob Mottram 9be61c2b38 Save a list of known web crawlers 2022-03-06 14:02:26 +00:00
Bob Mottram 885a2b82c9 Comment 2022-03-06 13:26:06 +00:00
Bob Mottram f4fc143b3a Add crawlers module 2022-03-06 12:56:26 +00:00