Bob Mottram
|
2f0b527881
|
Another LLM crawler (sigh)
|
2024-08-21 13:33:06 +01:00 |
Bob Mottram
|
3852e8dbe7
|
More LLM user agents
|
2024-08-19 19:32:38 +01:00 |
Bob Mottram
|
caade2aa2b
|
More LLM user agents
|
2024-08-19 19:23:54 +01:00 |
Bob Mottram
|
9d3bad77e1
|
Poison some other LLM scrapers
|
2024-08-17 21:15:08 +01:00 |
Bob Mottram
|
7015f41bd7
|
Extra default blocks
|
2024-06-24 17:01:16 +01:00 |
Bob Mottram
|
f20eaefa94
|
Function for accounts data directory
|
2024-05-12 13:35:26 +01:00 |
Bob Mottram
|
327c218986
|
Return type
|
2024-05-07 12:45:43 +01:00 |
Bob Mottram
|
75aece258f
|
Return types
|
2024-05-07 12:43:31 +01:00 |
Bob Mottram
|
a215fe2e6a
|
Less indentation
|
2024-05-07 10:20:10 +01:00 |
Bob Mottram
|
6a9aea9a3c
|
duplicate
|
2024-05-06 23:24:48 +01:00 |
Bob Mottram
|
18508fab89
|
More crawlers
|
2024-05-06 23:16:56 +01:00 |
Bob Mottram
|
2ea94354da
|
More crawlers
|
2024-05-06 22:39:59 +01:00 |
Bob Mottram
|
9057c542f1
|
More crawlers
|
2024-05-06 22:32:11 +01:00 |
Bob Mottram
|
c60fb9b467
|
Check for unused function arguments
|
2024-04-08 15:00:47 +01:00 |
Bob Mottram
|
86d17c5f17
|
Too many arguments
|
2024-02-11 13:52:25 +00:00 |
Bob Mottram
|
a5a6521c7d
|
Improve support for federated blocks
|
2024-02-11 13:42:15 +00:00 |
Bob Mottram
|
2ba05bc7ae
|
Use federated block domains
|
2024-02-09 21:25:40 +00:00 |
Bob Mottram
|
a4602fa8d7
|
Version 1.5.0
|
2024-01-21 19:01:20 +00:00 |
Bob Mottram
|
4c04d0f0ea
|
Block some ai crawlers
|
2024-01-12 12:42:33 +00:00 |
Bob Mottram
|
62b893dd8d
|
Block some ai crawlers
|
2024-01-12 12:03:44 +00:00 |
Bob Mottram
|
ac3b417b62
|
Content warnings for military-industrial usa
|
2023-12-12 18:30:31 +00:00 |
Bob Mottram
|
58f110e65d
|
Extra bot
|
2023-08-07 10:08:14 +01:00 |
Bob Mottram
|
3119e0a33f
|
pixelfedbot is I assume a legit aspect of pixelfed instances
|
2023-08-04 17:16:04 +01:00 |
Bob Mottram
|
e227c58ef4
|
Optionally block military user agents
|
2023-07-18 15:55:26 +01:00 |
Bob Mottram
|
09fad61a53
|
Reject no user agent
|
2023-03-23 20:45:12 +00:00 |
Bob Mottram
|
b91a876b75
|
v1.4.0
|
2023-01-21 23:03:30 +00:00 |
Bob Mottram
|
cd442d1415
|
Block scanner
|
2022-11-06 09:56:42 +00:00 |
Bob Mottram
|
65d9b0680a
|
Function for line ending characters
|
2022-06-21 12:58:50 +01:00 |
Bob Mottram
|
4308f7501a
|
Explicitly set file encoding
|
2022-06-09 15:46:30 +01:00 |
Bob Mottram
|
c395688c18
|
Improve user agent blocking
|
2022-03-31 17:14:19 +01:00 |
Bob Mottram
|
c9cd6ea9ab
|
Improve blocking of user agent domains
|
2022-03-31 16:18:42 +01:00 |
Bob Mottram
|
92b9942183
|
Improve blocking of user agent domains
|
2022-03-31 16:12:30 +01:00 |
Bob Mottram
|
118571ae3f
|
Extra check for search bots
|
2022-03-08 20:03:41 +00:00 |
Bob Mottram
|
8070d2a276
|
More robot strings
|
2022-03-08 12:40:15 +00:00 |
Bob Mottram
|
89a9ece062
|
Change filename for consistency
|
2022-03-06 14:21:49 +00:00 |
Bob Mottram
|
5b218919b3
|
Change variable name to avoid confusion
|
2022-03-06 14:20:25 +00:00 |
Bob Mottram
|
5f1f973d85
|
Use a different filename to distinguish from api/nodeinfo access
|
2022-03-06 14:11:11 +00:00 |
Bob Mottram
|
9be61c2b38
|
Save a list of known web crawlers
|
2022-03-06 14:02:26 +00:00 |
Bob Mottram
|
885a2b82c9
|
Comment
|
2022-03-06 13:26:06 +00:00 |
Bob Mottram
|
f4fc143b3a
|
Add crawlers module
|
2022-03-06 12:56:26 +00:00 |