indymedia
/
epicyon
mirror of https://gitlab.com/bashrc2/epicyon
7
4
Fork 1
Code Issues 14 Releases Wiki Activity
10,633 Commits
3 Branches
2 Tags
475 MiB
Commit Graph

257 Commits (9ad1fc842fbf17045a1c6b78dbbd99056ff6dbde)

Author SHA1 Message Date
Bob Mottram d161420471 RSS failures are warnings 2021-05-20 13:52:13 +01:00
Bob Mottram 928412c34c Less verbose 2021-03-14 19:53:22 +00:00
Bob Mottram 79610c8bf8 Be more generous with post recency 2021-03-05 16:48:28 +00:00
Bob Mottram 5257cfe2c8 Remove html from RSS feed titles 2021-02-13 21:48:24 +00:00
Bob Mottram 67172c3165 Invert logic 2021-02-12 12:09:48 +00:00
Bob Mottram b1c301dcb5 Support hashtags in json feeds 2021-02-12 12:09:16 +00:00
Bob Mottram 39a0c7ba9e Remove html from json feeds 2021-02-12 12:02:09 +00:00
Bob Mottram c74b208b53 Counter later 2021-02-12 11:50:05 +00:00
Bob Mottram c0c44e9d1a Result later 2021-02-12 11:47:49 +00:00
Bob Mottram 43ffcd7302 Support json feed 1.1 2021-02-12 11:46:26 +00:00
Bob Mottram 000162d85c Json feed version 2021-02-12 11:30:23 +00:00
Bob Mottram 4308317b3d Support for json feeds on newswire 2021-02-12 11:28:00 +00:00
Bob Mottram eeb095fe8a Only include non-system users blog posts 2021-02-11 12:40:56 +00:00
Bob Mottram 419353ccf9 Version 1.2.0 2021-01-26 10:07:42 +00:00
Bob Mottram 3c1314d4b4 Remove html from rss feed descriptions 2021-01-11 21:54:25 +00:00
Bob Mottram 3ff0866deb Test that number of function arguments match 2020-12-22 21:24:46 +00:00
Bob Mottram 5cd9aa8d66 Enforce convention of underscore before local function names 2020-12-22 18:06:23 +00:00
Bob Mottram 96e813181b Move hashtag categories functions to their own module 2020-12-22 10:30:52 +00:00
Bob Mottram 23301b35a5 Validate newswire item dates 
So they can't be in the future or too far in the past
 2020-12-21 12:11:45 +00:00
Bob Mottram a7d5c50222 Use global filter for newswire 2020-12-19 11:43:20 +00:00
Bob Mottram 77210c0f41 RSS 1.0 header 2020-12-14 20:22:05 +00:00
Bob Mottram f94f242d38 Rss version 2020-12-14 17:18:16 +00:00
Bob Mottram 96c139a63e Support for rss 1.0 feeds 2020-12-14 14:22:44 +00:00
Bob Mottram e87fd5a168 Break after loop 2020-12-13 22:13:45 +00:00
Bob Mottram fd07e67f3b Ensure that there isn't any html in feed text 2020-12-12 15:44:43 +00:00
Bob Mottram 562e154aa9 Too much date checking 2020-12-09 10:38:09 +00:00
Bob Mottram 09e980da24 Setting categories from defaults 2020-12-05 14:43:29 +00:00
Bob Mottram 931068d4c2 Default hashtag categories per language 2020-12-05 13:38:07 +00:00
Bob Mottram 60abb1a0a6 Check for blocked hashtag with hash prefix 2020-12-03 19:51:47 +00:00
Bob Mottram 4f740a836c Check for dubious payloads 2020-12-03 10:12:09 +00:00
Bob Mottram 1426fefe5d Apply instance level blocks to hashtag category feeds 2020-12-02 22:40:46 +00:00
Bob Mottram 1b9989bcd3 Missing parameter 2020-12-02 17:02:32 +00:00
Bob Mottram 2f513407e4 Hashtag categories as rss feeds 2020-12-02 16:18:36 +00:00
Bob Mottram 5a449ab4e9 Use published rather than updated for youtube feeds 2020-11-28 20:46:52 +00:00
Bob Mottram 6cb9d7e399 More debug 2020-11-27 22:43:34 +00:00
Bob Mottram a998c0b321 Check that offset exists 2020-11-22 20:37:08 +00:00
Bob Mottram 758380dade Calculate offset 2020-11-22 20:33:24 +00:00
Bob Mottram 7703a002cd utc offset adjust 2020-11-22 20:18:10 +00:00
Bob Mottram 6f5d5f1019 Convert local dates to utc 2020-11-22 19:09:35 +00:00
Bob Mottram fb29da5f7a Date parser returns string 2020-11-22 19:01:18 +00:00
Bob Mottram 61beedd86e Remove debug 2020-11-22 18:46:10 +00:00
Bob Mottram 31b12ae207 Unit test for date parsing 2020-11-22 18:43:01 +00:00
Bob Mottram 86997a1380 Debug 2020-11-22 18:36:17 +00:00
Bob Mottram b90abc6891 Debug 2020-11-22 18:30:59 +00:00
Bob Mottram d505132b17 Published date 2020-11-22 18:28:27 +00:00
Bob Mottram 669a70d0d2 No default append to feed date 2020-11-22 18:25:05 +00:00
Bob Mottram e58effe89d Append UTC 2020-11-22 18:21:20 +00:00
Bob Mottram f892745e8c Tidy parsing of feed dates 2020-11-22 18:14:40 +00:00
Bob Mottram e0e31e8330 Testing sequence for feeds 2020-11-22 16:10:58 +00:00
Bob Mottram a7de74bb81 Plus 2020-11-22 16:02:18 +00:00
Bob Mottram c937cbdac8 timedelta import 2020-11-22 15:33:11 +00:00
Bob Mottram b58cdeba8b atom 2020-11-22 15:25:25 +00:00
Bob Mottram 8b7b9d5660 Debug 2020-11-22 15:08:05 +00:00
Bob Mottram f42c23d69f Make debug messages distinguishable 2020-11-22 14:18:25 +00:00
Bob Mottram 7be81054ba Handling of dates within feeds 2020-11-22 14:08:29 +00:00
Bob Mottram 64b4e7fbd8 Extra warning 2020-11-22 13:04:58 +00:00
Bob Mottram 03842778cc Warning text 2020-11-22 12:43:22 +00:00
Bob Mottram 22f21ba1f0 Variable name 2020-11-22 12:41:54 +00:00
Bob Mottram ea30903c70 Debug 2020-11-22 12:36:21 +00:00
Bob Mottram 06337020f8 Debug 2020-11-22 12:32:48 +00:00
Bob Mottram a41ec54370 Remove any ending 2020-11-22 12:27:42 +00:00
Bob Mottram bf28568bd1 One more 2020-11-22 12:25:53 +00:00
Bob Mottram bc77031e6a Ensure that CDATA is removed from titles and descriptions 2020-11-22 12:18:43 +00:00
Bob Mottram d1295a94f0 Remove extra newswire items 2020-11-22 12:05:15 +00:00
Bob Mottram 7a01f422cf Set a maximum number of posts to appear in the newswire column 2020-11-22 11:48:53 +00:00
Bob Mottram 0e2a5e0965 Convert YT channels into atom-ish links 2020-11-22 10:46:54 +00:00
Bob Mottram 0b9e4c5350 Support for youtube feeds 2020-11-22 10:34:42 +00:00
Bob Mottram fad926c7ec Try media description if description doesn't exist 2020-11-21 23:29:46 +00:00
Bob Mottram a557c4a060 Try media description if description doesn't exist 2020-11-21 23:18:34 +00:00
Bob Mottram db390b1a23 Extra check for full url 2020-11-08 11:04:52 +00:00
Bob Mottram 30e63970f6 Include description in newswire rss feed 2020-11-08 10:45:33 +00:00
Bob Mottram 49414c7012 Include description within rss feeds 2020-11-08 10:30:25 +00:00
Bob Mottram bb936c455a Remove extraneous argument 2020-11-08 10:05:28 +00:00
Bob Mottram a62641fec4 Get newswire summary from blog posts 2020-11-08 09:47:01 +00:00
Bob Mottram c8858f871a Check the size of individual rss/atom feed items 2020-11-03 16:04:25 +00:00
Bob Mottram 5318beebf0 Check that items are returned 2020-11-03 15:04:33 +00:00
Bob Mottram 4c1553e1e7 Check newswire for no return value 2020-11-03 14:41:28 +00:00
Bob Mottram cb49d90bb9 Removing long words from feed titles 2020-10-31 23:10:38 +00:00
Bob Mottram ade3c0560b Remove long words from newswire titles 
This can cause column overflows
 2020-10-31 22:47:43 +00:00
Bob Mottram 44d48edbc0 Check number of tags 2020-10-25 12:57:14 +00:00
Bob Mottram 3fd0723684 Remove html before checking for hashtags 2020-10-25 12:47:16 +00:00
Bob Mottram a9c07065a0 Comment 2020-10-25 10:47:39 +00:00
Bob Mottram 78c06df1c6 More distinctive function name 2020-10-25 10:45:42 +00:00
Bob Mottram d571088c2d Extra check that blog post is public 2020-10-25 10:42:38 +00:00
Bob Mottram 15e34237e4 Simplify 2020-10-25 10:18:07 +00:00
Bob Mottram 361df8a2ae Tidy extraction of tags from rss feeds 2020-10-25 10:17:12 +00:00
Bob Mottram e521a95e18 Limit the maximum number of hashtags imported from newswire feeds 2020-10-23 15:41:29 +01:00
Bob Mottram 456b4202b1 Convert dates with offset 2020-10-20 13:37:32 +01:00
Bob Mottram fda4e294f8 Exception warn when converting date 2020-10-20 13:28:15 +01:00
Bob Mottram 4fdecc4f30 Handle dates with offset 2020-10-20 13:22:52 +01:00
Bob Mottram 6411ffcd62 Add a flag to indicate that a newswire feed has its contents mirrored 2020-10-19 15:37:17 +01:00
Bob Mottram ab48e6d456 Getting tags from posts 2020-10-18 10:28:43 +01:00
Bob Mottram b0a80dbb61 Conflicting domains 2020-10-17 21:53:36 +01:00
Bob Mottram 22fcc7be06 Apply word filter to newswire 2020-10-17 17:08:07 +01:00
Bob Mottram c536a8a0c8 Remove hash 2020-10-17 15:42:23 +01:00
Bob Mottram 96221bf86c Tidying 2020-10-17 15:28:42 +01:00
Bob Mottram 7835f02122 Apply hashtag moderation to news feeds 2020-10-17 15:23:35 +01:00
Bob Mottram 5ed417138a Quick check for hashtags 2020-10-16 21:46:34 +01:00
Bob Mottram af3b7baf12 Extract hashtags from newswire feeds 2020-10-16 21:13:23 +01:00
Bob Mottram a5d21852bb Avoid lone hashes 2020-10-16 20:52:27 +01:00
Bob Mottram a60491585e Extract hashtags from feeds 2020-10-16 20:49:34 +01:00
Bob Mottram 5bd133ffff Tidying of newswire dictionary creation 2020-10-16 20:25:55 +01:00
Bob Mottram 0735ceceb2 Missing argument 2020-10-16 13:11:05 +01:00
Bob Mottram d4751a47c6 Check text 2020-10-16 13:03:56 +01:00
Bob Mottram e5950d4363 Reject blocked domains within news feeds 2020-10-16 12:58:31 +01:00
Bob Mottram c3dbec6181 Maximum size for rss/atom feeds 
Prevents a hacked news source from implementing a denial of service
 2020-10-16 12:40:01 +01:00
Bob Mottram 876b29b7be Maximum newswire posts per source is configurable 2020-10-16 11:26:06 +01:00
Bob Mottram 5c5a25e534 Set an upper limit on the number of newswire posts per rss feed 
Helps to avoid having a giant list of items
 2020-10-16 11:13:14 +01:00
Bob Mottram 65acb8aa28 Singular 2020-10-13 18:17:17 +01:00
Bob Mottram bf1bf3a46d Title for site rss feed 2020-10-13 18:14:57 +01:00
Bob Mottram fbb230ac5c Don't need replaces 2020-10-10 13:25:07 +01:00
Bob Mottram 098932440c Same date format as rss 2020-10-10 13:24:14 +01:00
Bob Mottram 85162673f5 Add a moderated flag to newswire entries 2020-10-09 11:33:06 +01:00
Bob Mottram 6e77cf7f6b More obvious what list entries mean 2020-10-09 09:40:41 +01:00
Bob Mottram 71a36ec3ee Full url in rss link 2020-10-08 16:07:06 +01:00
Bob Mottram 6208a3f00f Convert rss feed items to activitypub posts 2020-10-07 14:51:29 +01:00
Bob Mottram 7bcabea021 Move news daemon functions 2020-10-07 13:05:49 +01:00
Bob Mottram f46f7e4480 No slash 2020-10-06 22:28:40 +01:00
Bob Mottram 576a2555e2 Voting on newswire items 2020-10-06 21:17:34 +01:00
Bob Mottram adc6cd9317 Show total moderator votes on newswire items 2020-10-06 20:46:22 +01:00
Bob Mottram 83bfd0b40a Three fields in item 2020-10-06 20:19:12 +01:00
Bob Mottram 143354d537 Show approved newswire items in a different style 2020-10-06 20:13:02 +01:00
Bob Mottram 454b4f3348 Backtracking 2020-10-06 19:32:24 +01:00
Bob Mottram 1d7a019217 Backtracking 2020-10-06 19:26:08 +01:00
Bob Mottram fdaf02b5c7 Edit button changes color when there are newswire items to be moderated 2020-10-06 15:32:53 +01:00
Bob Mottram a91f7bbb75 Continue if post is not located 2020-10-06 14:34:04 +01:00
Bob Mottram 96828b6727 Show exception 2020-10-06 14:31:34 +01:00
Bob Mottram f040362ef8 Three params 2020-10-06 14:17:32 +01:00
Bob Mottram bee236a44f Check that post is located 2020-10-06 14:05:15 +01:00
Bob Mottram df7382af19 Test without admin trust 2020-10-06 13:45:35 +01:00
Bob Mottram 3e666a4a91 Moderated posts can be rejected 2020-10-06 13:33:53 +01:00
Bob Mottram d0085e1c33 Comments 2020-10-06 13:15:35 +01:00
Bob Mottram d5248ea2d6 Save the current newswire moderation state to a file 2020-10-06 12:28:32 +01:00
Bob Mottram fc267f8b91 Unique entries in list 2020-10-06 11:37:06 +01:00
Bob Mottram ebb760a3c3 Create a dictionary of blog posts to be moderated 2020-10-06 11:34:56 +01:00
Bob Mottram 2d7e6f4f43 Blog posts going into the newswire may not always be local. 
They may be whatever federated to each users blog timeline.
 2020-10-06 10:47:58 +01:00
Bob Mottram 77dc42c343 Logic sequence 2020-10-06 10:41:04 +01:00
Bob Mottram 561640abfe Tidying 2020-10-06 10:38:41 +01:00
Bob Mottram c26cfb3c93 Tidying 2020-10-06 10:37:22 +01:00
Bob Mottram 8acf9b2f3e Comment 2020-10-06 10:22:23 +01:00
Bob Mottram f4cb24490a Tidying 2020-10-06 09:58:44 +01:00
Bob Mottram 8ec06c612b The trusted newswire accounts can include nickname only, rather than nick@domain 2020-10-05 19:26:38 +01:00
Bob Mottram 686aa0ec6a Read only 2020-10-05 19:22:26 +01:00
Bob Mottram 228234a4da Have a list of trusted handles permitted to post to the newswire 2020-10-05 19:21:12 +01:00
Bob Mottram 0e7490a44b Don't include blogs from suspended accounts within newswire 2020-10-05 12:30:11 +01:00
Bob Mottram 9b75c034a0 Add local blog posts to the newswire 2020-10-05 12:11:48 +01:00
Bob Mottram aa1e481b10 Date format 2020-10-04 23:16:00 +01:00
Bob Mottram a5291d4106 Date format 2020-10-04 23:12:27 +01:00
Bob Mottram 602714906a Date format 2020-10-04 23:08:13 +01:00
Bob Mottram ece3569b22 Reverse order 2020-10-04 22:45:46 +01:00