Commit Graph

178 Commits (4f17e93a02b345c8519d3444ac414fa63e5ee339)

Author SHA1 Message Date
Bob Mottram 4f740a836c Check for dubious payloads 2020-12-03 10:12:09 +00:00
Bob Mottram 1426fefe5d Apply instance level blocks to hashtag category feeds 2020-12-02 22:40:46 +00:00
Bob Mottram 1b9989bcd3 Missing parameter 2020-12-02 17:02:32 +00:00
Bob Mottram 2f513407e4 Hashtag categories as rss feeds 2020-12-02 16:18:36 +00:00
Bob Mottram 5a449ab4e9 Use published rather than updated for youtube feeds 2020-11-28 20:46:52 +00:00
Bob Mottram 6cb9d7e399 More debug 2020-11-27 22:43:34 +00:00
Bob Mottram a998c0b321 Check that offset exists 2020-11-22 20:37:08 +00:00
Bob Mottram 758380dade Calculate offset 2020-11-22 20:33:24 +00:00
Bob Mottram 7703a002cd utc offset adjust 2020-11-22 20:18:10 +00:00
Bob Mottram 6f5d5f1019 Convert local dates to utc 2020-11-22 19:09:35 +00:00
Bob Mottram fb29da5f7a Date parser returns string 2020-11-22 19:01:18 +00:00
Bob Mottram 61beedd86e Remove debug 2020-11-22 18:46:10 +00:00
Bob Mottram 31b12ae207 Unit test for date parsing 2020-11-22 18:43:01 +00:00
Bob Mottram 86997a1380 Debug 2020-11-22 18:36:17 +00:00
Bob Mottram b90abc6891 Debug 2020-11-22 18:30:59 +00:00
Bob Mottram d505132b17 Published date 2020-11-22 18:28:27 +00:00
Bob Mottram 669a70d0d2 No default append to feed date 2020-11-22 18:25:05 +00:00
Bob Mottram e58effe89d Append UTC 2020-11-22 18:21:20 +00:00
Bob Mottram f892745e8c Tidy parsing of feed dates 2020-11-22 18:14:40 +00:00
Bob Mottram e0e31e8330 Testing sequence for feeds 2020-11-22 16:10:58 +00:00
Bob Mottram a7de74bb81 Plus 2020-11-22 16:02:18 +00:00
Bob Mottram c937cbdac8 timedelta import 2020-11-22 15:33:11 +00:00
Bob Mottram b58cdeba8b atom 2020-11-22 15:25:25 +00:00
Bob Mottram 8b7b9d5660 Debug 2020-11-22 15:08:05 +00:00
Bob Mottram f42c23d69f Make debug messages distinguishable 2020-11-22 14:18:25 +00:00
Bob Mottram 7be81054ba Handling of dates within feeds 2020-11-22 14:08:29 +00:00
Bob Mottram 64b4e7fbd8 Extra warning 2020-11-22 13:04:58 +00:00
Bob Mottram 03842778cc Warning text 2020-11-22 12:43:22 +00:00
Bob Mottram 22f21ba1f0 Variable name 2020-11-22 12:41:54 +00:00
Bob Mottram ea30903c70 Debug 2020-11-22 12:36:21 +00:00
Bob Mottram 06337020f8 Debug 2020-11-22 12:32:48 +00:00
Bob Mottram a41ec54370 Remove any ending 2020-11-22 12:27:42 +00:00
Bob Mottram bf28568bd1 One more 2020-11-22 12:25:53 +00:00
Bob Mottram bc77031e6a Ensure that CDATA is removed from titles and descriptions 2020-11-22 12:18:43 +00:00
Bob Mottram d1295a94f0 Remove extra newswire items 2020-11-22 12:05:15 +00:00
Bob Mottram 7a01f422cf Set a maximum number of posts to appear in the newswire column 2020-11-22 11:48:53 +00:00
Bob Mottram 0e2a5e0965 Convert YT channels into atom-ish links 2020-11-22 10:46:54 +00:00
Bob Mottram 0b9e4c5350 Support for youtube feeds 2020-11-22 10:34:42 +00:00
Bob Mottram fad926c7ec Try media description if description doesn't exist 2020-11-21 23:29:46 +00:00
Bob Mottram a557c4a060 Try media description if description doesn't exist 2020-11-21 23:18:34 +00:00
Bob Mottram db390b1a23 Extra check for full url 2020-11-08 11:04:52 +00:00
Bob Mottram 30e63970f6 Include description in newswire rss feed 2020-11-08 10:45:33 +00:00
Bob Mottram 49414c7012 Include description within rss feeds 2020-11-08 10:30:25 +00:00
Bob Mottram bb936c455a Remove extraneous argument 2020-11-08 10:05:28 +00:00
Bob Mottram a62641fec4 Get newswire summary from blog posts 2020-11-08 09:47:01 +00:00
Bob Mottram c8858f871a Check the size of individual rss/atom feed items 2020-11-03 16:04:25 +00:00
Bob Mottram 5318beebf0 Check that items are returned 2020-11-03 15:04:33 +00:00
Bob Mottram 4c1553e1e7 Check newswire for no return value 2020-11-03 14:41:28 +00:00
Bob Mottram cb49d90bb9 Removing long words from feed titles 2020-10-31 23:10:38 +00:00
Bob Mottram ade3c0560b Remove long words from newswire titles
This can cause column overflows
2020-10-31 22:47:43 +00:00
Bob Mottram 44d48edbc0 Check number of tags 2020-10-25 12:57:14 +00:00
Bob Mottram 3fd0723684 Remove html before checking for hashtags 2020-10-25 12:47:16 +00:00
Bob Mottram a9c07065a0 Comment 2020-10-25 10:47:39 +00:00
Bob Mottram 78c06df1c6 More distinctive function name 2020-10-25 10:45:42 +00:00
Bob Mottram d571088c2d Extra check that blog post is public 2020-10-25 10:42:38 +00:00
Bob Mottram 15e34237e4 Simplify 2020-10-25 10:18:07 +00:00
Bob Mottram 361df8a2ae Tidy extraction of tags from rss feeds 2020-10-25 10:17:12 +00:00
Bob Mottram e521a95e18 Limit the maximum number of hashtags imported from newswire feeds 2020-10-23 15:41:29 +01:00
Bob Mottram 456b4202b1 Convert dates with offset 2020-10-20 13:37:32 +01:00
Bob Mottram fda4e294f8 Exception warn when converting date 2020-10-20 13:28:15 +01:00
Bob Mottram 4fdecc4f30 Handle dates with offset 2020-10-20 13:22:52 +01:00
Bob Mottram 6411ffcd62 Add a flag to indicate that a newswire feed has its contents mirrored 2020-10-19 15:37:17 +01:00
Bob Mottram ab48e6d456 Getting tags from posts 2020-10-18 10:28:43 +01:00
Bob Mottram b0a80dbb61 Conflicting domains 2020-10-17 21:53:36 +01:00
Bob Mottram 22fcc7be06 Apply word filter to newswire 2020-10-17 17:08:07 +01:00
Bob Mottram c536a8a0c8 Remove hash 2020-10-17 15:42:23 +01:00
Bob Mottram 96221bf86c Tidying 2020-10-17 15:28:42 +01:00
Bob Mottram 7835f02122 Apply hashtag moderation to news feeds 2020-10-17 15:23:35 +01:00
Bob Mottram 5ed417138a Quick check for hashtags 2020-10-16 21:46:34 +01:00
Bob Mottram af3b7baf12 Extract hashtags from newswire feeds 2020-10-16 21:13:23 +01:00
Bob Mottram a5d21852bb Avoid lone hashes 2020-10-16 20:52:27 +01:00
Bob Mottram a60491585e Extract hashtags from feeds 2020-10-16 20:49:34 +01:00
Bob Mottram 5bd133ffff Tidying of newswire dictionary creation 2020-10-16 20:25:55 +01:00
Bob Mottram 0735ceceb2 Missing argument 2020-10-16 13:11:05 +01:00
Bob Mottram d4751a47c6 Check text 2020-10-16 13:03:56 +01:00
Bob Mottram e5950d4363 Reject blocked domains within news feeds 2020-10-16 12:58:31 +01:00
Bob Mottram c3dbec6181 Maximum size for rss/atom feeds
Prevents a hacked news source from implementing a denial of service
2020-10-16 12:40:01 +01:00
Bob Mottram 876b29b7be Maximum newswire posts per source is configurable 2020-10-16 11:26:06 +01:00
Bob Mottram 5c5a25e534 Set an upper limit on the number of newswire posts per rss feed
Helps to avoid having a giant list of items
2020-10-16 11:13:14 +01:00
Bob Mottram 65acb8aa28 Singular 2020-10-13 18:17:17 +01:00
Bob Mottram bf1bf3a46d Title for site rss feed 2020-10-13 18:14:57 +01:00
Bob Mottram fbb230ac5c Don't need replaces 2020-10-10 13:25:07 +01:00
Bob Mottram 098932440c Same date format as rss 2020-10-10 13:24:14 +01:00
Bob Mottram 85162673f5 Add a moderated flag to newswire entries 2020-10-09 11:33:06 +01:00
Bob Mottram 6e77cf7f6b More obvious what list entries mean 2020-10-09 09:40:41 +01:00
Bob Mottram 71a36ec3ee Full url in rss link 2020-10-08 16:07:06 +01:00
Bob Mottram 6208a3f00f Convert rss feed items to activitypub posts 2020-10-07 14:51:29 +01:00
Bob Mottram 7bcabea021 Move news daemon functions 2020-10-07 13:05:49 +01:00
Bob Mottram f46f7e4480 No slash 2020-10-06 22:28:40 +01:00
Bob Mottram 576a2555e2 Voting on newswire items 2020-10-06 21:17:34 +01:00
Bob Mottram adc6cd9317 Show total moderator votes on newswire items 2020-10-06 20:46:22 +01:00
Bob Mottram 83bfd0b40a Three fields in item 2020-10-06 20:19:12 +01:00
Bob Mottram 143354d537 Show approved newswire items in a different style 2020-10-06 20:13:02 +01:00
Bob Mottram 454b4f3348 Backtracking 2020-10-06 19:32:24 +01:00
Bob Mottram 1d7a019217 Backtracking 2020-10-06 19:26:08 +01:00
Bob Mottram fdaf02b5c7 Edit button changes color when there are newswire items to be moderated 2020-10-06 15:32:53 +01:00
Bob Mottram a91f7bbb75 Continue if post is not located 2020-10-06 14:34:04 +01:00
Bob Mottram 96828b6727 Show exception 2020-10-06 14:31:34 +01:00
Bob Mottram f040362ef8 Three params 2020-10-06 14:17:32 +01:00
Bob Mottram bee236a44f Check that post is located 2020-10-06 14:05:15 +01:00