epicyon/README.md

338 lines
12 KiB
Markdown
Raw Normal View History

2019-07-04 20:50:46 +00:00
<img src="https://code.freedombone.net/bashrc/epicyon/raw/master/img/logo.png?raw=true" width=256/>
2019-07-04 21:20:26 +00:00
A minimal ActivityPub server.
2019-06-28 18:55:29 +00:00
2019-06-29 10:08:59 +00:00
Based on the specification: https://www.w3.org/TR/activitypub
2019-06-29 11:47:33 +00:00
Also: https://raw.githubusercontent.com/w3c/activitypub/gh-pages/activitypub-tutorial.txt
2019-06-29 10:08:59 +00:00
2019-07-05 20:32:21 +00:00
https://blog.dereferenced.org/what-is-ocap-and-why-should-i-care
2019-07-06 17:00:22 +00:00
https://alexcastano.com/what-is-activity-pub
2019-07-04 21:32:18 +00:00
This project is currently *pre alpha* and not recommended for any real world uses.
2019-07-04 21:21:10 +00:00
## Goals
2019-07-04 21:20:26 +00:00
* A minimal ActivityPub server, comparable to an email MTA.
2019-07-04 21:40:30 +00:00
* AGPLv3+
2019-07-04 21:20:26 +00:00
* Server-to-server and client-to-server protocols supported.
2019-07-04 21:32:18 +00:00
* Implemented in a common language (Python 3)
2019-07-04 22:11:56 +00:00
* Keyword filtering.
2019-07-06 09:07:24 +00:00
* Being able to define roles and skills, similar to the Pursuance project.
* Sharings collection, similar to the gnusocial sharings plugin
2019-07-04 21:20:26 +00:00
* Resistant to flooding, hellthreads, etc.
* Support content warnings, reporting and blocking.
* http signatures and basic auth.
* Compatible with http (onion addresses), https and dat.
* Minimal dependencies.
2019-07-05 20:32:21 +00:00
* Capabilities based security
2019-07-04 21:20:26 +00:00
* Data minimization principle. Configurable post expiry time.
2019-07-12 12:47:06 +00:00
* Likes and repeats only visible to authorized viewers
2019-07-04 21:20:26 +00:00
* Commandline interface. If there's a GUI it should be a separate project.
* Designed for intermittent connectivity. Assume network disruptions.
* Suitable for single board computers.
2019-07-07 12:26:33 +00:00
## Object capabilities workflow
This is one proposed way that OCAP could work.
2019-07-09 17:54:08 +00:00
* Works from person to person, not instance to instance. Actor-oriented capabilities.
2019-07-07 16:53:40 +00:00
* Produces negligible additional network traffic
* Works in the same way between people on different instances or the same instance
* People can alter what their followers can do on an individual basis
* Leverages the existing follow request mechanism
2019-07-07 12:26:33 +00:00
Default capabilities are initially set up when a follow request is made. The Accept activity sent back from a follow request can be received by any instance. A capabilities accept activity is attached to the follow accept.
``` text
2019-07-07 13:53:12 +00:00
Alice
2019-07-07 12:26:33 +00:00
|
V
Follow Request
|
V
2019-07-07 13:53:12 +00:00
Bob
2019-07-07 12:26:33 +00:00
|
V
Create/store default Capabilities
2019-07-07 13:53:12 +00:00
for Alice
2019-07-07 12:26:33 +00:00
|
V
Follow Accept + default Capabilities
|
V
2019-07-07 13:53:12 +00:00
Alice
2019-07-07 12:26:33 +00:00
|
V
Store Granted Capabilities
```
The default capabilities could be *any preferred policy* of the instance. They could be no capabilities at all, read only or full access to everything.
2019-07-07 13:53:12 +00:00
Example Follow request from **Alice** to **Bob**:
``` json
{'actor': 'http://alicedomain.net/users/alice',
'cc': ['https://www.w3.org/ns/activitystreams#Public'],
'id': 'http://alicedomain.net/users/alice/statuses/1562507338839876',
'object': 'http://bobdomain.net/users/bob',
'published': '2019-07-07T13:48:58Z',
'to': ['http://bobdomain.net/users/bob'],
'type': 'Follow'}
```
Follow Accept from **Bob** to **Alice** with attached capabilities.
``` json
{'actor': 'http://bobdomain.net/users/bob',
'capabilities': {'actor': 'http://bobdomain.net/users/bob',
'capability': ['inbox:write', 'objects:read'],
'id': 'http://bobdomain.net/caps/alice@alicedomain.net#rOYtHApyr4ZWDUgEE1KqjhTe0kI3T2wJ',
2019-07-07 13:53:12 +00:00
'scope': 'http://alicedomain.net/users/alice',
'type': 'Capability'},
'cc': [],
'object': {'actor': 'http://alicedomain.net/users/alice',
'cc': ['https://www.w3.org/ns/activitystreams#Public'],
'id': 'http://alicedomain.net/users/alice/statuses/1562507338839876',
'object': 'http://bobdomain.net/users/bob',
'published': '2019-07-07T13:48:58Z',
'to': ['http://bobdomain.net/users/bob'],
'type': 'Follow'},
'to': ['http://alicedomain.net/users/alice'],
'type': 'Accept'}
```
2019-07-09 14:44:19 +00:00
When posts are subsequently sent from the following instance (server-to-server) they should have the corresponding capability id string attached within the Create wrapper. To handle the *shared inbox* scenario this should be a list rather than a single string. In the above example that would be *['http://bobdomain.net/caps/alice@alicedomain.net#rOYtHApyr4ZWDUgEE1KqjhTe0kI3T2wJ']*. It should contain a random token which is hard to guess by brute force methods.
2019-07-07 12:26:33 +00:00
2019-07-12 16:09:25 +00:00
NOTE: the token should be random and not a hash of anything. Making it a hash would give an adversary a much better chance of calculating it.
2019-07-07 12:26:33 +00:00
``` text
2019-07-07 13:53:12 +00:00
Alice
2019-07-07 12:26:33 +00:00
|
V
Send Post
Attach id from Stored Capabilities
2019-07-07 13:53:12 +00:00
granted by Bob
2019-07-07 12:26:33 +00:00
|
V
2019-07-07 13:53:12 +00:00
Bob
2019-07-07 12:26:33 +00:00
|
V
2019-07-07 19:57:01 +00:00
http signature check
|
V
2019-07-07 12:26:33 +00:00
Check Capability id matches
stored capabilities
|
V
2019-07-07 19:57:01 +00:00
Match stored capability scope
against actor on received post
|
V
2019-07-07 20:00:06 +00:00
Check that stored capability
contains inbox:write, etc
|
V
2019-07-07 19:57:01 +00:00
Any other checks
2019-07-07 12:26:33 +00:00
|
V
2019-07-07 20:00:06 +00:00
Accept incoming post
2019-07-07 12:26:33 +00:00
```
Subsequently **Bob** could change the stored capabilities for **Alice** in their database, giving the new object a different id. This could be sent back to **Alice** as an **Update** activity with attached capability.
Bob can send this to Alice, altering *capability* to now include *inbox:noreply*. Notice that the random token at the end of the *id* has changed, so that Alice can't continue to use the old capabilities.
``` json
{'actor': 'http://bobdomain.net/users/bob',
'cc': [],
'object': {'actor': 'http://bobdomain.net/users/bob',
'capability': ['inbox:write', 'objects:read', 'inbox:noreply'],
'id': 'http://bobdomain.net/caps/alice@alicedomain.net#53nwZhHipNFCNwrJ2sgE8GPx13SnV23X',
'scope': 'http://alicedomain.net/users/alice',
'type': 'Capability'},
'to': ['http://alicedomain.net/users/alice'],
'type': 'Update'}
```
Alice then receives this and updates her capabilities granted by Bob to:
``` json
{'actor': 'http://bobdomain.net/users/bob',
'capability': ['inbox:write', 'objects:read', 'inbox:noreply'],
'id': 'http://bobdomain.net/caps/alice@alicedomain.net#53nwZhHipNFCNwrJ2sgE8GPx13SnV23X',
'scope': 'http://alicedomain.net/users/alice',
'type': 'Capability'}
```
If she sets her system to somehow ignore the update then if capabilities are strictly enforced she will no longer be able to send messages to Bob's inbox.
2019-07-07 12:26:33 +00:00
2019-07-07 17:52:24 +00:00
Object capabilities can be strictly enforced by adding the **--ocap** option when running the server. The only activities which it is not enforced upon are **Follow** and **Accept**. Anyone can create a follow request or accept updated capabilities.
2019-07-07 17:51:03 +00:00
2019-07-08 13:30:04 +00:00
## Object capabilities in the shared inbox scenario
Shared inboxes are obviously essential for any kind of scalability, otherwise there would be vast amounts of duplicated messages being dumped onto the intertubes like a big truck.
With the shared inbox instead of sending from Alice to 500 of her fans on a different instance - repeatedly sending the same message to individual inboxes - a single message is sent to its shared inbox (which has its own special account called 'inbox') and it then decides how to distribute that. If a list of capability ids is attached to the message which gets sent to the shared inbox then the receiving server can use that.
2019-07-07 21:16:04 +00:00
## Some capabilities
*inbox:write* - follower can post anything to your inbox
2019-07-09 15:53:38 +00:00
*inbox:noreply* - follower can't reply to your posts
2019-07-07 21:16:04 +00:00
*inbox:nolike* - follower can't like your posts
*inbox:nopics* - follower can't post image links
*inbox:noannounce* - follower can't send repeats (announce activities) to your inbox
*inbox:cw* - follower can't post to your inbox unless they include a content warning
2019-07-07 14:26:49 +00:00
## Object capabilities adversaries
If **Eve** subsequently learns what the capabilities id is for **Alice** by somehow intercepting the traffic (eg. suppose she works for *Eveflare*) then she can't gain the capabilities of Alice due to the *scope* parameter against which the actors of incoming posts are checked.
**Eve** could create a post pretending to be from Alice's domain, but the http signature check would fail due to her not having Alice's keys.
The only scenarios in which Eve might triumph would be if she could also do DNS highjacking and:
* Bob isn't storing Alice's public key and looks it up repeatedly
* Alice and Bob's instances are foolishly configured to perform *blind key rotation* such that her being in the middle is indistinguishable from expected key changes
Even if Eve has an account on Alice's instance this won't help her very much unless she can get write access to the database.
2019-07-07 14:07:40 +00:00
2019-06-28 18:55:29 +00:00
## Install
``` bash
2019-07-12 19:08:46 +00:00
sudo pacman -S tor python-pip python-pysocks python-pycryptodome python-beautifulsoup4 imagemagick python-pillow python-numpy
2019-07-02 17:11:59 +00:00
sudo pip install commentjson
2019-07-04 20:44:03 +00:00
```
## Running Tests
To run the unit tests:
``` bash
python3 epicyon.py --tests
```
To run the network tests. These simulate instances exchanging messages.
``` bash
python3 epicyon.py --testsnetwork
```
2019-07-04 21:32:18 +00:00
2019-07-04 22:03:24 +00:00
## Viewing Public Posts
To view the public posts for a person:
``` bash
python3 epicyon.py --posts nickname@domain
```
If you want to view the raw json:
``` bash
python3 epicyon.py --postsraw nickname@domain
```
2019-07-04 22:54:28 +00:00
## Account Management
To add a new account:
``` bash
python3 epicyon.py --addaccount nickname@domain --password [yourpassword]
```
To remove an account (be careful!):
``` bash
python3 epicyon.py --rmaccount nickname@domain
```
2019-07-05 09:53:51 +00:00
To change the password for an account:
``` bash
python3 epicyon.py --changepassword nickname@domain newpassword
```
2019-07-12 14:42:43 +00:00
To set an avatar for an account:
``` bash
2019-07-12 16:03:45 +00:00
python3 epicyon.py --nickname [nick] --domain [name] --avatar [image filename]
2019-07-12 14:42:43 +00:00
```
To set the background image for an account:
``` bash
2019-07-12 16:03:45 +00:00
python3 epicyon.py --nickname [nick] --domain [name] --background [image filename]
2019-07-12 14:42:43 +00:00
```
2019-07-04 21:32:18 +00:00
## Running the Server
To run with defaults:
``` bash
python3 epicyon.py
```
In a browser of choice (but not Tor browser) you can then navigate to:
``` text
http://localhost:8085/users/admin
```
If it's working then you should see the json actor for the default admin account.
For a more realistic installation you can run on a defined domain and port:
``` bash
python3 epicyon.py --domain [name] --port 8000 --https
```
You will need to proxy port 8000 through your web server and set up CA certificates as needed.
By default data will be stored in the directory in which you run the server, but you can also specify a directory:
``` bash
python3 epicyon.py --domain [name] --port 8000 --https --path [data directory]
```
2019-07-04 21:40:30 +00:00
By default the server will federate with any others. You can limit this to a well-defined list with the *--federate* option.
``` bash
2019-07-04 21:41:23 +00:00
python3 epicyon.py --domain [name] --port 8000 --https --federate domain1.net domain2.org domain3.co.uk
2019-07-04 21:40:30 +00:00
```
2019-07-09 15:58:51 +00:00
## Following other accounts
With your server running you can then follow other accounts with:
``` bash
python3 epicyon.py --nickname [yournick] --domain [name] --follow othernick@domain
```
2019-07-12 20:51:02 +00:00
You may or may not need to use the *--port*, *--https* and *--tor* options, depending upon how your server was set up.
## Archiving posts
You can archive old posts with:
``` bash
python3 epicyon.py --archive [directory]
```
Which will move old posts to the given directory. You can also specify the number of weeks after which images will be archived, and the maximum number of posts within in/outboxes.
``` bash
python3 epicyon.py --archive [directory] --archiveweeks 4 --maxposts 256
```
If you want old posts to be deleted for data minimization purposes then the archive location can be set to */dev/null*.
``` bash
python3 epicyon.py --archive /dev/null --archiveweeks 4 --maxposts 256
```