Reticulum/README.md

265 lines
18 KiB
Markdown
Raw Normal View History

2021-05-17 20:06:58 +02:00
Reticulum Network Stack β
2018-04-04 14:22:30 +02:00
==========
2022-06-30 14:06:55 +02:00
***Please Know!** Reticulum is transitioning to 128-bit address space. The code currently in the master branch is incompatible with the latest release, version 0.3.8. The next release of Reticulum, version 0.3.9, will bring the released version up to compatibility with the source code in this repository. Reticulum version 0.3.9 will not be compatible with any prior releases. Please transition your systems accordingly.*
2022-06-30 14:07:58 +02:00
<p align="center"><img width="200" src="https://unsigned.io/wp-content/uploads/2022/03/reticulum_logo_512.png"></p>
2022-04-01 18:22:17 +02:00
Reticulum is the cryptography-based networking stack for wide-area networks built on readily available hardware. It can operate even with very high latency and extremely low bandwidth. Reticulum allows you to build wide-area networks with off-the-shelf tools, and offers end-to-end encryption and connectivity, initiator anonymity, autoconfiguring cryptographically backed multi-hop transport, efficient addressing, unforgeable delivery acknowledgements and more.
2018-04-04 14:22:30 +02:00
2022-05-29 09:48:53 +02:00
The vision of Reticulum is to allow anyone to be their own network operator, and to make it cheap and easy to cover vast areas with a myriad of independent, interconnectable and autonomous networks. Reticulum **is not** *one* network. It is **a tool** for building *thousands of networks*. Networks without kill-switches, surveillance, censorship and control. Networks that can freely interoperate, associate and disassociate with each other, and require no central oversight. Networks for human beings. *Networks for the people*.
2022-04-28 14:17:12 +02:00
2022-05-29 09:48:31 +02:00
Reticulum is a complete networking stack, and does not rely on IP or higher layers, but it is possible to use IP as the underlying carrier for Reticulum. It is therefore trivial to tunnel Reticulum over the Internet or private IP networks.
2020-06-14 18:33:01 +02:00
2022-06-08 21:05:03 +02:00
Having no dependencies on traditional networking stacks frees up overhead that has been used to implement a networking stack built directly on cryptographic principles, allowing resilience and stable functionality, even in open and trustless networks.
2018-04-04 14:22:30 +02:00
2020-05-13 09:31:43 +02:00
No kernel modules or drivers are required. Reticulum runs completely in userland, and can run on practically any system that runs Python 3.
2020-03-07 23:05:03 +01:00
2022-01-12 12:53:18 +01:00
## Read The Manual
2021-05-17 20:06:58 +02:00
The full documentation for Reticulum is available at [markqvist.github.io/Reticulum/manual/](https://markqvist.github.io/Reticulum/manual/).
You can also [download the Reticulum manual as a PDF](https://github.com/markqvist/Reticulum/raw/master/docs/Reticulum%20Manual.pdf)
2018-04-04 14:22:30 +02:00
2021-05-17 20:06:58 +02:00
For more info, see [unsigned.io/projects/reticulum](https://unsigned.io/projects/reticulum/)
2021-05-17 00:03:56 +02:00
2020-06-14 11:26:11 +02:00
## Notable Features
2022-04-18 17:01:41 +02:00
- Coordination-less globally unique adressing and identification
- Fully self-configuring multi-hop routing
- Complete initiator anonymity, communicate without revealing your identity
- Asymmetric X25519 encryption and Ed25519 signatures as a basis for all communication
- Forward Secrecy with ephemereal Elliptic Curve Diffie-Hellman keys on Curve25519
- Reticulum uses the [Fernet](https://github.com/fernet/spec/blob/master/Spec.md) specification for on-the-wire / over-the-air encryption
- Keys are ephemeral and derived from an ECDH key exchange on Curve25519
- AES-128 in CBC mode with PKCS7 padding
- HMAC using SHA256 for authentication
- IVs are generated through os.urandom()
- Unforgeable packet delivery confirmations
- A variety of supported interface types
- An intuitive and easy-to-use API
- Reliable and efficient transfer of arbritrary amounts of data
- Reticulum can handle a few bytes of data or files of many gigabytes
- Sequencing, transfer coordination and checksumming is automatic
- The API is very easy to use, and provides transfer progress
- Lightweight, flexible and expandable Request/Response mechanism
- Efficient link establishment
2022-07-02 08:45:57 +02:00
- Total bandwidth cost of setting up an encrypted link is 3 packets totalling 265 bytes
- Low cost of keeping links open at only 0.44 bits per second
2020-06-14 11:26:11 +02:00
2021-10-08 17:54:17 +02:00
## Examples of Reticulum Applications
If you want to quickly get an idea of what Reticulum can do, take a look at the following resources.
2022-04-18 17:01:41 +02:00
- [LXMF](https://github.com/markqvist/lxmf) is a distributed, delay and disruption tolerant message transfer protocol built on Reticulum
- For an off-grid, encrypted and resilient mesh communications platform, see [Nomad Network](https://github.com/markqvist/NomadNet)
- The Android, Linux and macOS app [Sideband](https://unsigned.io/sideband) has a graphical interface and focuses on ease of use.
2021-10-08 17:54:17 +02:00
2020-05-13 09:31:43 +02:00
## Where can Reticulum be used?
2022-07-01 17:30:51 +02:00
Over practically any medium that can support at least a half-duplex channel with 500 bits per second throughput, and an MTU of 500 bytes. Data radios, modems, LoRa radios, serial lines, AX.25 TNCs, amateur radio digital modes, WiFi and Ethernet devices, free-space optical links, and similar systems are all examples of the types of physical devices Reticulum can use.
2018-04-04 14:32:29 +02:00
2022-07-01 17:30:51 +02:00
An open-source LoRa-based interface called [RNode](https://markqvist.github.io/Reticulum/manual/hardware.html#rnode) has been designed specifically for use with Reticulum. It is possible to build yourself, or it can be purchased as a complete transceiver that just needs a USB connection to the host.
2018-04-04 14:32:29 +02:00
2022-07-01 17:30:51 +02:00
Reticulum can also be encapsulated over existing IP networks, so there's nothing stopping you from using it over wired ethernet, your local WiFi network or the Internet, where it'll work just as well. In fact, one of the strengths of Reticulum is how easily it allows you to connect different mediums into a self-configuring, resilient and encrypted mesh, using any available mixture of available infrastructure.
2018-04-04 14:32:29 +02:00
2020-05-13 09:31:43 +02:00
As an example, it's possible to set up a Raspberry Pi connected to both a LoRa radio, a packet radio TNC and a WiFi network. Once the interfaces are configured, Reticulum will take care of the rest, and any device on the WiFi network can communicate with nodes on the LoRa and packet radio sides of the network, and vice versa.
2018-04-20 22:10:44 +02:00
2021-12-09 18:34:07 +01:00
## How do I get started?
The best way to get started with the Reticulum Network Stack depends on what
you want to do. For full details and examples, have a look at the [Getting Started Fast](https://markqvist.github.io/Reticulum/manual/gettingstartedfast.html) section of the [Reticulum Manual](https://markqvist.github.io/Reticulum/manual/).
To simply install Reticulum and related utilities on your system, the easiest way is via pip:
```bash
pip3 install rns
```
You can then start any program that uses Reticulum, or start Reticulum as a system service with [the rnsd utility](https://markqvist.github.io/Reticulum/manual/using.html#the-rnsd-utility).
2022-07-01 17:30:51 +02:00
When first started, Reticulum will create a default configuration file, providing basic connectivity to other Reticulum peers that might be locally reachable. The default config file contains a few examples, and references for creating a more complex configuration.
2021-12-09 18:34:07 +01:00
2022-07-01 17:30:51 +02:00
For more detailed examples on how to expand communication over many mediums such as packet radio or LoRa, serial ports, or over fast IP links and the Internet using the UDP and TCP interfaces, take a look at the [Supported Interfaces](https://markqvist.github.io/Reticulum/manual/interfaces.html) section of the [Reticulum Manual](https://markqvist.github.io/Reticulum/manual/).
2021-12-09 18:34:07 +01:00
2022-05-24 20:57:56 +02:00
## Included Utilities
Reticulum includes a range of useful utilities for managing your networks, viewing status and information, and other tasks. You can read more about these programs in the [Included Utility Programs](https://markqvist.github.io/Reticulum/manual/using.html#included-utility-programs) section of the [Reticulum Manual](https://markqvist.github.io/Reticulum/manual/).
2022-05-24 20:58:58 +02:00
- The system daemon `rnsd` for running Reticulum as an always-available service
- An interface status utility called `rnstatus`, that displays information about interfaces
- The path lookup and and management tool `rnpath` letting you view and modify path tables
- A diagnostics tool called `rnprobe` for checking connectivity to destinations
2022-07-01 21:13:55 +02:00
- A simple file transfer program called `rncp` making it easy to copy files to remote systems
2022-05-24 20:58:58 +02:00
- The remote command execution program `rnx` that let's you run commands and programs and retrieve output from remote systems
2022-05-24 20:57:56 +02:00
2022-05-24 21:00:46 +02:00
All tools, including `rnx` and `rncp`, work reliably and well even over very low-bandwidth links like LoRa or Packet Radio.
2022-05-24 21:00:25 +02:00
2020-05-13 09:31:43 +02:00
## Supported interface types and devices
2022-04-18 17:01:41 +02:00
Reticulum implements a range of generalised interface types that covers most of the communications hardware that Reticulum can run over. If your hardware is not supported, it's relatively simple to implement an interface class. I will gratefully accept pull requests for custom interfaces if they are generally useful.
2020-03-07 23:04:38 +01:00
2022-04-18 17:01:41 +02:00
Currently, the following interfaces are supported:
- Any ethernet device
- LoRa using [RNode](https://unsigned.io/projects/rnode/)
- Packet Radio TNCs (with or without AX.25)
- KISS-compatible hardware and software modems
- Any device with a serial port
- TCP over IP networks
- UDP over IP networks
2022-05-14 20:19:46 +02:00
- External programs via stdio or pipes
- Custom hardware via stdio or pipes
2020-03-07 23:04:38 +01:00
2022-06-10 13:12:07 +02:00
## Performance
2022-06-12 13:28:16 +02:00
Reticulum targets a *very* wide usable performance envelope, but prioritises functionality and performance over low-bandwidth mediums. The goal is to provide a dynamic performance envelope from 250 bits per second, to 1 gigabit per second on normal hardware.
2022-06-10 13:13:51 +02:00
2022-06-12 13:28:16 +02:00
Currently, the usable performance envelope is approximately 500 bits per second to 20 megabits per second, with physical mediums faster than that not being saturated. Performance beyond the current level is intended for future upgrades, but not highly prioritised at this point in time.
2022-06-10 13:12:07 +02:00
2022-06-10 13:13:15 +02:00
## Current Status
Reticulum should currently be considered beta software. All core protocol features are implemented and functioning, but additions will probably occur as real-world use is explored. There will be bugs. The API and wire-format can be considered relatively stable at the moment, but could change if warranted.
2022-04-01 17:55:48 +02:00
## Development Roadmap
2022-06-22 10:00:43 +02:00
- Version 0.3.9
- Expansion of address space to 128 bits
- Performance and memory optimisations
2022-05-29 09:47:26 +02:00
- Utilities for managing identities, signing and encryption
2022-06-22 10:00:43 +02:00
- Version 0.4.0
- Improving [the manual](https://markqvist.github.io/Reticulum/manual/) with sections specifically for beginners
- User friendly interface configuration tool
- Support for radio and modem interfaces on Android
2022-04-18 17:08:06 +02:00
- More interface types for even broader compatibility
- Plain ESP32 devices (ESP-Now, WiFi, Bluetooth, etc.)
- More LoRa transceivers
- IR Transceivers
- Planned, but not yet scheduled
2022-07-01 17:30:51 +02:00
- Distributed Destination Naming System
2022-06-11 15:03:14 +02:00
- Network-wide path balancing
2022-04-18 17:08:06 +02:00
- Globally routable multicast
2022-05-22 11:13:54 +02:00
- Bindings for other programming languages
2022-04-18 17:08:06 +02:00
- A portable Reticulum implementation in C, see [#21](https://github.com/markqvist/Reticulum/discussions/21)
2022-06-10 17:05:00 +02:00
- Easy way to share interface configurations, see [#19](https://github.com/markqvist/Reticulum/discussions/19)
- More interface types
- AT-compatible modems
- AWDL / OWL
- HF Modems
- CAN-bus
- ZeroMQ
- MQTT
- SPI
- i²c
2022-06-27 20:17:23 +02:00
- Tor
2022-04-18 17:08:06 +02:00
2018-04-04 14:32:29 +02:00
2022-06-10 11:28:59 +02:00
## Dependencies
2022-06-16 19:53:17 +02:00
The installation of the default `rns` package requires the dependencies listed below. Almost all systems and distributions have readily available packages for these dependencies, and when the `rns` package is installed with `pip`, they will be downloaded and installed as well.
2018-04-04 14:22:30 +02:00
2022-06-10 11:26:46 +02:00
- [PyCA/cryptography](https://github.com/pyca/cryptography)
- [netifaces](https://github.com/al45tair/netifaces)
- [pyserial](https://github.com/pyserial/pyserial)
On more unusual systems, and in some rare cases, it might not be possible to install or even compile one or more of the above modules. In such situations, you can use the `rnspure` package instead, which require no external dependencies for installation. Please note that the contents of the `rns` and `rnspure` packages are *identical*. The only difference is that the `rnspure` package lists no dependencies required for installation.
No matter how Reticulum is installed and started, it will load external dependencies only if they are *needed* and *available*. If for example you want to use Reticulum on a system that cannot support [pyserial](https://github.com/pyserial/pyserial), it is perfectly possible to do so using the `rnspure` package, but Reticulum will not be able to use serial-based interfaces. All other available modules will still be loaded when needed.
2022-04-01 17:11:52 +02:00
2022-06-10 11:26:46 +02:00
**Please Note!** If you use the `rnspure` package to run Reticulum on systems that do not support [PyCA/cryptography](https://github.com/pyca/cryptography), it is important that you read and understand the [Cryptographic Primitives](#cryptographic-primitives) section of this document.
## Public Testnet
2022-04-01 17:11:52 +02:00
If you just want to get started experimenting without building any physical networks, you are welcome to join the Unsigned.io RNS Testnet. The testnet is just that, an informal network for testing and experimenting. It will be up most of the time, and anyone can join, but it also means that there's no guarantees for service availability.
2022-04-01 17:13:47 +02:00
The testnet runs the very latest version of Reticulum (often even a short while before it is publicly released). Sometimes experimental versions of Reticulum might be deployed to nodes on the testnet, which means strange behaviour might occur. If none of that scares you, you can join the testnet via eihter TCP or I2P. Just add one of the following interfaces to your Reticulum configuration file:
2022-04-01 17:11:52 +02:00
```
2022-07-01 21:13:55 +02:00
# For connecting over TCP/IP on v0.3.8:
2022-04-01 17:11:52 +02:00
[[RNS Testnet Frankfurt]]
type = TCPClientInterface
interface_enabled = yes
outgoing = True
target_host = frankfurt.rns.unsigned.io
target_port = 4965
2022-07-01 21:13:55 +02:00
# For connecting over I2P on v0.3.8:
2022-04-01 17:11:52 +02:00
[[RNS Testnet I2P Node A]]
type = I2PInterface
interface_enabled = yes
peers = ykzlw5ujbaqc2xkec4cpvgyxj257wcrmmgkuxqmqcur7cq3w3lha.b32.i2p
2022-07-01 21:13:55 +02:00
# For connecting over TCP/IP on v0.3.9+:
[[RNS Testnet Dublin]]
type = TCPClientInterface
enabled = yes
target_host = dublin.connect.reticulum.network
target_port = 4965
# For connecting over I2P on v0.3.9+:
[[RNS Testnet I2P Hub A]]
type = I2PInterface
enabled = yes
peers = uxg5kubabakh3jtnvsipingbr5574dle7bubvip7llfvwx2tgrua.b32.i2p
2022-04-01 17:11:52 +02:00
```
The testnet also contains a number of [Nomad Network](https://github.com/markqvist/nomadnet) nodes, and LXMF propagation nodes.
2021-10-11 15:26:21 +02:00
## Support Reticulum
2021-10-11 15:26:07 +02:00
You can help support the continued development of open, free and private communications systems by donating via one of the following channels:
2022-06-10 12:19:31 +02:00
- Monero:
```
84FpY1QbxHcgdseePYNmhTHcrgMX4nFf
BYtz2GKYToqHVVhJp8Eaw1Z1EedRnKD1
9b3B8NiLCGVxzKV17UMmmeEsCrPyA5w
```
- Ethereum
```
0x81F7B979fEa6134bA9FD5c701b3501A2e61E897a
```
- Bitcoin
```
3CPmacGm34qYvR6XWLVEJmi2aNe3PZqUuq
```
2021-10-11 15:26:07 +02:00
- Ko-Fi: https://ko-fi.com/markqvist
2022-03-25 20:15:11 +01:00
Are certain features in the development roadmap are important to you or your organisation? Make them a reality quickly by sponsoring their implementation.
2022-06-10 11:26:46 +02:00
## Cryptographic Primitives
2022-07-01 17:30:51 +02:00
Reticulum has been uses a simple suite of efficient, strong and modern cryptographic primitives, with widely available implementations that can be used both on general-purpose CPUs and on microcontrollers. The necessary primitives are:
2022-06-10 11:26:46 +02:00
- Ed25519 for signatures
- X22519 for ECDH key exchanges
- HKDF for key derivation
2022-06-30 19:31:13 +02:00
- Modified Fernet for encrypted tokens
2022-06-10 11:26:46 +02:00
- AES-128 in CBC mode
- HMAC for message authentication
2022-06-30 19:31:13 +02:00
- No Fernet version and timestamp fields
2022-06-10 11:26:46 +02:00
- SHA-256
- SHA-512
2022-06-10 11:45:40 +02:00
In the default installation configuration, the `X25519`, `Ed25519` and `AES-128-CBC` primitives are provided by [OpenSSL](https://www.openssl.org/) (via the [PyCA/cryptography](https://github.com/pyca/cryptography) package). The hashing functions `SHA-256` and `SHA-512` are provided by the standard Python [hashlib](https://docs.python.org/3/library/hashlib.html). The `HKDF`, `HMAC`, `Fernet` primitives, and the `PKCS7` padding function are always provided by the following internal implementations:
- [HKDF.py](RNS/Cryptography/HKDF.py)
- [HMAC.py](RNS/Cryptography/HMAC.py)
- [Fernet.py](RNS/Cryptography/Fernet.py)
- [PKCS7.py](RNS/Cryptography/PKCS7.py)
2022-06-10 11:26:46 +02:00
2022-06-16 19:58:34 +02:00
Reticulum also includes a complete implementation of all necessary primitives in pure Python. If OpenSSL & PyCA are not available on the system when Reticulum is started, Reticulum will instead use the internal pure-python primitives. A trivial consequence of this is performance, with the OpenSSL backend being *much* faster. The most important consequence however, is the potential loss of security by using primitives that has not seen the same amount of scrutiny, testing and review as those from OpenSSL.
2022-06-10 11:32:57 +02:00
2022-06-13 17:28:03 +02:00
If you want to use the internal pure-python primitives, it is **highly advisable** that you have a good understanding of the risks that this pose, and make an informed decision on whether those risks are acceptable to you.
2022-06-10 11:26:46 +02:00
2022-06-10 12:13:36 +02:00
Reticulum is relatively young software, and should be considered as such. While it has been built with cryptography best-practices very foremost in mind, it _has not_ been externally security audited, and there could very well be privacy or security breaking bugs. If you want to help out, or help sponsor an audit, please do get in touch.
2022-06-10 12:11:43 +02:00
## Acknowledgements & Credits
2022-06-13 17:25:13 +02:00
Reticulum can only exist because of the mountain of Open Source work it was built on top of, the contributions of everyone involved, and everyone that has supported the project through the years. To everyone who has helped, thank you so much.
2022-06-10 12:11:43 +02:00
A number of other modules and projects are either part of, or used by Reticulum. Sincere thanks to the authors and contributors of the following projects:
- [PyCA/cryptography](https://github.com/pyca/cryptography), *BSD License*
- [Pure-25519](https://github.com/warner/python-pure25519) by [Brian Warner](https://github.com/warner), *MIT License*
- [Pysha2](https://github.com/thomdixon/pysha2) by [Thom Dixon](https://github.com/thomdixon), *MIT License*
- [Python-AES](https://github.com/orgurar/python-aes) by [Or Gur Arie](https://github.com/orgurar), *MIT License*
- [Curve25519.py](https://gist.github.com/nickovs/cc3c22d15f239a2640c185035c06f8a3#file-curve25519-py) by [Nicko van Someren](https://gist.github.com/nickovs), *Public Domain*
2022-06-10 12:12:26 +02:00
- [I2Plib](https://github.com/l-n-s/i2plib) by [Viktor Villainov](https://github.com/l-n-s)
2022-06-13 17:24:35 +02:00
- [PySerial](https://github.com/pyserial/pyserial) by Chris Liechti, *BSD License*
- [Netifaces](https://github.com/al45tair/netifaces) by [Alastair Houghton](https://github.com/al45tair), *MIT License*
- [Configobj](https://github.com/DiffSK/configobj) by Michael Foord, Nicola Larosa, Rob Dennis & Eli Courtwright, *BSD License*
2022-06-10 12:11:43 +02:00
- [Six](https://github.com/benjaminp/six) by [Benjamin Peterson](https://github.com/benjaminp), *MIT License*
- [Umsgpack.py](https://github.com/vsergeev/u-msgpack-python) by [Ivan A. Sergeev](https://github.com/vsergeev)
2022-06-10 12:13:03 +02:00
- [Python](https://www.python.org)