mediamtx/README.md

945 lines
33 KiB
Markdown
Raw Normal View History

2019-12-28 21:07:03 +00:00
2021-09-07 10:16:42 +00:00
<p align="center">
2021-02-14 21:50:04 +00:00
<img src="logo.png" alt="rtsp-simple-server">
2021-09-07 10:16:42 +00:00
</p>
2019-12-28 21:12:11 +00:00
2021-09-05 15:35:04 +00:00
_rtsp-simple-server_ is a ready-to-use and zero-dependency server and proxy that allows users to publish, read and proxy live video and audio streams through various protocols:
2021-05-09 16:13:10 +00:00
2022-08-16 11:53:04 +00:00
|protocol|description|variants|publish|read|proxy|
|--------|-----------|--------|-------|----|-----|
|RTSP|fastest way to publish and read streams|RTSP, RTSPS|:heavy_check_mark:|:heavy_check_mark:|:heavy_check_mark:|
|RTMP|allows to interact with legacy software|RTMP, RTMPS|:heavy_check_mark:|:heavy_check_mark:|:heavy_check_mark:|
|HLS|allows to embed streams into a web page|Low-Latency HLS, standard HLS|:x:|:heavy_check_mark:|:heavy_check_mark:|
2019-12-28 21:07:03 +00:00
2019-12-28 22:46:32 +00:00
Features:
2020-11-15 09:29:04 +00:00
2021-09-07 10:16:42 +00:00
* Publish live streams to the server
* Read live streams from the server
* Proxy streams from other servers or cameras, always or on-demand
* Each stream can have multiple video and audio tracks, encoded with any RTP-compatible codec, including H264, H265, VP8, VP9, MPEG2, MP3, AAC, Opus, PCM, JPEG
2021-09-05 15:35:04 +00:00
* Streams are automatically converted from a protocol to another. For instance, it's possible to publish a stream with RTSP and read it with HLS
2020-10-28 21:58:04 +00:00
* Serve multiple streams at once in separate paths
* Authenticate users; use internal or external authentication
* Redirect readers to other RTSP servers (load balancing)
* Query and control the server through an HTTP API
* Reload the configuration without disconnecting existing clients (hot reloading)
2021-10-31 13:30:33 +00:00
* Read Prometheus-compatible metrics
* Run external commands when clients connect, disconnect, read or publish streams
* Natively compatible with the Raspberry Pi Camera
2021-12-08 17:18:38 +00:00
* Compatible with Linux, Windows and macOS, does not require any dependency or interpreter, it's a single executable
2019-12-28 21:07:03 +00:00
2021-09-07 10:16:42 +00:00
[![Test](https://github.com/aler9/rtsp-simple-server/workflows/test/badge.svg)](https://github.com/aler9/rtsp-simple-server/actions?query=workflow:test)
[![Lint](https://github.com/aler9/rtsp-simple-server/workflows/lint/badge.svg)](https://github.com/aler9/rtsp-simple-server/actions?query=workflow:lint)
[![CodeCov](https://codecov.io/gh/aler9/rtsp-simple-server/branch/main/graph/badge.svg)](https://codecov.io/gh/aler9/rtsp-simple-server/branch/main)
[![Release](https://img.shields.io/github/v/release/aler9/rtsp-simple-server)](https://github.com/aler9/rtsp-simple-server/releases)
[![Docker Hub](https://img.shields.io/badge/docker-aler9/rtsp--simple--server-blue)](https://hub.docker.com/r/aler9/rtsp-simple-server)
[![API Documentation](https://img.shields.io/badge/api-documentation-blue)](https://aler9.github.io/rtsp-simple-server)
2020-12-12 22:48:06 +00:00
## Table of contents
* [Installation](#installation)
* [Standard](#standard)
* [Docker](#docker)
* [Basic usage](#basic-usage)
2021-12-06 15:27:20 +00:00
* [General](#general)
2020-12-12 22:48:06 +00:00
* [Configuration](#configuration)
2020-12-31 18:47:25 +00:00
* [Authentication](#authentication)
* [Encrypt the configuration](#encrypt-the-configuration)
2021-03-19 22:08:47 +00:00
* [Proxy mode](#proxy-mode)
2020-12-12 22:48:06 +00:00
* [Remuxing, re-encoding, compression](#remuxing-re-encoding-compression)
* [Save streams to disk](#save-streams-to-disk)
2020-12-12 22:48:06 +00:00
* [On-demand publishing](#on-demand-publishing)
2022-02-16 17:50:04 +00:00
* [Start on boot](#start-on-boot)
* [Linux](#linux)
* [Windows](#windows)
* [HTTP API](#http-api)
* [Metrics](#metrics)
2021-08-12 09:50:39 +00:00
* [pprof](#pprof)
2020-12-12 22:48:06 +00:00
* [Compile and run from source](#compile-and-run-from-source)
* [Publish to the server](#publish-to-the-server)
2021-12-05 10:05:50 +00:00
* [From a webcam](#from-a-webcam)
* [From a Raspberry Pi Camera](#from-a-raspberry-pi-camera)
* [From OBS Studio](#from-obs-studio)
* [From OpenCV](#from-opencv)
2022-05-04 07:43:01 +00:00
* [Read from the server](#read-from-the-server)
* [From VLC and Ubuntu](#from-vlc-and-ubuntu)
2021-12-06 15:27:20 +00:00
* [RTSP protocol](#rtsp-protocol)
2022-08-16 11:53:04 +00:00
* [General usage](#general-usage)
2021-11-01 09:49:17 +00:00
* [TCP transport](#tcp-transport)
* [UDP-multicast transport](#udp-multicast-transport)
2021-10-22 17:33:44 +00:00
* [Encryption](#encryption)
* [Redirect to another server](#redirect-to-another-server)
* [Fallback stream](#fallback-stream)
* [Corrupted frames](#corrupted-frames)
2021-12-06 15:27:20 +00:00
* [RTMP protocol](#rtmp-protocol)
2022-08-16 11:53:04 +00:00
* [General usage](#general-usage-1)
* [Encryption](#encryption-1)
2021-12-06 15:27:20 +00:00
* [HLS protocol](#hls-protocol)
2022-08-16 11:53:04 +00:00
* [General usage](#general-usage-2)
2022-05-16 12:32:52 +00:00
* [Embedding](#embedding)
Implement Low-Latency HLS (#938) * add hlsVariant parameter * hls: split muxer into variants * hls: implement fmp4 segments * hls muxer: implement low latency mode * hls muxer: support audio with fmp4 mode * hls muxer: rewrite file router * hls muxer: implement preload hint * hls muxer: add various error codes * hls muxer: use explicit flags * hls muxer: fix error in aac pts * hls muxer: fix sudden freezes with video+audio * hls muxer: skip empty parts * hls muxer: fix video FPS * hls muxer: add parameter hlsPartDuration * hls muxer: refactor fmp4 muxer * hls muxer: fix CAN-SKIP-UNTIL * hls muxer: refactor code * hls muxer: show only parts of last 2 segments * hls muxer: implementa playlist delta updates * hls muxer: change playlist content type * hls muxer: improve video dts precision * hls muxer: fix video sample flags * hls muxer: improve iphone audio support * hls muxer: improve mp4 timestamp precision * hls muxer: add offset between pts and dts * hls muxer: close muxer in case of error * hls muxer: stop logging requests with the info level * hls muxer: rename entry into sample * hls muxer: compensate video dts error over time * hls muxer: change default segment count * hls muxer: add starting gap * hls muxer: set default part duration to 200ms * hls muxer: fix audio-only streams on ios * hls muxer: add playsinline attribute to video tag of default web page * hls muxer: keep mpegts as the default hls variant * hls muxer: implement encryption * hls muxer: rewrite dts estimation * hls muxer: improve DTS precision * hls muxer: use right SPS/PPS for each sample * hls muxer: adjust part duration dynamically * add comments * update readme * hls muxer: fix memory leak * hls muxer: decrease ram consumption
2022-05-31 17:17:26 +00:00
* [Low-Latency variant](#low-latency-variant)
* [Decreasing latency](#decreasing-latency)
2020-12-12 22:48:06 +00:00
* [Links](#links)
## Installation
### Standard
2019-12-28 21:07:03 +00:00
1. Download and extract a precompiled binary from the [release page](https://github.com/aler9/rtsp-simple-server/releases).
2019-12-28 21:07:03 +00:00
2020-06-14 15:54:52 +00:00
2. Start the server:
2020-11-15 09:29:04 +00:00
2019-12-28 21:07:03 +00:00
```
./rtsp-simple-server
```
2020-12-12 22:48:06 +00:00
### Docker
Download and launch the image:
```
docker run --rm -it --network=host aler9/rtsp-simple-server
```
2021-11-01 09:49:17 +00:00
The `--network=host` flag is mandatory since Docker can change the source port of UDP packets for routing reasons, and this doesn't allow the server to find out the author of the packets. This issue can be avoided by disabling the UDP transport protocol:
2020-12-12 22:48:06 +00:00
```
2021-11-01 09:49:17 +00:00
docker run --rm -it -e RTSP_PROTOCOLS=tcp -p 8554:8554 -p 1935:1935 -p 8888:8888 aler9/rtsp-simple-server
2020-12-12 22:48:06 +00:00
```
Please keep in mind that the Docker image doesn't include _FFmpeg_. if you need to use _FFmpeg_ for an external command or anything else, you need to build a Docker image that contains both _rtsp-simple-server_ and _FFmpeg_, by following instructions [here](https://github.com/aler9/rtsp-simple-server/discussions/278#discussioncomment-549104).
2021-10-06 13:21:57 +00:00
2020-12-12 22:48:06 +00:00
## Basic usage
1. Publish a stream. For instance, you can publish a video/audio file with _FFmpeg_:
2020-11-15 09:29:04 +00:00
2019-12-28 21:07:03 +00:00
```
2019-12-31 13:55:46 +00:00
ffmpeg -re -stream_loop -1 -i file.ts -c copy -f rtsp rtsp://localhost:8554/mystream
2019-12-28 21:07:03 +00:00
```
or _GStreamer_:
2020-11-15 09:29:04 +00:00
```
gst-launch-1.0 rtspclientsink name=s location=rtsp://localhost:8554/mystream filesrc location=file.mp4 ! qtdemux name=d d.video_0 ! queue ! s.sink_0 d.audio_0 ! queue ! s.sink_1
```
To publish from other hardware / software, take a look at the [Publish to the server](#publish-to-the-server) section.
2020-12-12 22:48:06 +00:00
2. Open the stream. For instance, you can open the stream with _VLC_:
2020-11-15 09:29:04 +00:00
2019-12-28 21:07:03 +00:00
```
2019-12-31 13:55:46 +00:00
vlc rtsp://localhost:8554/mystream
2019-12-28 21:07:03 +00:00
```
2020-06-08 12:19:49 +00:00
or _GStreamer_:
2020-11-15 09:29:04 +00:00
2019-12-28 21:07:03 +00:00
```
gst-play-1.0 rtsp://localhost:8554/mystream
2019-12-28 21:07:03 +00:00
```
2020-06-08 12:19:49 +00:00
or _FFmpeg_:
2020-11-15 09:29:04 +00:00
2020-06-08 12:19:49 +00:00
```
ffmpeg -i rtsp://localhost:8554/mystream -c copy output.mp4
```
2021-12-06 15:27:20 +00:00
## General
2020-06-14 15:54:52 +00:00
2020-10-07 19:06:27 +00:00
### Configuration
2020-12-13 22:43:31 +00:00
All the configuration parameters are listed and commented in the [configuration file](rtsp-simple-server.yml).
2020-11-15 09:29:04 +00:00
2021-09-05 15:35:04 +00:00
There are 3 ways to change the configuration:
2021-09-05 15:35:04 +00:00
1. By editing the `rtsp-simple-server.yml` file, that is
2020-11-15 09:29:04 +00:00
2021-09-05 15:35:04 +00:00
* included into the release bundle
* available in the root folder of the Docker image (`/rtsp-simple-server.yml`); it can be overridden in this way:
2021-09-05 15:35:04 +00:00
```
docker run --rm -it --network=host -v $PWD/rtsp-simple-server.yml:/rtsp-simple-server.yml aler9/rtsp-simple-server
```
2020-12-13 22:43:31 +00:00
2022-06-25 18:02:34 +00:00
The configuration can be changed dynamically when the server is running (hot reloading) by writing to the configuration file. Changes are detected and applied without disconnecting existing clients, whenever it's possible.
2021-09-05 15:35:04 +00:00
2. By overriding configuration parameters with environment variables, in the format `RTSP_PARAMNAME`, where `PARAMNAME` is the uppercase name of a parameter. For instance, the `rtspAddress` parameter can be overridden in the following way:
2020-12-13 22:43:31 +00:00
```
RTSP_RTSPADDRESS="127.0.0.1:8554" ./rtsp-simple-server
2020-12-13 22:43:31 +00:00
```
2022-08-03 07:58:26 +00:00
Parameters that have array as value can be overriden by setting a comma-separated list. For example:
```
RTSP_PROTOCOLS="tcp,udp"
```
2020-12-13 22:43:31 +00:00
Parameters in maps can be overridden by using underscores, in the following way:
```
RTSP_PATHS_TEST_SOURCE=rtsp://myurl ./rtsp-simple-server
```
This method is particularly useful when using Docker; any configuration parameter can be changed by passing environment variables with the `-e` flag:
2020-12-13 22:43:31 +00:00
```
docker run --rm -it --network=host -e RTSP_PATHS_TEST_SOURCE=rtsp://myurl aler9/rtsp-simple-server
```
2021-09-05 15:35:04 +00:00
3. By using the [HTTP API](#http-api).
2020-12-13 22:43:31 +00:00
2020-12-31 18:47:25 +00:00
### Authentication
Edit `rtsp-simple-server.yml` and replace everything inside section `paths` with the following content:
```yml
paths:
all:
2021-01-31 20:58:59 +00:00
publishUser: myuser
publishPass: mypass
2020-12-31 18:47:25 +00:00
```
Only publishers that provide both username and password will be able to proceed:
```
2021-01-31 20:58:59 +00:00
ffmpeg -re -stream_loop -1 -i file.ts -c copy -f rtsp rtsp://myuser:mypass@localhost:8554/mystream
2020-12-31 18:47:25 +00:00
```
It's possible to setup authentication for readers too:
```yml
paths:
all:
2021-01-31 20:58:59 +00:00
publishUser: myuser
2020-12-31 18:47:25 +00:00
publishPass: mypass
readUser: user
readPass: userpass
```
If storing plain credentials in the configuration file is a security problem, username and passwords can be stored as sha256-hashed strings; a string must be hashed with sha256 and encoded with base64:
2020-12-31 18:47:25 +00:00
```
echo -n "userpass" | openssl dgst -binary -sha256 | openssl base64
```
Then stored with the `sha256:` prefix:
```yml
paths:
all:
readUser: sha256:j1tsRqDEw9xvq/D7/9tMx6Jh/jMhk3UfjwIB2f1zgMo=
readPass: sha256:BdSWkrdV+ZxFBLUQQY7+7uv9RmiSVA8nrPmjGjJtZQQ=
```
**WARNING**: enable encryption or use a VPN to ensure that no one is intercepting the credentials.
2020-12-31 18:47:25 +00:00
2021-12-22 18:15:33 +00:00
Authentication can be delegated to an external HTTP server:
```yml
externalAuthenticationURL: http://myauthserver/auth
```
Each time a user needs to be authenticated, the specified URL will be requested with the POST method and this payload:
```json
{
"ip": "ip",
"user": "user",
"password": "password",
"path": "path",
"action": "read|publish"
}
```
If the URL returns a status code that begins with `20` (i.e. `200`), authentication is successful, otherwise it fails.
2022-06-21 08:11:41 +00:00
Please be aware that it's perfectly normal for the authentication server to receive requests with empty users and passwords, i.e.:
```json
{
"user": "",
"password": "",
}
```
This happens because a RTSP client doesn't provide credentials until it is asked to. In order to receive the credentials, the authentication server must reply with status code `401` - the client will then send credentials.
### Encrypt the configuration
The configuration file can be entirely encrypted for security purposes.
An online encryption tool is [available here](https://play.golang.org/p/rX29jwObNe4).
The encryption procedure is the following:
1. NaCL's `crypto_secretbox` function is applied to the content of the configuration. NaCL is a cryptographic library available for [C/C++](https://nacl.cr.yp.to/secretbox.html), [Go](https://pkg.go.dev/golang.org/x/crypto/nacl/secretbox), [C#](https://github.com/somdoron/NaCl.net) and many other languages;
2. The string is prefixed with the nonce;
3. The string is encoded with base64.
2021-10-31 13:30:33 +00:00
After performing the encryption, put the base64-encoded result into the configuration file, and launch the server with the `RTSP_CONFKEY` variable:
```
RTSP_CONFKEY=mykey ./rtsp-simple-server
```
2021-03-19 22:08:47 +00:00
### Proxy mode
2021-09-05 15:35:04 +00:00
_rtsp-simple-server_ is also a proxy, that is usually deployed in one of these scenarios:
2020-11-15 09:29:04 +00:00
2021-10-22 17:33:44 +00:00
* when there are multiple users that are reading a stream and the bandwidth is limited; the proxy is used to receive the stream once. Users can then connect to the proxy instead of the original source.
2020-09-28 12:14:11 +00:00
* when there's a NAT / firewall between a stream and the users; the proxy is installed on the NAT and makes the stream available to the outside world.
Edit `rtsp-simple-server.yml` and replace everything inside section `paths` with the following content:
2020-11-15 09:29:04 +00:00
2020-11-01 22:19:58 +00:00
```yml
2020-06-27 19:22:50 +00:00
paths:
proxied:
# url of the source stream, in the format rtsp://user:pass@host:port/path
source: rtsp://original-url
```
2020-06-27 19:22:50 +00:00
2020-12-06 18:45:16 +00:00
After starting the server, users can connect to `rtsp://localhost:8554/proxied`, instead of connecting to the original url. The server supports any number of source streams, it's enough to add additional entries to the `paths` section:
```yml
paths:
proxied1:
source: rtsp://url1
proxied2:
source: rtsp://url1
```
2020-11-01 22:19:58 +00:00
It's possible to save bandwidth by enabling the on-demand mode: the stream will be pulled only when at least a client is connected:
2020-11-15 09:29:04 +00:00
2020-11-01 22:19:58 +00:00
```yml
paths:
proxied:
source: rtsp://original-url
sourceOnDemand: yes
```
2020-08-17 17:12:07 +00:00
### Remuxing, re-encoding, compression
2020-07-19 13:41:24 +00:00
2022-03-15 10:43:53 +00:00
To change the format, codec or compression of a stream, use _FFmpeg_ or _GStreamer_ together with _rtsp-simple-server_. For instance, to re-encode an existing stream, that is available in the `/original` path, and publish the resulting stream in the `/compressed` path, edit `rtsp-simple-server.yml` and replace everything inside section `paths` with the following content:
2020-11-15 09:29:04 +00:00
2020-11-01 22:19:58 +00:00
```yml
2020-07-19 13:41:24 +00:00
paths:
all:
original:
2022-02-19 10:59:39 +00:00
runOnReady: ffmpeg -i rtsp://localhost:$RTSP_PORT/$RTSP_PATH -pix_fmt yuv420p -c:v libx264 -preset ultrafast -b:v 600k -max_muxing_queue_size 1024 -f rtsp rtsp://localhost:$RTSP_PORT/compressed
runOnReadyRestart: yes
2020-07-19 13:41:24 +00:00
```
### Save streams to disk
2021-09-05 16:11:02 +00:00
To save available streams to disk, you can use the `runOnReady` parameter and _FFmpeg_:
2021-09-05 16:11:02 +00:00
```yml
paths:
all:
original:
2022-06-23 21:04:01 +00:00
runOnReady: ffmpeg -i rtsp://localhost:$RTSP_PORT/$RTSP_PATH -c copy -f segment -strftime 1 -segment_time 60 -segment_format mpegts saved_%Y-%m-%d_%H-%M-%S.ts
runOnReadyRestart: yes
2021-09-05 16:11:02 +00:00
```
2022-06-23 21:04:01 +00:00
In the example configuration, streams are saved into TS files, that can be read even if the system crashes, while MP4 files can't.
2020-11-19 20:57:15 +00:00
### On-demand publishing
Edit `rtsp-simple-server.yml` and replace everything inside section `paths` with the following content:
```yml
paths:
ondemand:
runOnDemand: ffmpeg -re -stream_loop -1 -i file.ts -c copy -f rtsp rtsp://localhost:$RTSP_PORT/$RTSP_PATH
runOnDemandRestart: yes
```
The command inserted into `runOnDemand` will start only when a client requests the path `ondemand`, therefore the file will start streaming only when requested.
2022-02-16 17:50:04 +00:00
### Start on boot
#### Linux
Systemd is the service manager used by Ubuntu, Debian and many other Linux distributions, and allows to launch _rtsp-simple-server_ on boot.
2020-12-03 15:17:18 +00:00
Download a release bundle from the [release page](https://github.com/aler9/rtsp-simple-server/releases), unzip it, and move the executable and configuration in the system:
2020-11-15 09:29:04 +00:00
2020-12-03 15:17:18 +00:00
```
sudo mv rtsp-simple-server /usr/local/bin/
sudo mv rtsp-simple-server.yml /usr/local/etc/
```
2020-12-03 15:17:18 +00:00
Create the service:
2020-11-15 09:29:04 +00:00
```
2020-12-03 15:17:18 +00:00
sudo tee /etc/systemd/system/rtsp-simple-server.service >/dev/null << EOF
[Unit]
Wants=network.target
[Service]
ExecStart=/usr/local/bin/rtsp-simple-server /usr/local/etc/rtsp-simple-server.yml
[Install]
WantedBy=multi-user.target
2020-12-03 15:17:18 +00:00
EOF
```
2020-12-03 15:17:18 +00:00
Enable and start the service:
2020-11-15 09:29:04 +00:00
```
2020-12-03 15:17:18 +00:00
sudo systemctl enable rtsp-simple-server
sudo systemctl start rtsp-simple-server
```
2022-02-16 17:50:04 +00:00
#### Windows
Download the [WinSW v2 executable](https://github.com/winsw/winsw/releases/download/v2.11.0/WinSW-x64.exe) and place it into the same folder of `rtsp-simple-server.exe`.
In the same folder, create a file named `WinSW-x64.xml` with this content:
```xml
<service>
<id>rtsp-simple-server</id>
<name>rtsp-simple-server</name>
<description></description>
<executable>%BASE%/rtsp-simple-server.exe</executable>
</service>
```
Open a terminal, navigate to the folder and run:
```
WinSW-x64 install
```
The server is now installed as a system service and will start at boot time.
### HTTP API
2021-08-07 17:31:09 +00:00
The server can be queried and controlled with an HTTP API, that must be enabled by setting the `api` parameter in the configuration:
2021-08-07 17:31:09 +00:00
```yml
api: yes
```
2020-07-30 15:30:50 +00:00
The API listens on `apiAddress`, that by default is `127.0.0.1:9997`; for instance, to obtain a list of active paths, run:
2020-11-15 09:29:04 +00:00
```
curl http://127.0.0.1:9997/v1/paths/list
```
2020-11-15 09:29:04 +00:00
Full documentation of the API is available on the [dedicated site](https://aler9.github.io/rtsp-simple-server/).
2020-11-15 09:29:04 +00:00
### Metrics
2020-07-30 15:30:50 +00:00
A metrics exporter, compatible with Prometheus, can be enabled with the parameter `metrics: yes`; then the server can be queried for metrics with Prometheus or with a simple HTTP request:
2020-11-15 09:29:04 +00:00
```
wget -qO- localhost:9998/metrics
```
2020-09-19 21:39:41 +00:00
Obtaining:
2020-11-15 09:29:04 +00:00
```
2021-10-11 22:00:56 +00:00
paths{name="<path_name>",state="ready"} 1
rtsp_sessions{state="idle"} 0
rtsp_sessions{state="read"} 0
rtsp_sessions{state="publish"} 1
rtsps_sessions{state="idle"} 0
rtsps_sessions{state="read"} 0
rtsps_sessions{state="publish"} 0
rtmp_conns{state="idle"} 0
rtmp_conns{state="read"} 0
rtmp_conns{state="publish"} 1
2021-11-05 16:29:13 +00:00
hls_muxers{name="<name>"} 1
```
2020-06-27 20:16:43 +00:00
where:
2021-11-02 13:01:13 +00:00
* `paths{name="<path_name>",state="ready"} 1` is replicated for every path and shows the name and state of every path
* `rtsp_sessions{state="idle"}` is the count of RTSP sessions that are idle
* `rtsp_sessions{state="read"}` is the count of RTSP sessions that are reading
* `rtsp_sessions{state="publish"}` is the counf ot RTSP sessions that are publishing
* `rtsps_sessions{state="idle"}` is the count of RTSPS sessions that are idle
* `rtsps_sessions{state="read"}` is the count of RTSPS sessions that are reading
* `rtsps_sessions{state="publish"}` is the counf ot RTSPS sessions that are publishing
* `rtmp_conns{state="idle"}` is the count of RTMP connections that are idle
* `rtmp_conns{state="read"}` is the count of RTMP connections that are reading
* `rtmp_conns{state="publish"}` is the count of RTMP connections that are publishing
2021-11-05 16:29:13 +00:00
* `hls_muxers{name="<name>"}` is replicated for every HLS muxer and shows the name and state of every HLS muxer
2021-08-12 09:50:39 +00:00
### pprof
A performance monitor, compatible with pprof, can be enabled with the parameter `pprof: yes`; then the server can be queried for metrics with pprof-compatible tools, like:
```
go tool pprof -text http://localhost:9999/debug/pprof/goroutine
go tool pprof -text http://localhost:9999/debug/pprof/heap
go tool pprof -text http://localhost:9999/debug/pprof/profile?seconds=30
```
2021-10-22 17:33:44 +00:00
### Compile and run from source
2022-09-17 18:18:07 +00:00
Install Go 1.18, download the repository, open a terminal in it and run:
2021-10-22 17:33:44 +00:00
```
go run .
```
You can perform the entire operation inside Docker:
```
make run
```
## Publish to the server
2021-12-05 10:05:50 +00:00
### From a webcam
To publish the video stream of a generic webcam to the server, edit `rtsp-simple-server.yml` and replace everything inside section `paths` with the following content:
```yml
paths:
cam:
2022-02-19 10:59:39 +00:00
runOnInit: ffmpeg -f v4l2 -i /dev/video0 -pix_fmt yuv420p -preset ultrafast -b:v 600k -f rtsp rtsp://localhost:$RTSP_PORT/$RTSP_PATH
runOnInitRestart: yes
```
If the platform is Windows:
```yml
paths:
cam:
2022-02-19 10:59:39 +00:00
runOnInit: ffmpeg -f dshow -i video="USB2.0 HD UVC WebCam" -pix_fmt yuv420p -c:v libx264 -preset ultrafast -b:v 600k -f rtsp rtsp://localhost:$RTSP_PORT/$RTSP_PATH
runOnInitRestart: yes
```
Where `USB2.0 HD UVC WebCam` is the name of your webcam, that can be obtained with:
```
ffmpeg -list_devices true -f dshow -i dummy
```
After starting the server, the webcam can be reached on `rtsp://localhost:8554/cam`.
2021-12-05 10:05:50 +00:00
### From a Raspberry Pi Camera
_rtsp-simple-server_ natively support the Raspberry Pi Camera, enabling high-quality and low-latency video streaming from the camera to any user. To make the video stream of a Raspberry Pi Camera available on the server:
1. The server must be installed on a Raspberry Pi, with Raspberry Pi OS bullseye or newer as operative system, and must be installed by using the standard method (Docker is not actually supported). If you're using the 64-bit version of the operative system, you need to pick the `arm64` variant of the server.
2. Make sure that the legacy camera stack is disabled. Type:
```
sudo raspi-config
```
Then go to `Interfacing options`, `enable/disable legacy camera support`, choose `no`. Reboot the system.
3. edit `rtsp-simple-server.yml` and replace everything inside section `paths` with the following content:
```yml
paths:
cam:
source: rpiCamera
```
After starting the server, the camera can be reached on `rtsp://raspberry-pi:8554/cam` or `http://raspberry-pi:8888/cam`.
2022-08-27 16:36:16 +00:00
Camera settings can be changed by using the `rpiCamera*` parameters:
```yml
paths:
cam:
source: rpiCamera
rpiCameraWidth: 1920
rpiCameraHeight: 1080
```
All available parameters are listed in the [sample configuration file](https://github.com/aler9/rtsp-simple-server/blob/master/rtsp-simple-server.yml#L230).
2022-08-27 16:36:16 +00:00
2021-12-05 10:05:50 +00:00
### From OBS Studio
OBS Studio can publish to the server by using the RTMP protocol. In `Settings -> Stream` (or in the Auto-configuration Wizard), use the following parameters:
* Service: `Custom...`
* Server: `rtmp://localhost`
* Stream key: `mystream`
If credentials are in use, use the following parameters:
* Service: `Custom...`
* Server: `rtmp://localhost`
* Stream key: `mystream?user=myuser&pass=mypass`
2021-12-05 10:05:50 +00:00
### From OpenCV
2021-11-26 14:44:41 +00:00
To publish a video stream from OpenCV to the server, OpenCV must be compiled with GStreamer support, by following this procedure:
```
2022-04-21 16:25:11 +00:00
sudo apt install -y libgstreamer1.0-dev libgstreamer-plugins-base1.0-dev gstreamer1.0-plugins-ugly gstreamer1.0-rtsp python3-dev python3-numpy
2021-11-26 14:44:41 +00:00
git clone --depth=1 -b 4.5.4 https://github.com/opencv/opencv
cd opencv
mkdir build && cd build
2022-04-21 16:25:11 +00:00
cmake -D CMAKE_INSTALL_PREFIX=/usr -D WITH_GSTREAMER=ON ..
2021-11-26 14:44:41 +00:00
make -j$(nproc)
sudo make install
```
2022-08-16 11:53:04 +00:00
Videos can be published with `VideoWriter`:
2021-11-26 14:44:41 +00:00
```python
import cv2
import numpy as np
from time import sleep
fps = 20
width = 800
height = 600
out = cv2.VideoWriter('appsrc ! videoconvert' + \
2022-04-21 16:25:11 +00:00
' ! x264enc speed-preset=ultrafast bitrate=600 key-int-max=40' + \
2021-11-26 14:44:41 +00:00
' ! rtspclientsink location=rtsp://localhost:8554/mystream',
cv2.CAP_GSTREAMER, 0, fps, (width, height), True)
if not out.isOpened():
raise Exception("can't open video writer")
while True:
frame = np.zeros((height, width, 3), np.uint8)
# create a red rectangle
for y in range(0, int(frame.shape[0] / 2)):
for x in range(0, int(frame.shape[1] / 2)):
frame[y][x] = (0, 0, 255)
out.write(frame)
print("frame written to the server")
sleep(1 / fps)
```
2022-05-04 07:43:01 +00:00
## Read from the server
### From VLC and Ubuntu
2022-05-04 07:50:05 +00:00
The VLC shipped with Ubuntu 21.10 doesn't support playing RTSP due to a license issue (see [here](https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=982299) and [here](https://stackoverflow.com/questions/69766748/cvlc-cannot-play-rtsp-omxplayer-instead-can)).
2022-05-04 07:43:01 +00:00
To overcome the issue, remove the default VLC instance and install the snap version:
```
sudo apt purge -y vlc
snap install vlc
```
Then use it to read the stream:
```
vlc rtsp://localhost:8554/mystream
```
2021-12-06 15:27:20 +00:00
## RTSP protocol
2021-10-22 17:33:44 +00:00
2022-08-16 11:53:04 +00:00
### General usage
2019-12-28 21:07:03 +00:00
2021-11-01 09:49:17 +00:00
RTSP is a standardized protocol that allows to publish and read streams; in particular, it supports different underlying transport protocols, that are chosen by clients during the handshake with the server:
2021-10-22 17:33:44 +00:00
2021-11-01 09:49:17 +00:00
* UDP: the most performant, but doesn't work when there's a NAT/firewall between server and clients. It doesn't support encryption.
* UDP-multicast: allows to save bandwidth when clients are all in the same LAN, by sending packets once to a fixed multicast IP. It doesn't support encryption.
2021-10-22 17:33:44 +00:00
* TCP: the most versatile, does support encryption.
The default transport protocol is UDP. To change the transport protocol, you have to tune the configuration of your client of choice.
2021-11-01 09:49:17 +00:00
### TCP transport
The RTSP protocol supports the TCP transport protocol, that allows to receive packets even when there's a NAT/firewall between server and clients, and supports encryption (see [Encryption](#encryption)).
2021-10-22 17:33:44 +00:00
You can use _FFmpeg_ to publish a stream with the TCP transport protocol:
```
ffmpeg -re -stream_loop -1 -i file.ts -c copy -f rtsp -rtsp_transport tcp rtsp://localhost:8554/mystream
2019-12-28 21:07:03 +00:00
```
2021-11-01 09:49:17 +00:00
You can use _FFmpeg_ to read that stream with the TCP transport protocol:
2019-12-28 21:07:03 +00:00
2021-10-22 17:33:44 +00:00
```
ffmpeg -rtsp_transport tcp -i rtsp://localhost:8554/mystream -c copy output.mp4
2021-10-22 17:33:44 +00:00
```
2019-12-28 21:07:03 +00:00
2022-03-15 10:43:53 +00:00
You can use _GStreamer_ to read that stream with the TCP transport protocol:
2021-11-01 09:49:17 +00:00
```
gst-launch-1.0 rtspsrc protocols=tcp location=rtsp://localhost:8554/mystream ! fakesink
2021-11-01 09:49:17 +00:00
```
You can use _VLC_ to read that stream with the TCP transport protocol:
```
vlc --rtsp-tcp rtsp://localhost:8554/mystream
```
### UDP-multicast transport
The RTSP protocol supports the UDP-multicast transport protocol, that allows a server to send packets once, regardless of the number of connected readers, saving bandwidth.
This mode must be requested by readers when handshaking with the server; once a reader has completed a handshake, the server will start sending multicast packets. Other readers will be instructed to read existing multicast packets. When all multicast readers have disconnected from the server, the latter will stop sending multicast packets.
2021-11-01 09:49:17 +00:00
2022-04-09 09:41:00 +00:00
If you want to use the UDP-multicast protocol in a Wireless LAN, please be aware that the maximum bitrate supported by multicast is the one that corresponds to the lowest enabled WiFi data rate. For instance, if the 1 Mbps data rate is enabled on your router (and it is on most routers), the maximum bitrate will be 1 Mbps. To increase the maximum bitrate, use a cabled LAN or change your router settings.
2021-11-01 09:49:17 +00:00
To request and read a stream with UDP-multicast, you can use _FFmpeg_:
```
ffmpeg -rtsp_transport udp_multicast -i rtsp://localhost:8554/mystream -c copy output.mp4
2021-11-01 09:49:17 +00:00
```
or _GStreamer_:
```
2022-04-16 14:24:40 +00:00
gst-launch-1.0 rtspsrc protocols=udp-mcast location=rtsps://ip:8554/...
2021-11-01 09:49:17 +00:00
```
or _VLC_ (append `?vlcmulticast` to the URL):
```
vlc rtsp://localhost:8554/mystream?vlcmulticast
```
2021-11-01 09:49:17 +00:00
2021-10-22 17:33:44 +00:00
### Encryption
Implement Low-Latency HLS (#938) * add hlsVariant parameter * hls: split muxer into variants * hls: implement fmp4 segments * hls muxer: implement low latency mode * hls muxer: support audio with fmp4 mode * hls muxer: rewrite file router * hls muxer: implement preload hint * hls muxer: add various error codes * hls muxer: use explicit flags * hls muxer: fix error in aac pts * hls muxer: fix sudden freezes with video+audio * hls muxer: skip empty parts * hls muxer: fix video FPS * hls muxer: add parameter hlsPartDuration * hls muxer: refactor fmp4 muxer * hls muxer: fix CAN-SKIP-UNTIL * hls muxer: refactor code * hls muxer: show only parts of last 2 segments * hls muxer: implementa playlist delta updates * hls muxer: change playlist content type * hls muxer: improve video dts precision * hls muxer: fix video sample flags * hls muxer: improve iphone audio support * hls muxer: improve mp4 timestamp precision * hls muxer: add offset between pts and dts * hls muxer: close muxer in case of error * hls muxer: stop logging requests with the info level * hls muxer: rename entry into sample * hls muxer: compensate video dts error over time * hls muxer: change default segment count * hls muxer: add starting gap * hls muxer: set default part duration to 200ms * hls muxer: fix audio-only streams on ios * hls muxer: add playsinline attribute to video tag of default web page * hls muxer: keep mpegts as the default hls variant * hls muxer: implement encryption * hls muxer: rewrite dts estimation * hls muxer: improve DTS precision * hls muxer: use right SPS/PPS for each sample * hls muxer: adjust part duration dynamically * add comments * update readme * hls muxer: fix memory leak * hls muxer: decrease ram consumption
2022-05-31 17:17:26 +00:00
Incoming and outgoing RTSP streams can be encrypted with TLS (obtaining the RTSPS protocol). A TLS certificate is needed and can be generated with OpenSSL:
2021-10-22 17:33:44 +00:00
```
openssl genrsa -out server.key 2048
openssl req -new -x509 -sha256 -key server.key -out server.crt -days 3650
2019-12-28 21:07:03 +00:00
```
2021-11-24 22:38:18 +00:00
Edit `rtsp-simple-server.yml`, and set the `protocols`, `encryption`, `serverKey` and `serverCert` parameters:
2020-06-14 15:54:52 +00:00
2021-10-22 17:33:44 +00:00
```yml
protocols: [tcp]
encryption: optional
serverKey: server.key
serverCert: server.crt
```
2022-08-16 11:53:04 +00:00
Streams can be published and read with the `rtsps` scheme and the `8322` port:
2020-11-15 09:29:04 +00:00
2020-06-14 15:54:52 +00:00
```
2022-04-16 14:24:40 +00:00
ffmpeg -i rtsps://ip:8322/...
2020-06-14 15:54:52 +00:00
```
2021-10-22 17:33:44 +00:00
If the client is _GStreamer_, disable the certificate validation:
2020-11-15 09:29:04 +00:00
2020-06-14 15:54:52 +00:00
```
2022-04-16 14:24:40 +00:00
gst-launch-1.0 rtspsrc tls-validation-flags=0 location=rtsps://ip:8322/...
2021-10-22 17:33:44 +00:00
```
2021-11-01 09:49:17 +00:00
At the moment _VLC_ doesn't support reading encrypted RTSP streams. A workaround consists in launching an instance of _rtsp-simple-server_ on the same machine in which _VLC_ is running, using it for reading the encrypted stream with the proxy mode, and reading the proxied stream with _VLC_.
2021-10-22 17:33:44 +00:00
### Redirect to another server
To redirect to another server, use the `redirect` source:
```yml
paths:
redirected:
source: redirect
sourceRedirect: rtsp://otherurl/otherpath
```
### Fallback stream
If no one is publishing to the server, readers can be redirected to a fallback path or URL that is serving a fallback stream:
```yml
paths:
withfallback:
fallback: /otherpath
```
### Corrupted frames
In some scenarios, when reading RTSP from the server, decoded frames can be corrupted or incomplete. This can be caused by multiple reasons:
* the packet buffer of the server is too small and can't keep up with the stream throughput. A solution consists in increasing its size:
2021-10-22 17:33:44 +00:00
```yml
readBufferCount: 1024
```
* The stream throughput is too big and the stream can't be sent correctly with the UDP transport. UDP is more performant, faster and more efficient than TCP, but doesn't have a retransmission mechanism, that is needed in case of streams that need a large bandwidth. A solution consists in switching to TCP:
```yml
protocols: [tcp]
```
In case the source is a camera:
```yml
paths:
test:
source: rtsp://..
sourceProtocol: tcp
```
2021-12-06 15:27:20 +00:00
## RTMP protocol
2021-10-22 17:33:44 +00:00
2022-08-16 11:53:04 +00:00
### General usage
2021-10-22 17:33:44 +00:00
RTMP is a protocol that allows to read and publish streams, but is less versatile and less efficient than RTSP (doesn't support UDP, encryption, doesn't support most RTSP codecs, doesn't support feedback mechanism). It is used when there's need of publishing or reading streams from a software that supports only RTMP (for instance, OBS Studio and DJI drones).
At the moment, only the H264 and AAC codecs can be used with the RTMP protocol.
Streams can be published or read with the RTMP protocol, for instance with _FFmpeg_:
```
ffmpeg -re -stream_loop -1 -i file.ts -c copy -f flv rtmp://localhost/mystream
```
or _GStreamer_:
```
gst-launch-1.0 -v flvmux name=s ! rtmpsink location=rtmp://localhost/mystream filesrc location=file.mp4 ! qtdemux name=d d.video_0 ! queue ! s.video d.audio_0 ! queue ! s.audio
```
Credentials can be provided by appending to the URL the `user` and `pass` parameters:
```
ffmpeg -re -stream_loop -1 -i file.ts -c copy -f flv rtmp://localhost:8554/mystream?user=myuser&pass=mypass
```
2022-08-16 11:53:04 +00:00
### Encryption
RTMP connections can be encrypted with TLS, obtaining the RTMPS protocol. A TLS certificate is needed and can be generated with OpenSSL:
```
openssl genrsa -out server.key 2048
openssl req -new -x509 -sha256 -key server.key -out server.crt -days 3650
```
Edit `rtsp-simple-server.yml`, and set the `rtmpEncryption`, `rtmpServerKey` and `rtmpServerCert` parameters:
```yml
rtmpEncryption: optional
rtmpServerKey: server.key
rtmpServerCert: server.crt
```
Streams can be published and read with the `rtmps` scheme and the `1937` port:
```
rtmps://localhost:1937/...
```
Please be aware that RTMPS is currently unsupported by _VLC_, _FFmpeg_ and _GStreamer_. However, you can use a proxy like [stunnel](https://www.stunnel.org/) or [nginx](https://nginx.org/) to allow RTMP clients to access RTMPS resources.
2021-12-06 15:27:20 +00:00
## HLS protocol
2021-10-22 17:33:44 +00:00
2022-08-16 11:53:04 +00:00
### General usage
2021-10-22 17:33:44 +00:00
2022-05-31 17:21:40 +00:00
HLS is a protocol that allows to embed live streams into web pages. It works by splitting streams into segments, and by serving these segments with the HTTP protocol. Every stream published to the server can be accessed by visiting:
2021-10-22 17:33:44 +00:00
2020-06-14 15:54:52 +00:00
```
2021-10-22 17:33:44 +00:00
http://localhost:8888/mystream
```
where `mystream` is the name of a stream that is being published.
2022-08-05 16:16:07 +00:00
Please be aware that HLS only supports a single H264 video track and a single AAC audio track due to limitations of most browsers. If you want to use HLS with streams that use other codecs, you have to re-encode them, for instance by using _FFmpeg_:
2022-08-05 16:13:43 +00:00
```
ffmpeg -i rtsp://original-source -pix_fmt yuv420p -c:v libx264 -preset ultrafast -b:v 600k -c:a aac -b:a 160k -f rtsp rtsp://localhost:8554/mystream
```
2022-05-16 12:32:52 +00:00
### Embedding
The simples way to embed a live stream into a web page consists in using an iframe tag:
```
<iframe src="http://rtsp-simple-server-ip:8888/mystream" scrolling="no"></iframe>
```
Alternatively you can create a video tag that points directly to the stream playlist:
2021-10-22 17:33:44 +00:00
```
2022-05-16 12:32:52 +00:00
<video src="http://localhost:8888/mystream/index.m3u8"></video>
2021-10-22 17:33:44 +00:00
```
2022-05-16 12:32:52 +00:00
Please note that most browsers don't support HLS directly (except Safari); a Javascript library, like [hls.js](https://github.com/video-dev/hls.js), must be used to load the stream. You can find a working example by looking at the [source code of the HLS muxer](internal/core/hls_muxer.go).
2020-06-14 15:54:52 +00:00
Implement Low-Latency HLS (#938) * add hlsVariant parameter * hls: split muxer into variants * hls: implement fmp4 segments * hls muxer: implement low latency mode * hls muxer: support audio with fmp4 mode * hls muxer: rewrite file router * hls muxer: implement preload hint * hls muxer: add various error codes * hls muxer: use explicit flags * hls muxer: fix error in aac pts * hls muxer: fix sudden freezes with video+audio * hls muxer: skip empty parts * hls muxer: fix video FPS * hls muxer: add parameter hlsPartDuration * hls muxer: refactor fmp4 muxer * hls muxer: fix CAN-SKIP-UNTIL * hls muxer: refactor code * hls muxer: show only parts of last 2 segments * hls muxer: implementa playlist delta updates * hls muxer: change playlist content type * hls muxer: improve video dts precision * hls muxer: fix video sample flags * hls muxer: improve iphone audio support * hls muxer: improve mp4 timestamp precision * hls muxer: add offset between pts and dts * hls muxer: close muxer in case of error * hls muxer: stop logging requests with the info level * hls muxer: rename entry into sample * hls muxer: compensate video dts error over time * hls muxer: change default segment count * hls muxer: add starting gap * hls muxer: set default part duration to 200ms * hls muxer: fix audio-only streams on ios * hls muxer: add playsinline attribute to video tag of default web page * hls muxer: keep mpegts as the default hls variant * hls muxer: implement encryption * hls muxer: rewrite dts estimation * hls muxer: improve DTS precision * hls muxer: use right SPS/PPS for each sample * hls muxer: adjust part duration dynamically * add comments * update readme * hls muxer: fix memory leak * hls muxer: decrease ram consumption
2022-05-31 17:17:26 +00:00
### Low-Latency variant
2021-11-26 13:51:39 +00:00
2022-05-31 17:21:40 +00:00
Low-Latency HLS is a [recently standardized](https://datatracker.ietf.org/doc/html/draft-pantos-hls-rfc8216bis) variant of the protocol that allows to greatly reduce playback latency. It works by splitting segments into parts, that are served before the segment is complete.
2021-11-26 13:51:39 +00:00
Implement Low-Latency HLS (#938) * add hlsVariant parameter * hls: split muxer into variants * hls: implement fmp4 segments * hls muxer: implement low latency mode * hls muxer: support audio with fmp4 mode * hls muxer: rewrite file router * hls muxer: implement preload hint * hls muxer: add various error codes * hls muxer: use explicit flags * hls muxer: fix error in aac pts * hls muxer: fix sudden freezes with video+audio * hls muxer: skip empty parts * hls muxer: fix video FPS * hls muxer: add parameter hlsPartDuration * hls muxer: refactor fmp4 muxer * hls muxer: fix CAN-SKIP-UNTIL * hls muxer: refactor code * hls muxer: show only parts of last 2 segments * hls muxer: implementa playlist delta updates * hls muxer: change playlist content type * hls muxer: improve video dts precision * hls muxer: fix video sample flags * hls muxer: improve iphone audio support * hls muxer: improve mp4 timestamp precision * hls muxer: add offset between pts and dts * hls muxer: close muxer in case of error * hls muxer: stop logging requests with the info level * hls muxer: rename entry into sample * hls muxer: compensate video dts error over time * hls muxer: change default segment count * hls muxer: add starting gap * hls muxer: set default part duration to 200ms * hls muxer: fix audio-only streams on ios * hls muxer: add playsinline attribute to video tag of default web page * hls muxer: keep mpegts as the default hls variant * hls muxer: implement encryption * hls muxer: rewrite dts estimation * hls muxer: improve DTS precision * hls muxer: use right SPS/PPS for each sample * hls muxer: adjust part duration dynamically * add comments * update readme * hls muxer: fix memory leak * hls muxer: decrease ram consumption
2022-05-31 17:17:26 +00:00
LL-HLS is disabled by default. To enable it, a TLS certificate is needed and can be generated with OpenSSL:
2021-11-26 13:51:39 +00:00
Implement Low-Latency HLS (#938) * add hlsVariant parameter * hls: split muxer into variants * hls: implement fmp4 segments * hls muxer: implement low latency mode * hls muxer: support audio with fmp4 mode * hls muxer: rewrite file router * hls muxer: implement preload hint * hls muxer: add various error codes * hls muxer: use explicit flags * hls muxer: fix error in aac pts * hls muxer: fix sudden freezes with video+audio * hls muxer: skip empty parts * hls muxer: fix video FPS * hls muxer: add parameter hlsPartDuration * hls muxer: refactor fmp4 muxer * hls muxer: fix CAN-SKIP-UNTIL * hls muxer: refactor code * hls muxer: show only parts of last 2 segments * hls muxer: implementa playlist delta updates * hls muxer: change playlist content type * hls muxer: improve video dts precision * hls muxer: fix video sample flags * hls muxer: improve iphone audio support * hls muxer: improve mp4 timestamp precision * hls muxer: add offset between pts and dts * hls muxer: close muxer in case of error * hls muxer: stop logging requests with the info level * hls muxer: rename entry into sample * hls muxer: compensate video dts error over time * hls muxer: change default segment count * hls muxer: add starting gap * hls muxer: set default part duration to 200ms * hls muxer: fix audio-only streams on ios * hls muxer: add playsinline attribute to video tag of default web page * hls muxer: keep mpegts as the default hls variant * hls muxer: implement encryption * hls muxer: rewrite dts estimation * hls muxer: improve DTS precision * hls muxer: use right SPS/PPS for each sample * hls muxer: adjust part duration dynamically * add comments * update readme * hls muxer: fix memory leak * hls muxer: decrease ram consumption
2022-05-31 17:17:26 +00:00
```
openssl genrsa -out server.key 2048
openssl req -new -x509 -sha256 -key server.key -out server.crt -days 3650
```
Set the `hlsVariant`, `hlsEncryption`, `hlsServerKey` and `hlsServerCert` parameters in the configuration file:
```yml
hlsVariant: lowLatency
hlsEncryption: yes
hlsServerKey: server.key
hlsServerCert: server.crt
```
2022-08-16 11:53:04 +00:00
Every stream published to the server can be read with LL-HLS by visiting:
2021-11-26 13:51:39 +00:00
```
Implement Low-Latency HLS (#938) * add hlsVariant parameter * hls: split muxer into variants * hls: implement fmp4 segments * hls muxer: implement low latency mode * hls muxer: support audio with fmp4 mode * hls muxer: rewrite file router * hls muxer: implement preload hint * hls muxer: add various error codes * hls muxer: use explicit flags * hls muxer: fix error in aac pts * hls muxer: fix sudden freezes with video+audio * hls muxer: skip empty parts * hls muxer: fix video FPS * hls muxer: add parameter hlsPartDuration * hls muxer: refactor fmp4 muxer * hls muxer: fix CAN-SKIP-UNTIL * hls muxer: refactor code * hls muxer: show only parts of last 2 segments * hls muxer: implementa playlist delta updates * hls muxer: change playlist content type * hls muxer: improve video dts precision * hls muxer: fix video sample flags * hls muxer: improve iphone audio support * hls muxer: improve mp4 timestamp precision * hls muxer: add offset between pts and dts * hls muxer: close muxer in case of error * hls muxer: stop logging requests with the info level * hls muxer: rename entry into sample * hls muxer: compensate video dts error over time * hls muxer: change default segment count * hls muxer: add starting gap * hls muxer: set default part duration to 200ms * hls muxer: fix audio-only streams on ios * hls muxer: add playsinline attribute to video tag of default web page * hls muxer: keep mpegts as the default hls variant * hls muxer: implement encryption * hls muxer: rewrite dts estimation * hls muxer: improve DTS precision * hls muxer: use right SPS/PPS for each sample * hls muxer: adjust part duration dynamically * add comments * update readme * hls muxer: fix memory leak * hls muxer: decrease ram consumption
2022-05-31 17:17:26 +00:00
https://localhost:8888/mystream
2021-11-26 13:51:39 +00:00
```
Implement Low-Latency HLS (#938) * add hlsVariant parameter * hls: split muxer into variants * hls: implement fmp4 segments * hls muxer: implement low latency mode * hls muxer: support audio with fmp4 mode * hls muxer: rewrite file router * hls muxer: implement preload hint * hls muxer: add various error codes * hls muxer: use explicit flags * hls muxer: fix error in aac pts * hls muxer: fix sudden freezes with video+audio * hls muxer: skip empty parts * hls muxer: fix video FPS * hls muxer: add parameter hlsPartDuration * hls muxer: refactor fmp4 muxer * hls muxer: fix CAN-SKIP-UNTIL * hls muxer: refactor code * hls muxer: show only parts of last 2 segments * hls muxer: implementa playlist delta updates * hls muxer: change playlist content type * hls muxer: improve video dts precision * hls muxer: fix video sample flags * hls muxer: improve iphone audio support * hls muxer: improve mp4 timestamp precision * hls muxer: add offset between pts and dts * hls muxer: close muxer in case of error * hls muxer: stop logging requests with the info level * hls muxer: rename entry into sample * hls muxer: compensate video dts error over time * hls muxer: change default segment count * hls muxer: add starting gap * hls muxer: set default part duration to 200ms * hls muxer: fix audio-only streams on ios * hls muxer: add playsinline attribute to video tag of default web page * hls muxer: keep mpegts as the default hls variant * hls muxer: implement encryption * hls muxer: rewrite dts estimation * hls muxer: improve DTS precision * hls muxer: use right SPS/PPS for each sample * hls muxer: adjust part duration dynamically * add comments * update readme * hls muxer: fix memory leak * hls muxer: decrease ram consumption
2022-05-31 17:17:26 +00:00
If the stream is not shown correctly, try tuning the `hlsPartDuration` parameter, for instance:
```yml
hlsPartDuration: 500ms
```
### Decreasing latency
2022-05-31 17:21:40 +00:00
in HLS, latency is introduced since a client must wait for the server to generate segments before downloading them. This latency amounts to 1-15secs depending on the duration of each segment, and to 500ms-3s if the Low-Latency variant is enabled.
Implement Low-Latency HLS (#938) * add hlsVariant parameter * hls: split muxer into variants * hls: implement fmp4 segments * hls muxer: implement low latency mode * hls muxer: support audio with fmp4 mode * hls muxer: rewrite file router * hls muxer: implement preload hint * hls muxer: add various error codes * hls muxer: use explicit flags * hls muxer: fix error in aac pts * hls muxer: fix sudden freezes with video+audio * hls muxer: skip empty parts * hls muxer: fix video FPS * hls muxer: add parameter hlsPartDuration * hls muxer: refactor fmp4 muxer * hls muxer: fix CAN-SKIP-UNTIL * hls muxer: refactor code * hls muxer: show only parts of last 2 segments * hls muxer: implementa playlist delta updates * hls muxer: change playlist content type * hls muxer: improve video dts precision * hls muxer: fix video sample flags * hls muxer: improve iphone audio support * hls muxer: improve mp4 timestamp precision * hls muxer: add offset between pts and dts * hls muxer: close muxer in case of error * hls muxer: stop logging requests with the info level * hls muxer: rename entry into sample * hls muxer: compensate video dts error over time * hls muxer: change default segment count * hls muxer: add starting gap * hls muxer: set default part duration to 200ms * hls muxer: fix audio-only streams on ios * hls muxer: add playsinline attribute to video tag of default web page * hls muxer: keep mpegts as the default hls variant * hls muxer: implement encryption * hls muxer: rewrite dts estimation * hls muxer: improve DTS precision * hls muxer: use right SPS/PPS for each sample * hls muxer: adjust part duration dynamically * add comments * update readme * hls muxer: fix memory leak * hls muxer: decrease ram consumption
2022-05-31 17:17:26 +00:00
To decrease the latency, you can:
* enable the Low-Latency variant of the HLS protocol, as explained in the previous section;
* if Low-latency is enabled, try decreasing the `hlsPartDuration` parameter;
* try decreasing the `hlsSegmentDuration` parameter;
* The segment duration is influenced by the interval between the IDR frames of the video track. An IDR frame is a frame that can be decoded independently from the others. The server changes the segment duration in order to include at least one IDR frame into each segment. Therefore, you need to decrease the interval between the IDR frames. This can be done in two ways:
* if the stream is being hardware-generated (i.e. by a camera), there's usually a setting called _Key-Frame Interval_ in the camera configuration page
* otherwise, the stream must be re-encoded. It's possible to tune the IDR frame interval by using ffmpeg's `-g` option:
```
ffmpeg -i rtsp://original-stream -pix_fmt yuv420p -c:v libx264 -preset ultrafast -b:v 600k -max_muxing_queue_size 1024 -g 30 -f rtsp rtsp://localhost:$RTSP_PORT/compressed
```
2019-12-28 21:07:03 +00:00
## Links
2020-01-20 22:04:12 +00:00
Related projects
2020-11-15 09:29:04 +00:00
2022-08-03 07:58:26 +00:00
* gortsplib (RTSP library used internally) https://github.com/aler9/gortsplib
* pion/sdp (SDP library used internally) https://github.com/pion/sdp
* pion/rtp (RTP library used internally) https://github.com/pion/rtp
* pion/rtcp (RTCP library used internally) https://github.com/pion/rtcp
* notedit/rtmp (RTMP library used internally) https://github.com/notedit/rtmp
* go-astits (MPEG-TS library used internally) https://github.com/asticode/go-astits
* go-mp4 (MP4 library used internally) https://github.com/abema/go-mp4
2020-10-06 16:55:58 +00:00
* https://github.com/flaviostutz/rtsp-relay
2020-01-20 22:04:12 +00:00
2022-06-01 10:43:24 +00:00
Standards
2020-11-15 09:29:04 +00:00
2022-06-01 10:40:12 +00:00
* RTSP 1.0 https://datatracker.ietf.org/doc/html/rfc2326
* RTSP 2.0 https://datatracker.ietf.org/doc/html/rfc7826
* HTTP 1.1 https://datatracker.ietf.org/doc/html/rfc2616
* HLS https://datatracker.ietf.org/doc/html/rfc8216
* HLS v2 https://datatracker.ietf.org/doc/html/draft-pantos-hls-rfc8216bis
2022-06-01 10:43:24 +00:00
* Golang project layout https://github.com/golang-standards/project-layout