Usage: How to use and test this patch

[winlinvip]

Please select a open-source WHIP server to work with FFmpeg.

• Usage: FFmpeg + SRS
• Usage: FFmpeg + Pion
• Usage: FFmpeg + Janus
• Usage: FFmpeg + Millicast
• Usage: FFmpeg + MediaMTX

If you encounter any issues or get stuck, please leave us a message on Discord.

Note: We've included Janus, Pion, Millicast, and SRS as examples of WHIP servers you can use. However, there are many other options available, such as Galene, Deadsfu, and more. For more information, please see the ietf112-hackathon-whip.pdf.

You also have the option to select a WHIP cloud service, which is typically provided by video cloud service providers.

• Usage: FFmpeg + AWS-IVS
• Usage: FFmpeg + Cloudflare
• Usage: FFmpeg + TRTC

If you encounter any issues or get stuck, please leave us a message on Discord.

Other useful documents you may need.

• OpenSSL What's the supported version of OpenSSL, and how do I build it?
• Debugging How to enable debugging logs of FFmpeg?
• Asan and Fate How to build with asan and make with fate?
• Simulate Packet Loss How to simulate packet loss in localhost?
• Known Issues Regarding known issues and what has been fixed.
• Latency What's the process for measuring latency? Typically, it's around 150ms.
• Load Certificate File How to import a DTLS certificate and private key from a file?
• Authorization How can I authorize using an HTTP header?
• Contributors About the authors, contributors, and reviewers for this patch.
• Links Useful links about this patch.

[Ryutaku]

FFmpeg + MediaMTX not work.
Using FFmpeg to stream to MediaMTX via WHIP fails with the following error:

D:\ffmpeg-master-latest-win64-gpl\bin> ffmpeg -rtsp_transport tcp -i "rtsp://192.168.2.128:8554/mediamtx/a" -acodec libopus -ar 48000 -ac 2 -vcodec libx264 -profile:v baseline -tune zerolatency -threads 1 -bf 0 -f whip "http://192.168.2.128:8889/test/b/whip"
ffmpeg version N-120839-gc2d17c4db8-20250826 Copyright (c) 2000-2025 the FFmpeg developers
  built with gcc 15.1.0 (crosstool-NG 1.27.0.79_8f49ec5)
  configuration: --prefix=/ffbuild/prefix --pkg-config-flags=--static --pkg-config=pkg-config --cross-prefix=x86_64-w64-mingw32- --arch=x86_64 --target-os=mingw32 --enable-gpl --enable-version3 --disable-debug --disable-w32threads --enable-pthreads --enable-iconv --enable-zlib --enable-libfribidi --enable-gmp --enable-libxml2 --enable-lzma --enable-fontconfig --enable-libharfbuzz --enable-libfreetype --enable-libvorbis --enable-opencl --disable-libpulse --enable-libvmaf --disable-libxcb --disable-xlib --enable-vulkan --enable-libshaderc --enable-amf --enable-libaom --enable-libaribb24 --enable-avisynth --enable-chromaprint --enable-libdav1d --enable-libdavs2 --enable-libdvdread --enable-libdvdnav --disable-libfdk-aac --enable-ffnvcodec --enable-cuda-llvm --enable-frei0r --enable-libgme --enable-libkvazaar --enable-libaribcaption --enable-libass --enable-libbluray --enable-libjxl --enable-libmp3lame --enable-libopus --enable-libplacebo --enable-librist --enable-libssh --enable-libtheora --enable-libvpx --enable-libwebp --enable-libzmq --enable-lv2 --enable-libvpl --enable-openal --enable-liboapv --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenh264 --enable-libopenjpeg --enable-libopenmpt --enable-librav1e --enable-librubberband --enable-schannel --enable-sdl2 --enable-libsnappy --enable-libsoxr --enable-libsrt --enable-libsvtav1 --enable-libtwolame --enable-libuavs3d --disable-libdrm --enable-vaapi --enable-libvidstab --enable-libvvenc --enable-whisper --enable-libx264 --enable-libx265 --enable-libxavs2 --enable-libxvid --enable-libzimg --enable-libzvbi --extra-cflags=-DLIBTWOLAME_STATIC --extra-cxxflags= --extra-libs=-lgomp --extra-ldflags=-pthread --extra-ldexeflags= --cc=x86_64-w64-mingw32-gcc --cxx=x86_64-w64-mingw32-g++ --ar=x86_64-w64-mingw32-gcc-ar --ranlib=x86_64-w64-mingw32-gcc-ranlib --nm=x86_64-w64-mingw32-gcc-nm --extra-version=20250826
  libavutil      60. 10.100 / 60. 10.100
  libavcodec     62. 13.101 / 62. 13.101
  libavformat    62.  4.101 / 62.  4.101
  libavdevice    62.  2.100 / 62.  2.100
  libavfilter    11.  5.100 / 11.  5.100
  libswscale      9.  2.100 /  9.  2.100
  libswresample   6.  2.100 /  6.  2.100
Input #0, rtsp, from 'rtsp://192.168.2.128:8554/mediamtx/a':
  Metadata:
    title           : Media Presentation
  Duration: N/A, start: 0.122313, bitrate: N/A
  Stream #0:0: Video: h264 (Main), yuvj420p(pc, bt709, progressive), 1280x720, 25 fps, 24.92 tbr, 90k tbn, start 0.162078
  Stream #0:1: Audio: aac (LC), 16000 Hz, mono, fltp, start 0.122313
Stream mapping:
  Stream #0:0 -> #0:0 (h264 (native) -> h264 (libx264))
  Stream #0:1 -> #0:1 (aac (native) -> opus (libopus))
Press [q] to stop, [?] for help
[libopus @ 000001c69d317980] No bit rate set. Defaulting to 96000 bps.
[libx264 @ 000001c69c83dc00] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
[libx264 @ 000001c69c83dc00] profile Constrained Baseline, level 3.1, 4:2:0, 8-bit
[libx264 @ 000001c69c83dc00] 264 - core 165 - H.264/MPEG-4 AVC codec - Copyleft 2003-2025 - http://www.videolan.org/x264.html - options: cabac=0 ref=3 deblock=1:0:0 analyse=0x1:0x111 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=0 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=1 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=0 weightp=0 keyint=250 keyint_min=24 scenecut=40 intra_refresh=0 rc=crf mbtree=0 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
[dtls @ 000001c69f50c700] Creating security context failed (0x80090331)
[WHIP muxer @ 000001c69a8f71c0] Dispose resource http://192.168.2.128:8889/test/b/whip/6410c61d-bd2a-4415-8ac0-123decd1a0cd ok
[out#0/whip @ 000001c69a88c300] Could not write header (incorrect codec parameters ?): Unknown error occurred
[vf#0:0 @ 000001c69a8fc840] Error sending frames to consumers: Unknown error occurred
[vf#0:0 @ 000001c69a8fc840] Task finished with error code: -1313558101 (Unknown error occurred)
[vf#0:0 @ 000001c69a8fc840] Terminating thread with return code -1313558101 (Unknown error occurred)
[out#0/whip @ 000001c69a88c300] Nothing was written into output file, because at least one of its streams received no packets.
frame=    0 fps=0.0 q=0.0 Lsize=       0KiB time=N/A bitrate=N/A dup=4 drop=0 speed=N/A elapsed=0:00:00.68
Conversion failed!

For comparison, streaming to MediaMTX via WHIP using OBS is successful.

[JackLau1222]

[dtls @ 000001c69f50c700] Creating security context failed (0x80090331)

Windows Schannel doesn't support DTLS use_srtp extension, so the WHIP will be rejected by the peer.

Please compile FFmpeg with OpenSSL

[Ryutaku]

[dtls @ 000001c69f50c700] Creating security context failed (0x80090331)

Windows Schannel doesn't support DTLS use_srtp extension, so the WHIP will be rejected by the peer.

Please compile FFmpeg with OpenSSL

Thanks.

The above DTLS problem has been resoved. But encountered a new problem：

[root]# ./ffmpeg -rtsp_transport tcp -i "rtsp://192.168.2.128:8554/mediamtx/a" -c:v copy -c:a libopus -ar 48000 -ac 2 -f whip "http://192.168.2.189:8889/testx/c/whip"
ffmpeg version N-120839-gc2d17c4db8-20250826 Copyright (c) 2000-2025 the FFmpeg developers
  built with gcc 15.1.0 (crosstool-NG 1.27.0.79_8f49ec5)
  configuration: --prefix=/ffbuild/prefix --pkg-config-flags=--static --pkg-config=pkg-config --cross-prefix=x86_64-ffbuild-linux-gnu- --arch=x86_64 --target-os=linux --enable-gpl --enable-version3 --disable-debug --enable-iconv --enable-zlib --enable-libfribidi --enable-gmp --enable-libxml2 --enable-openssl --enable-lzma --enable-fontconfig --enable-libharfbuzz --enable-libfreetype --enable-libvorbis --enable-opencl --enable-libpulse --enable-libvmaf --enable-libxcb --enable-xlib --enable-vulkan --enable-libshaderc --enable-amf --enable-libaom --enable-libaribb24 --enable-avisynth --enable-chromaprint --enable-libdav1d --enable-libdavs2 --enable-libdvdread --enable-libdvdnav --disable-libfdk-aac --enable-ffnvcodec --enable-cuda-llvm --enable-frei0r --enable-libgme --enable-libkvazaar --enable-libaribcaption --enable-libass --enable-libbluray --enable-libjxl --enable-libmp3lame --enable-libopus --enable-libplacebo --enable-librist --enable-libssh --enable-libtheora --enable-libvpx --enable-libwebp --enable-libzmq --enable-lv2 --enable-libvpl --enable-openal --enable-liboapv --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenh264 --enable-libopenjpeg --enable-libopenmpt --enable-librav1e --enable-librubberband --disable-schannel --enable-sdl2 --enable-libsnappy --enable-libsoxr --enable-libsrt --enable-libsvtav1 --enable-libtwolame --enable-libuavs3d --enable-libdrm --enable-vaapi --enable-libvidstab --enable-libvvenc --enable-whisper --enable-libx264 --enable-libx265 --enable-libxavs2 --enable-libxvid --enable-libzimg --enable-libzvbi --extra-cflags=-DLIBTWOLAME_STATIC --extra-cxxflags= --extra-libs='-ldl -lgomp' --extra-ldflags=-pthread --extra-ldexeflags=-pie --cc=x86_64-ffbuild-linux-gnu-gcc --cxx=x86_64-ffbuild-linux-gnu-g++ --ar=x86_64-ffbuild-linux-gnu-gcc-ar --ranlib=x86_64-ffbuild-linux-gnu-gcc-ranlib --nm=x86_64-ffbuild-linux-gnu-gcc-nm --extra-version=20250826
  libavutil      60. 10.100 / 60. 10.100
  libavcodec     62. 13.101 / 62. 13.101
  libavformat    62.  4.101 / 62.  4.101
  libavdevice    62.  2.100 / 62.  2.100
  libavfilter    11.  5.100 / 11.  5.100
  libswscale      9.  2.100 /  9.  2.100
  libswresample   6.  2.100 /  6.  2.100
Input #0, rtsp, from 'rtsp://192.168.2.128:8554/mediamtx/a':
  Metadata:
    title           : Media Presentation
  Duration: N/A, start: 0.105313, bitrate: N/A
  Stream #0:0: Video: h264 (Main), yuvj420p(pc, bt709, progressive), 1280x720, 25 fps, 24.92 tbr, 90k tbn, start 0.162144
  Stream #0:1: Audio: aac (LC), 16000 Hz, mono, fltp, start 0.105313
Stream mapping:
  Stream #0:0 -> #0:0 (copy)
  Stream #0:1 -> #0:1 (aac (native) -> opus (libopus))
Press [q] to stop, [?] for help
[libopus @ 0x55672eacd340] No bit rate set. Defaulting to 96000 bps.
[WHIP muxer @ 0x55672eb01100] DTLS handshake timeout=5000ms, cost=5038ms, elapsed=5047ms, state=7
[WHIP muxer @ 0x55672eb01100] Dispose resource http://192.168.2.189:8889/testx/c/whip/51485dd2-6e5c-4735-b0f0-aac6c7498a1f ok
[out#0/whip @ 0x55672eb0b880] Could not write header (incorrect codec parameters ?): Connection timed out
[af#0:1 @ 0x55672eaca280] Error sending frames to consumers: Connection timed out
[af#0:1 @ 0x55672eaca280] Task finished with error code: -110 (Connection timed out)
[af#0:1 @ 0x55672eaca280] Terminating thread with return code -110 (Connection timed out)
[out#0/whip @ 0x55672eb0b880] Nothing was written into output file, because at least one of its streams received no packets.
frame=    0 fps=0.0 q=-1.0 Lsize=       0KiB time=N/A bitrate=N/A speed=N/A elapsed=0:00:05.07    
Conversion failed!