mpv/video/decode
Stefano Pigozzi a9cb2dc1b8 video: add vda decode support (with hwaccel) and direct rendering
Decoding H264 using Video Decode Acceleration used the custom 'vda_h264_dec'
decoder in FFmpeg.

The Good: This new implementation has some advantages over the previous one:

 - It works with Libav: vda_h264_dec never got into Libav since they prefer
   client applications to use the hwaccel API.

 - It is way more efficient: in my tests this implementation yields a
   reduction of CPU usage of roughly ~50% compared to using `vda_h264_dec` and
   ~65-75% compared to h264 software decoding. This is mainly because
   `vo_corevideo` was adapted to perform direct rendering of the
   `CVPixelBufferRefs` created by the Video Decode Acceleration API Framework.

The Bad:
  - `vo_corevideo` is required to use VDA decoding acceleration.
  - only works with versions of ffmpeg/libav new enough (needs reference
    refcounting). That is FFmpeg 2.0+ and Libav's git master currently.

The Ugly: VDA was hardcoded to use UYVY (2vuy) for the uploaded video texture.
One one end this makes the code simple since Apple's OpenGL implementation
actually supports this out of the box. It would be nice to support other
output image formats and choose the best format depending on the input, or at
least making it configurable. My tests indicate that CPU usage actually
increases with a 420p IMGFMT output which is not what I would have expected.

NOTE: There is a small memory leak with old versions of FFmpeg and with Libav
since the CVPixelBufferRef is not automatically released when the AVFrame is
deallocated. This can cause leaks inside libavcodec for decoded frames that
are discarded before mpv wraps them inside a refcounted mp_image (this only
happens on seeks).
For frames that enter mpv's refcounting facilities, this is not a problem
since we rewrap the CVPixelBufferRef in our mp_image that properly forwards
CVPixelBufferRetain/CvPixelBufferRelease calls to the underying
CVPixelBufferRef.

So, for FFmpeg use something more recent than `b3d63995` for Libav the patch
was posted to the dev ML in July and in review since, apparently, the proposed
fix is rather hacky.
2013-08-22 12:13:30 +02:00
..
dec_video.c core: move contents to mpvcore (2/2) 2013-08-06 22:52:31 +02:00
dec_video.h video: add vaapi decode and output support 2013-08-12 01:12:02 +02:00
lavc.h video/decode: change fix_image callback 2013-08-15 23:40:02 +02:00
lavc_dr1.c vdpau: split off decoder parts, use "new" libavcodec vdpau hwaccel API 2013-07-28 19:25:07 +02:00
vaapi.c vaapi: use highest available profile, instead of mapping it exactly 2013-08-19 01:05:48 +02:00
vd.c core: move contents to mpvcore (2/2) 2013-08-06 22:52:31 +02:00
vd.h vd: add VDCTRL_GET_PARAMS 2013-07-15 01:49:26 +02:00
vd_lavc.c video: add vda decode support (with hwaccel) and direct rendering 2013-08-22 12:13:30 +02:00
vda.c video: add vda decode support (with hwaccel) and direct rendering 2013-08-22 12:13:30 +02:00
vdpau.c vdpau: don't try to match codec profiles 2013-08-19 01:05:48 +02:00
vdpau_old.c vdpau_old: add forgotten probe callback 2013-08-15 23:40:04 +02:00