2011-01-16 18:03:08 +00:00
|
|
|
#ifndef MPLAYER_SD_H
|
|
|
|
#define MPLAYER_SD_H
|
|
|
|
|
VO, sub: refactor
Remove VFCTRL_DRAW_OSD, VFCAP_EOSD_FILTER, VFCAP_EOSD_RGBA, VFCAP_EOSD,
VOCTRL_DRAW_EOSD, VOCTRL_GET_EOSD_RES, VOCTRL_QUERY_EOSD_FORMAT.
Remove draw_osd_with_eosd(), which rendered the OSD by calling
VOCTRL_DRAW_EOSD. Change VOs to call osd_draw() directly, which takes
a callback as argument. (This basically works like the old OSD API,
except multiple OSD bitmap formats are supported and caching is
possible.)
Remove all mentions of "eosd". It's simply "osd" now.
Make OSD size per-OSD-object, as they can be different when using
vf_sub. Include display_par/video_par in resolution change detection.
Fix the issue with margin borders in vo_corevideo.
2012-10-19 17:25:18 +00:00
|
|
|
#include "dec_sub.h"
|
2013-11-18 17:46:44 +00:00
|
|
|
#include "demux/packet.h"
|
sub: make filter_sdh a "proper" filter, allow runtime changes
Until now, filter_sdh was simply a function that was called by sd_ass
directly (if enabled).
I want to add another filter, so it's time to turn this into a somewhat
more general subtitle filtering infrastructure.
I pondered whether to reuse the audio/video filtering stuff - but better
not. Also, since subtitles are horrible and tend to refuse proper
abstraction, it's still messed into sd_ass, instead of working on the
dec_sub.c level. Actually mpv used to have subtitle "filters" and even
made subtitle converters part of it, but it was fairly horrible, so
don't do that again.
In addition, make runtime changes possible. Since this was supposed to
be a quick hack, I just decided to put all subtitle filter options into
a separate option group (=> simpler change notification), to manually
push the change through the playloop (like it was sort of before for OSD
options), and to recreate the sub filter chain completely in every
change. Should be good enough.
One strangeness is that due to prefetching and such, most subtitle
packets (or those some time ahead) are actually done filtering when we
change, so the user still needs to manually seek to actually refresh
everything. And since subtitle data is usually cached in ASS_Track (for
other terrible but user-friendly reasons), we also must clear the
subtitle data, but of course only on seek, since otherwise all subtitles
would just disappear. What a fucking mess, but such is life. We could
trigger a "refresh seek" to make this more automatic, but I don't feel
like it currently.
This is slightly inefficient (lots of allocations and copying), but I
decided that it doesn't matter. Could matter slightly for crazy ASS
subtitles that render with thousands of events.
Not very well tested. Still seems to work, but I didn't have many test
cases.
2020-02-16 00:02:17 +00:00
|
|
|
#include "misc/bstr.h"
|
2013-06-01 17:44:12 +00:00
|
|
|
|
2015-12-07 22:47:18 +00:00
|
|
|
// up to 210 ms overlaps or gaps are removed
|
|
|
|
#define SUB_GAP_THRESHOLD 0.210
|
2015-12-05 22:55:56 +00:00
|
|
|
// don't change timings if durations are smaller
|
|
|
|
#define SUB_GAP_KEEP 0.4
|
2023-11-06 01:29:18 +00:00
|
|
|
// slight offset when sub seeking or sub stepping
|
|
|
|
#define SUB_SEEK_OFFSET 0.01
|
2015-12-05 22:55:56 +00:00
|
|
|
|
2013-06-01 17:44:12 +00:00
|
|
|
struct sd {
|
2015-12-26 17:34:18 +00:00
|
|
|
struct mpv_global *global;
|
2013-12-21 18:06:37 +00:00
|
|
|
struct mp_log *log;
|
2017-12-29 16:19:25 +00:00
|
|
|
struct mp_subtitle_opts *opts;
|
2023-12-13 21:36:58 +00:00
|
|
|
struct mp_subtitle_shared_opts *shared_opts;
|
2013-06-01 17:44:12 +00:00
|
|
|
|
|
|
|
const struct sd_functions *driver;
|
|
|
|
void *priv;
|
2023-12-17 19:18:11 +00:00
|
|
|
int order;
|
2013-06-01 17:44:12 +00:00
|
|
|
|
2016-03-03 17:48:56 +00:00
|
|
|
struct attachment_list *attachments;
|
2016-01-12 22:48:19 +00:00
|
|
|
struct mp_codec_params *codec;
|
sub: make preloading more robust
Subtitles can be preloaded, which means they're fully read and copied
into ASS_Track. This in turn is mainly for the sake of being able to do
subtitle seeking (when it comes down to it, subtitle seeking is the
cause for most trouble here).
Commit a714f8e92 broke preloaded subtitles which have events with
unknown duration, such as some MicroDVD samples. The event list gets
cleared on every seek, so the property of being preloaded obviously gets
lost.
Fix this by moving most of the preloading logic to dec_sub.c. If the
subtitle list gets cleared, they are not considered preloaded anymore,
and the logic for demuxed subtitles is used.
As another minor thing, preloadeding subtitles did neither disable the
demux stream, nor did it discard packets. Thus you could get queue
overflows in theory (harmless, but annoying). Fix this by explicitly
discarding packets in preloaded mode.
In summary, now the only difference between preloaded and normal
demuxing are:
1. a seek is issued, and all packets are read on start
2. during playback, discard the packets instead of feeding them to the
subtitle decoder
This is still petty annoying. It would be nice if maintaining the
subtitle index (and maybe a subtitle packet cache for instant subtitle
presentation when seeking back) could be maintained in the demuxer
instead. Half of all file formats with interleaved subtitles have
this anyway (mp4, mkv muxed with newer mkvmerge).
2016-03-06 13:50:36 +00:00
|
|
|
|
|
|
|
// Set to false as soon as the decoder discards old subtitle events.
|
|
|
|
// (only needed if sd_functions.accept_packets_in_advance == false)
|
|
|
|
bool preload_ok;
|
2013-06-01 17:44:12 +00:00
|
|
|
};
|
2011-01-16 18:03:08 +00:00
|
|
|
|
|
|
|
struct sd_functions {
|
2013-06-03 19:49:39 +00:00
|
|
|
const char *name;
|
2013-04-28 19:12:11 +00:00
|
|
|
bool accept_packets_in_advance;
|
2013-06-01 17:44:12 +00:00
|
|
|
int (*init)(struct sd *sd);
|
|
|
|
void (*decode)(struct sd *sd, struct demux_packet *packet);
|
2013-06-01 17:44:55 +00:00
|
|
|
void (*reset)(struct sd *sd);
|
2015-12-26 17:35:36 +00:00
|
|
|
void (*select)(struct sd *sd, bool selected);
|
2013-06-01 17:44:55 +00:00
|
|
|
void (*uninit)(struct sd *sd);
|
|
|
|
|
sub: don't potentially discard too many subtitles on seek
The accepts_packet packet callback is supposed to deal with subtitle
decoders which have only a small queue of current subtitle events (i.e.
sd_lavc.c), in case feeding it too many packets would discard events
that are still needed.
Normally, the number of subtitles that need to be preserved is estimated
by the rendering pts (get_bitmaps() argument). Rendering lags behind
decoding, so normally the rendering pts is smaller than the next video
frame pts, and we simply discard all subtitle events until the rendering
pts.
This breaks down in some annoying corner cases. One of them is seeking
backwards: the VO will still try to render the old PTS during seeks,
which passes a high PTS to the subtitle renderer, which in turn would
discard more subtitles than it should. There is a similar issue with
forward seeks. Add hacks to deal with those issues.
There should be a better way to deal with the essentially unknown
"rendering position", which is made worse by screenshots or rendering
with vf_sub. At the very least, we could handle seeks better, and e.g.
either force the VO not to re-render subs after seeks (ugly), or
introduce seek sequence numbers to distinguish attempts to render
earlier subtitles when a seek is done.
2016-08-14 18:27:37 +00:00
|
|
|
bool (*accepts_packet)(struct sd *sd, double pts); // implicit default if NULL: true
|
2013-06-28 23:34:11 +00:00
|
|
|
int (*control)(struct sd *sd, enum sd_ctrl cmd, void *arg);
|
2013-06-01 17:54:31 +00:00
|
|
|
|
video: make OSD/subtitle bitmaps refcounted (sort of)
Making OSD/subtitle bitmaps refcounted was planend a longer time ago,
e.g. the sub_bitmaps.packed field (which refcounts the subtitle bitmap
data) was added in 2016. But nothing benefited much from it, because
struct sub_bitmaps was usually stack allocated, and there was this weird
callback stuff through osd_draw().
Make it possible to get actually refcounted subtitle bitmaps on the OSD
API level. For this, we just copy all subtitle data other than the
bitmaps with sub_bitmaps_copy(). At first, I had planned some fancy
refcount shit, but when that was a big mess and hard to debug and just
boiled to emulating malloc(), I made it a full allocation+copy. This
affects mostly the parts array. With crazy ASS subtitles, this parts
array can get pretty big (thousands of elements or more), in which case
the extra alloc/copy could become performance relevant. But then again
this is just pure bullshit, and I see no need to care. In practice, this
extra work most likely gets drowned out by libass murdering a single
core (while mpv is waiting for it) anyway. So fuck it.
I just wanted this so draw_bmp.c requires only a single call to render
everything. VOs also can benefit from this, because the weird callback
shit isn't necessary anymore (simpler code), but I haven't done anything
about it yet. In general I'd hope this will work towards simplifying the
OSD layer, which is prerequisite for making actual further improvements.
I haven't tested some cases such as the "overlay-add" command. Maybe it
crashes now? Who knows, who cares.
In addition, it might be worthwhile to reduce the code duplication
between all the things that output subtitle bitmaps (with repacking,
image allocation, etc.), but that's orthogonal.
2020-04-26 21:34:32 +00:00
|
|
|
struct sub_bitmaps *(*get_bitmaps)(struct sd *sd, struct mp_osd_res dim,
|
2023-12-17 19:18:11 +00:00
|
|
|
int format, double pts);
|
2020-05-14 20:14:49 +00:00
|
|
|
char *(*get_text)(struct sd *sd, double pts, enum sd_text_type type);
|
2019-09-21 18:11:18 +00:00
|
|
|
struct sd_times (*get_times)(struct sd *sd, double pts);
|
2011-01-16 18:03:08 +00:00
|
|
|
};
|
|
|
|
|
sub: make filter_sdh a "proper" filter, allow runtime changes
Until now, filter_sdh was simply a function that was called by sd_ass
directly (if enabled).
I want to add another filter, so it's time to turn this into a somewhat
more general subtitle filtering infrastructure.
I pondered whether to reuse the audio/video filtering stuff - but better
not. Also, since subtitles are horrible and tend to refuse proper
abstraction, it's still messed into sd_ass, instead of working on the
dec_sub.c level. Actually mpv used to have subtitle "filters" and even
made subtitle converters part of it, but it was fairly horrible, so
don't do that again.
In addition, make runtime changes possible. Since this was supposed to
be a quick hack, I just decided to put all subtitle filter options into
a separate option group (=> simpler change notification), to manually
push the change through the playloop (like it was sort of before for OSD
options), and to recreate the sub filter chain completely in every
change. Should be good enough.
One strangeness is that due to prefetching and such, most subtitle
packets (or those some time ahead) are actually done filtering when we
change, so the user still needs to manually seek to actually refresh
everything. And since subtitle data is usually cached in ASS_Track (for
other terrible but user-friendly reasons), we also must clear the
subtitle data, but of course only on seek, since otherwise all subtitles
would just disappear. What a fucking mess, but such is life. We could
trigger a "refresh seek" to make this more automatic, but I don't feel
like it currently.
This is slightly inefficient (lots of allocations and copying), but I
decided that it doesn't matter. Could matter slightly for crazy ASS
subtitles that render with thousands of events.
Not very well tested. Still seems to work, but I didn't have many test
cases.
2020-02-16 00:02:17 +00:00
|
|
|
// lavc_conv.c
|
2015-12-18 00:54:14 +00:00
|
|
|
struct lavc_conv;
|
2023-02-20 21:11:47 +00:00
|
|
|
struct lavc_conv *lavc_conv_create(struct mp_log *log,
|
|
|
|
const struct mp_codec_params *mp_codec);
|
2015-12-18 00:54:14 +00:00
|
|
|
char *lavc_conv_get_extradata(struct lavc_conv *priv);
|
2019-09-18 18:26:05 +00:00
|
|
|
char **lavc_conv_decode(struct lavc_conv *priv, struct demux_packet *packet,
|
|
|
|
double *sub_pts, double *sub_duration);
|
2015-12-18 00:54:14 +00:00
|
|
|
void lavc_conv_reset(struct lavc_conv *priv);
|
|
|
|
void lavc_conv_uninit(struct lavc_conv *priv);
|
2013-06-01 17:54:18 +00:00
|
|
|
|
sub: make filter_sdh a "proper" filter, allow runtime changes
Until now, filter_sdh was simply a function that was called by sd_ass
directly (if enabled).
I want to add another filter, so it's time to turn this into a somewhat
more general subtitle filtering infrastructure.
I pondered whether to reuse the audio/video filtering stuff - but better
not. Also, since subtitles are horrible and tend to refuse proper
abstraction, it's still messed into sd_ass, instead of working on the
dec_sub.c level. Actually mpv used to have subtitle "filters" and even
made subtitle converters part of it, but it was fairly horrible, so
don't do that again.
In addition, make runtime changes possible. Since this was supposed to
be a quick hack, I just decided to put all subtitle filter options into
a separate option group (=> simpler change notification), to manually
push the change through the playloop (like it was sort of before for OSD
options), and to recreate the sub filter chain completely in every
change. Should be good enough.
One strangeness is that due to prefetching and such, most subtitle
packets (or those some time ahead) are actually done filtering when we
change, so the user still needs to manually seek to actually refresh
everything. And since subtitle data is usually cached in ASS_Track (for
other terrible but user-friendly reasons), we also must clear the
subtitle data, but of course only on seek, since otherwise all subtitles
would just disappear. What a fucking mess, but such is life. We could
trigger a "refresh seek" to make this more automatic, but I don't feel
like it currently.
This is slightly inefficient (lots of allocations and copying), but I
decided that it doesn't matter. Could matter slightly for crazy ASS
subtitles that render with thousands of events.
Not very well tested. Still seems to work, but I didn't have many test
cases.
2020-02-16 00:02:17 +00:00
|
|
|
struct sd_filter {
|
|
|
|
struct mpv_global *global;
|
|
|
|
struct mp_log *log;
|
|
|
|
struct mp_sub_filter_opts *opts;
|
|
|
|
const struct sd_filter_functions *driver;
|
|
|
|
|
|
|
|
void *priv;
|
|
|
|
|
|
|
|
// Static codec parameters. Set by sd; cannot be changed by filter.
|
|
|
|
char *codec;
|
|
|
|
char *event_format;
|
|
|
|
};
|
|
|
|
|
|
|
|
struct sd_filter_functions {
|
|
|
|
bool (*init)(struct sd_filter *ft);
|
|
|
|
|
|
|
|
// Filter an ASS event (usually in the Matroska format, but event_format
|
|
|
|
// can be used to determine details).
|
|
|
|
// Returning NULL is interpreted as dropping the event completely.
|
|
|
|
// Returning pkt makes it no-op.
|
|
|
|
// If the returned packet is not pkt or NULL, it must have been properly
|
|
|
|
// allocated.
|
|
|
|
// pkt is owned by the caller (and freed by the caller when needed).
|
|
|
|
// Note: as by normal demux_packet rules, you must not modify any fields in
|
|
|
|
// it, or the data referenced by it. You must create a new demux_packet
|
|
|
|
// when modifying data.
|
|
|
|
struct demux_packet *(*filter)(struct sd_filter *ft,
|
|
|
|
struct demux_packet *pkt);
|
|
|
|
|
|
|
|
void (*uninit)(struct sd_filter *ft);
|
|
|
|
};
|
|
|
|
|
|
|
|
extern const struct sd_filter_functions sd_filter_sdh;
|
2020-02-16 01:03:36 +00:00
|
|
|
extern const struct sd_filter_functions sd_filter_regex;
|
2021-07-23 16:11:23 +00:00
|
|
|
extern const struct sd_filter_functions sd_filter_jsre;
|
2017-02-02 09:53:19 +00:00
|
|
|
|
2021-07-22 17:23:13 +00:00
|
|
|
|
|
|
|
// convenience utils for filters with ass codec
|
|
|
|
|
|
|
|
// num commas to skip at an ass-event before the "Text" field (always last)
|
|
|
|
// (doesn't change, can be retrieved once on filter init)
|
|
|
|
int sd_ass_fmt_offset(const char *event_format);
|
|
|
|
|
|
|
|
// the event (pkt->buffer) "Text" content according to the calculated offset.
|
|
|
|
// on malformed event: warns and returns (bstr){NULL,0}
|
|
|
|
bstr sd_ass_pkt_text(struct sd_filter *ft, struct demux_packet *pkt, int offset);
|
|
|
|
|
2021-07-23 17:31:15 +00:00
|
|
|
// convert \0-terminated "Text" (ass) content to plaintext, possibly in-place.
|
|
|
|
// result.start is out, result.len is MIN(out_siz, strlen(in)) or smaller.
|
|
|
|
// if there's room: out[result.len] is set to \0. out == in is allowed.
|
|
|
|
bstr sd_ass_to_plaintext(char *out, size_t out_siz, const char *in);
|
|
|
|
|
2011-01-16 18:03:08 +00:00
|
|
|
#endif
|