8d18bc550e
fate-run: make avconv() properly deal with multiple inputs.
2012-07-09 08:22:38 +02:00
7263cd5544
fate: convert codec-regression.sh to makefile rules
...
Signed-off-by: Mans Rullgard <mans@mansr.com>
2012-05-29 08:35:41 +01:00
47b5996bb0
fate: allow tests to specify unit size for psnr comparison
...
Signed-off-by: Mans Rullgard <mans@mansr.com>
2012-05-29 08:27:19 +01:00
11e33402ca
fate: use standard diff options
...
diff -w is not a standard option. This fixes the reference files
to match what the tests actually output and switches to using the
standard diff -b which is sufficient to handle different line ending
styles.
Signed-off-by: Mans Rullgard <mans@mansr.com>
2012-05-15 19:47:18 +01:00
0ff0af731c
fate: use diff -b in oneline comparison
...
This is simpler and should take care of any problems with mixed
line ending styles.
Signed-off-by: Mans Rullgard <mans@mansr.com>
2012-05-15 15:23:34 +01:00
4bfa67bdad
Add probe fate tests to test for regressions in detecting media types.
...
Signed-off-by: Alex Converse <alex.converse@gmail.com>
2012-05-07 10:14:51 -07:00
40fa14f775
fate: Add oneline comparison method
...
Signed-off-by: Alex Converse <alex.converse@gmail.com>
2012-05-07 10:14:50 -07:00
9cc338b1de
FATE: pass the decoded output format and audio source file to enc_dec_pcm
...
This will allow decoding to md5 and doing a diff comparison to a reference
checksum instead of a fuzzy stddev or oneoff comparison.
Signed-off-by: Mans Rullgard <mans@mansr.com>
2012-04-18 22:26:56 -04:00
c755b1fbbc
FATE: specify the input format when decoding in enc_dec_pcm()
...
The output format is not always the same as the file extension,
which is sometimes required for correct probing. We can avoid
probing by specifying the format since it is already known.
2012-04-18 22:26:49 -04:00
a56fba502e
fate: make compare() function compatible with POSIX bc
...
Signed-off-by: Mans Rullgard <mans@mansr.com>
2012-03-18 18:40:59 +00:00
b1740cb00a
fate: fix enc_dec_pcm tests with remote target
...
Signed-off-by: Mans Rullgard <mans@mansr.com>
2012-03-17 17:28:33 +00:00
90e5b58a53
FATE: add capability for audio encode/decode tests with fuzzy psnr comparison
...
This allows for testing floating-point audio encoders across different
platforms where exact comparisons are unreliable due to float rounding
differences.
2012-03-15 17:06:17 -04:00
cffd7580bb
FATE: allow a tolerance in the size comparison in do_tiny_psnr()
...
This will allow for comparing decoded output to the original source when the
decoded size is not exactly the same as the original size.
2012-03-15 14:40:31 -04:00
bb6842966e
FATE: use absolute difference from a target value in do_tiny_psnr()
...
This will allow comparison to original pre-encoded content instead of
comparing to expected decoded output.
2012-03-15 14:40:31 -04:00
5ecadc6620
FATE: allow tests to set CMP_SHIFT to pass to tiny_psnr
...
This will allow adjusting for any encoder or decoder delay when doing
comparisons.
2012-03-15 14:40:24 -04:00
0720d263ea
FATE: use $fuzz directly in do_tiny_psnr() instead of passing it around
2012-03-15 12:06:56 -04:00
018f39ef49
FATE: add CPUFLAGS variable, mapping to -cpuflags avconv option.
2012-03-06 15:03:36 +01:00
0836d48a16
fate: run avconv with -nostats flag
...
Signed-off-by: Mans Rullgard <mans@mansr.com>
2011-10-09 16:53:12 +01:00
dec4b4705f
fate: use 'run' helper for seek-test
...
This is simpler, and the actual seek-test command is printed with V=1.
Signed-off-by: Mans Rullgard <mans@mansr.com>
2011-09-28 02:30:30 +01:00
bc5acfa7af
fate: use +frame+slice named constants instead of '3'
2011-09-05 12:11:08 +02:00
6291d7e416
Make a copy of ffmpeg under a new name -- avconv.
...
It will be further developed with a few incompatible changes.
ffmpeg.c will stay as is for some time, so any scripts using it won't be
broken.
2011-08-12 13:27:30 +02:00
191c5f8ff3
build: move tests/seek_test.c to libavformat and reuse generic build rules
2011-07-13 13:27:15 +02:00
84757de0f5
fate: add 'null' comparison method
...
Setting CMP=null uses stdout from the test as the diff record in
the report without further inspection. This can be useful when
the exit status of the test itself determines success while the
output is informative.
Signed-off-by: Mans Rullgard <mans@mansr.com>
2011-07-04 09:54:16 +01:00
ea57502c82
fate: remove output redirections from old regtest scripts
...
All tests are run through the fate-run.sh script which already
sets up redirections. Using the outputs set there simplifies
things somewhat.
Signed-off-by: Mans Rullgard <mans@mansr.com>
2011-06-21 12:37:58 +01:00
3283f274fd
FATE: allow forcing thread-type when doing threaded fate runs.
...
Signed-off-by: Ronald S. Bultje <rsbultje@gmail.com>
2011-04-21 19:36:45 -04:00
7851eb68c6
fate: add support for multithread testing
...
Add a THREADS variable to fate calls.
2011-03-23 01:17:20 +01:00
c4795e8069
fate: print commands being executed with V=1
...
Originally committed as revision 25161 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-09-23 09:55:31 +00:00
078ae66b4b
fate: set LC_ALL=C to avoid locale interference
...
Originally committed as revision 24889 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-08-23 17:34:08 +00:00
b42c483f07
fate-run: use 'run' function in 'ffmpeg' function
...
Originally committed as revision 24837 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-08-19 16:51:24 +00:00
91de2c0a73
fate: add -v 0 to ffmpeg flags
...
Originally committed as revision 24836 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-08-19 16:51:21 +00:00
dff1fc51b2
fate-run: add helper to run things on target
...
Originally committed as revision 24694 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-08-04 06:56:59 +00:00
61a187b081
fate: fix non-standard use of bc
...
Originally committed as revision 24651 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-08-01 15:28:42 +00:00
5b60c29339
fate: fix signal name translation
...
Originally committed as revision 24650 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-08-01 12:29:03 +00:00
4e705a6806
fate: translate exit status to signal name
...
Originally committed as revision 24623 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-31 16:53:09 +00:00
b82be63688
fate: create report files
...
Originally committed as revision 24529 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-26 23:44:06 +00:00
8fae6e7c11
Unbreak parallel lavfi testing
...
Originally committed as revision 24485 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-24 17:13:32 +00:00
157c924176
fate: delete useless artifacts after running each test
...
Originally committed as revision 24395 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-21 20:49:36 +00:00
bcb0a1546d
fate: keep stderr from failing tests
...
Originally committed as revision 24394 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-21 20:49:34 +00:00
ffe72624e7
fate: run diff even if command fails
...
The diff may provide useful information even if the command was
unsuccessful. The test is still treated as failed in this case.
Originally committed as revision 24353 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-20 12:54:43 +00:00
9a3f31efcb
fate: allow running regtests through fate frontend
...
Originally committed as revision 24347 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-20 10:19:28 +00:00
cdaf4b79bb
fate: simplify test runner slightly
...
All tests use the provided helper functions so prepending $target_exec
and using eval is no longer required.
Originally committed as revision 24317 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-18 20:46:44 +00:00
2b18c451bd
fate: add some helper functions to simplify test rules
...
Originally committed as revision 24314 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-18 20:19:30 +00:00
f0388cf716
fate: apply TARGET_EXEC only to commands starting with absolute path
...
Originally committed as revision 24313 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-18 20:19:25 +00:00
d2f33c8021
fate: use our variable names in test rules imported from Mike's db
...
Originally committed as revision 24312 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-18 20:19:21 +00:00
122a9af76b
fate-run: rename some variables consistently with other files
...
Originally committed as revision 24311 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-18 20:19:16 +00:00
e153cfa867
fate: add stddev comparator
...
This allows CMP=stddev in test rules. The test passes if the reported
stddev is <= the FUZZ value (default 1).
Originally committed as revision 24289 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-17 15:02:34 +00:00
26e87a2261
fate: whitespace cosmetics
...
Originally committed as revision 24288 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-17 15:02:32 +00:00
83b203dc94
fate: ensure file sizes match in oneoff tests
...
Originally committed as revision 24164 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-10 16:58:00 +00:00
150ef830f5
fate: fail with a sensible error message if reference file is missing
...
Originally committed as revision 24152 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-09 23:55:16 +00:00
7d610af6f2
fate: delete output files from successful tests
...
Originally committed as revision 24150 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-09 23:36:04 +00:00
Anton Khirnov
Mans Rullgard
Ronald S. Bultje
Justin Ruggles
Diego Biurrun
Ronald S. Bultje
Luca Barbato