RepoMirrors
/
ffmpeg
mirror of https://git.ffmpeg.org/ffmpeg.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity

avcodec/hqxdsp: Fix runtime error: signed integer overflow: -196264 * 11585 cannot be represented in type 'int' 

Fixes: 1568/clusterfuzz-testcase-minimized-5944868608147456

Found-by: continuous fuzzing process https://github.com/google/oss-fuzz/tree/master/targets/ffmpeg
Signed-off-by: Michael Niedermayer <michael@niedermayer.cc>
This commit is contained in:
Michael Niedermayer 2017-05-14 14:06:56 +02:00
parent f2c539d350
commit b923213276
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
libavcodec/hqxdsp.c
View File

@ -47,8 +47,8 @@ static inline void idct_col(int16_t *blk, const uint8_t *quant)
t5 = t1 * 2 + t3; t5 = t1 * 2 + t3;
t6 = t2 - t3; t6 = t2 - t3;
t7 = t3 * 2 + t6; t7 = t3 * 2 + t6;
t8 = (t6 * 11585) >> 14; t8 = (int)(t6 * 11585U) >> 14;
t9 = (t7 * 11585) >> 14; t9 = (int)(t7 * 11585U) >> 14;
tA = (int)(s2 * 8867U - s6 * 21407U) >> 14; tA = (int)(s2 * 8867U - s6 * 21407U) >> 14;
tB = (int)(s6 * 8867U + s2 * 21407U) >> 14; tB = (int)(s6 * 8867U + s2 * 21407U) >> 14;
tC = (s0 >> 1) - (s4 >> 1); tC = (s0 >> 1) - (s4 >> 1);