ffmpeg

Commit Graph

Author	SHA1	Message	Date
Timo Rothenpieler	f3fb528cd5	avutil/half2float: move tables to header-internal structs Having to put the knowledge of the size of those arrays into a multitude of places is rather smelly.	2022-08-19 22:09:36 +02:00
Timo Rothenpieler	cb8ad005bb	avutil/half2float: adjust conversion of NaN IEEE-754 differentiates two different kind of NaNs. Quiet and Signaling ones. They are differentiated by the MSB of the mantissa. For whatever reason, actual hardware conversion of half to single always sets the signaling bit to 1 if the mantissa is != 0, and to 0 if it's 0. So our code has to follow suite or fate-testing hardware float16 will be impossible.	2022-08-19 22:09:36 +02:00
Timo Rothenpieler	b42925264a	avutil: move half-precision float helper to avutil	2022-08-19 22:09:36 +02:00

Author

SHA1

Message

Date

Timo Rothenpieler

f3fb528cd5

avutil/half2float: move tables to header-internal structs

Having to put the knowledge of the size of those arrays into a multitude
of places is rather smelly.

2022-08-19 22:09:36 +02:00

Timo Rothenpieler

cb8ad005bb

avutil/half2float: adjust conversion of NaN

IEEE-754 differentiates two different kind of NaNs.
Quiet and Signaling ones. They are differentiated by the MSB of the
mantissa.

For whatever reason, actual hardware conversion of half to single always
sets the signaling bit to 1 if the mantissa is != 0, and to 0 if it's 0.
So our code has to follow suite or fate-testing hardware float16 will be
impossible.

2022-08-19 22:09:36 +02:00

Timo Rothenpieler

b42925264a

avutil: move half-precision float helper to avutil

2022-08-19 22:09:36 +02:00

3 Commits