RepoMirrors/musl
1
0
Fork 0
mirror of git://git.musl-libc.org/musl synced 2024-12-30 02:42:37 +00:00
Code Issues Packages Projects Releases Wiki Activity

fix printf precision specifier for hex floats on non-ld80 archs

Browse Source 
the code to perform rounding to the desired precision wrongly assumed
the long double mantissa was an integral number of nibbles (hex
digits) in length. this is true for 80-bit extended precision (64-bit
mantissa) but not for double (53) or quad (113).

scale the rounding value by 1<<(LDBL_MANT_DIG%4) to compensate.
This commit is contained in:
Rich Felker 2018-08-23 15:24:03 -04:00
parent 6aeb131b4c
commit cfa0a54c08
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
src/stdio/vfprintf.c
View File

@ -220,6 +220,7 @@ static int fmt_fp(FILE *f, long double y, int w, int p, int fl, int t)
else re=LDBL_MANT_DIG/4-1-p; else re=LDBL_MANT_DIG/4-1-p;
if (re) { if (re) {
round *= 1<<(LDBL_MANT_DIG%4);
while (re--) round*=16; while (re--) round*=16;
if (*prefix=='-') { if (*prefix=='-') {
y=-y; y=-y;