[Cfp-interest 2899] incorrect definitions of *_DECIMAL_DIG and DECIMAL_DIG
Vincent Lefevre
vincent at vinc17.net
Wed Sep 13 02:47:30 PDT 2023
The *_DECIMAL_DIG macros are defined as follows:
number of decimal digits, n, such that any floating-point number
with p radix b digits can be rounded to a floating-point number
with n decimal digits and back again without change to the value,
[...]
However, this is true only if rounding to nearest is used for these
roundings. Ditto for the DECIMAL_DIG macro.
--
Vincent Lefèvre <vincent at vinc17.net> - Web: <https://www.vinc17.net/>
100% accessible validated (X)HTML - Blog: <https://www.vinc17.net/blog/>
Work: CR INRIA - computer arithmetic / AriC project (LIP, ENS-Lyon)
More information about the Cfp-interest
mailing list