[Cfp-interest 2899] incorrect definitions of *_DECIMAL_DIG and DECIMAL_DIG

Vincent Lefevre vincent at vinc17.net
Wed Sep 13 02:47:30 PDT 2023


The *_DECIMAL_DIG macros are defined as follows:

  number of decimal digits, n, such that any floating-point number
  with p radix b digits can be rounded to a floating-point number
  with n decimal digits and back again without change to the value,
  [...]

However, this is true only if rounding to nearest is used for these
roundings. Ditto for the DECIMAL_DIG macro.

-- 
Vincent Lefèvre <vincent at vinc17.net> - Web: <https://www.vinc17.net/>
100% accessible validated (X)HTML - Blog: <https://www.vinc17.net/blog/>
Work: CR INRIA - computer arithmetic / AriC project (LIP, ENS-Lyon)


More information about the Cfp-interest mailing list