Improve computeNextExponential tail performance and accuracy

XMLWordPrintable

    • Type: Enhancement
    • Resolution: Fixed
    • Priority: P4
    • 22
    • Affects Version/s: None
    • Component/s: core-libs
    • b07
    • generic
    • generic

      Repeatedly adding DoubleZigguratTables.exponentialX0 to extra causes a rounding error to accumulate at the tail of the distribution;

      we can fixe that by tracking the multiple of exponentialX0 as a long. It also optimizes a few expressions using Math::fma.

      Submit on behalf of Chris Hennick (hennickc@amazon.com)

            Assignee:
            Xin Liu
            Reporter:
            Xin Liu
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved: