Math with large integral values is incorrect.

Question

LadyCailinBot opened this issue 11 years ago · 1 comments

LadyCailinBot commented 11 years ago

CMDHELPER-2893 - Reported by CyaNox

{code:title=test.ms}
console(1234567890 * 1234567890)


{code:title=Expected}
1524157875019052100

{code:title=Actual result}
1524157875019052032


If the numbers are even larger yet still fit in the 64 bit address space this issue becomes even more prevalent.

LadyCailinBot · Answer 1 · 2014-01-18T06:17:37.000Z

Comment by CyaNox

I created a fix for this and also related math functions that have the same issue #201.