Subject | RE: [firebird-support] 32 bit vs 64 bit arthmetic |
---|---|
Author | Leyne, Sean |
Post date | 2016-01-18T17:34:45Z |
Tim,
Sean
> So I've got this stored procedure which takes DECIMAL(18,6) parameters andPlease post the logic for the SP and a reproducible example, this may be worthy of a bug tracker ticket.
> returns DECIMAL(18,12) results, and internally copies stuff into and out of
> DOUBLE PRECISION variables which it uses to call a UDF to do the actual
> calculations.
>
> And the results are different (in the 8th decimal place or so) between
> running on 32 bit and 64 bit systems.
Sean