Subject | AW: [firebird-support] CAST/ Round disparity 1.5->2.1 |
---|---|
Author | Michael Möhle |
Post date | 2008-08-01T14:16:50Z |
Hm, here I get 65.56 on all of my Dialect 1 DBs wheras I get 65.57 on
Dialect 3 DBs on the same machine and same IB Version!
Did you changed the Databasedialect while upgrading?
Michael
_____
Von: firebird-support@yahoogroups.com
[mailto:firebird-support@yahoogroups.com] Im Auftrag von Helen Borrie
Gesendet: Freitag, 1. August 2008 15:39
An: firebird-support@yahoogroups.com
Betreff: Re: [firebird-support] CAST/ Round disparity 1.5->2.1
At 08:09 PM 1/08/2008, you wrote:
hosts, all 32-bit).
./helen
[Non-text portions of this message have been removed]
Dialect 3 DBs on the same machine and same IB Version!
Did you changed the Databasedialect while upgrading?
Michael
_____
Von: firebird-support@yahoogroups.com
[mailto:firebird-support@yahoogroups.com] Im Auftrag von Helen Borrie
Gesendet: Freitag, 1. August 2008 15:39
An: firebird-support@yahoogroups.com
Betreff: Re: [firebird-support] CAST/ Round disparity 1.5->2.1
At 08:09 PM 1/08/2008, you wrote:
>You can probably poke your finger at this with disdain but this simplifiednot
>query has always returned 65.57 up thru FB1.5.5
>But now in FB2.1 it returns 65.56
>
>SELECT
> CAST(CAST(1.5 AS NUMERIC(18,2))
> * CAST(43.71 AS NUMERIC(18,2))
> * (CAST(0.00 AS DOUBLE PRECISION)/100+1.00)
> AS NUMERIC(18,2))
> AS ITEMTOTAL
> FROM RDB$DATABASE
>
>The zero value in the double cast is a constant in this context but it's
>in real life.I get the same result (65.57) on Fb 1.5.5, 2.04 and 2.1.1 (on separate Win2K
>It has something to do with this cast as double precision - it's changed in
>FB2.1.
>My focus here is on loss of consistency, not precision.
>
>Does anyone know why consistency has been altered? Is it because some grave
>fault was discovered i.e. precision was in error all this time?
hosts, all 32-bit).
./helen
[Non-text portions of this message have been removed]