Subject | Re: Numeric Calculation Error ? |
---|---|
Author | kamen_lai |
Post date | 2005-01-14T09:49:34Z |
Sorry, I don't care about the figure after decimal point , but the
major problem is the integer part -230930 and 4984.
1. The correct result should be positive but the first result is
netagive.
2. -230930 is an error result
thanks
--- In firebird-support@yahoogroups.com, "Ivan Prenosil"
<Ivan.Prenosil@s...> wrote:
major problem is the integer part -230930 and 4984.
1. The correct result should be positive but the first result is
netagive.
2. -230930 is an error result
thanks
--- In firebird-support@yahoogroups.com, "Ivan Prenosil"
<Ivan.Prenosil@s...> wrote:
> What result do you expect ?RDB$DATABASE
> Because the resulting datatype has scale 8, both the ...0041
> and ...00006 at the end of your results are wrong.
>
> Ivan
>
> > i think the last result 4984.2725939500006 is correct.
> >
> > By the way , i use ibexpert , ib_sql by IBO & isql , both show same
> > results.
> >
> >
> >
> > --- In firebird-support@yahoogroups.com, "Ivan Prenosil"
> > <Ivan.Prenosil@s...> wrote:
> >> > select 0.00 - (13060.45*9.031631) - (13060.45*8.65) from
> >> >RDB$DATABASE
> >> > the wrong result is -230930.057593950041
> >> >
> >> > but
> >> >
> >> > select 0.00 + (13060.45*9.031631) - (13060.45*8.65) from
> >> >application.
> >> > get correct result is 4984.2725939500006
> >> >
> >> > in IB 6.01. & WI-V1.5.1.4481 Firebird 1.5
> >>
> >> Both results are wrong. Probably wrong formatting in your
> >> Did you try ISQL ?
> >>
> >> Ivan