Subject | Re: Maximum speed for insert with embedded server |
---|---|
Author | Rado Antloga |
Post date | 2004-08-12T17:38:10Z |
Sorry I didn't have time to reply before.
I have tested changing parameters:
MaxUnflushedWrites and MaxUnflushedWriteTime.
I need local fast database for processing
data. Real data is in FB database with forced
writes = On. When all is done then results are
written back to server. So I need to (get) export
records from server to local database and
after some time (days) results must be imported
back to server. I was testing embedded FB for
local database and the best way is to import
records using external files. My first message
was 15 seconds for 1 million records but I was
wrong it was for 100.000 records. Sorry for
wrong info. But I think this will be also fast enough.
I can see the problem only when result records
will be written back to server (1 million and more).
I will have to think what can I do about that.
Regards,
Rado Antloga
--- In firebird-support@yahoogroups.com, German Gentile en Listas
<listas.ggentile@c...> wrote:
6/D=groups/S=1705115386:HM/EXP=1092319699/A=2164331/R=0/SIG=11eaelai9/
*http://www.netflix.com/Default?mqso=60183351>
I have tested changing parameters:
MaxUnflushedWrites and MaxUnflushedWriteTime.
I need local fast database for processing
data. Real data is in FB database with forced
writes = On. When all is done then results are
written back to server. So I need to (get) export
records from server to local database and
after some time (days) results must be imported
back to server. I was testing embedded FB for
local database and the best way is to import
records using external files. My first message
was 15 seconds for 1 million records but I was
wrong it was for 100.000 records. Sorry for
wrong info. But I think this will be also fast enough.
I can see the problem only when result records
will be written back to server (1 million and more).
I will have to think what can I do about that.
Regards,
Rado Antloga
--- In firebird-support@yahoogroups.com, German Gentile en Listas
<listas.ggentile@c...> wrote:
> Rado Antloga wrote:<milanb@k...>
>
> > Thank you I did that.
> > I have decided to use external files for that purpose.
> > My test for loading 1 million records takes 15 seconds.
> > This is great :-)) !!!
> >
> With that option, when the databse will write the changes to disk/
> Is that time under config?
> TIA
>
> > --- In firebird-support@yahoogroups.com, Milan Babuskov
> > wrote:<http://us.ard.yahoo.com/SIG=129fveikn/M=298184.5285298.6392945.300117
> > > rado_antloga wrote:
> > > > How can I change firebird.conf to get maximum speed
> > > > for inserting 1 million records. RAM is not a problem.
> > > > I was changing DefaultDbCachePages, MaxUnflushedWrites,
> > > > MaxUnflushedWriteTime but I could only improve speed
> > > > for about 3 s. I could insert in MSDE with OLEDB rawset
> > > > in 17 seconds. With FB it takes 1 minute 22 seconds.
> > >
> > > Turn the forced writes off. You get basically the same thing as
> > with
> > > MSDE (speed and no certainty ;)
> > >
> > > --
> > > Milan Babuskov
> > > http://fbexport.sourceforge.net
> > > http://www.flamerobin.org
> >
> >
> > *Yahoo! Groups Sponsor*
> > ADVERTISEMENT
> > click here
> >
6/D=groups/S=1705115386:HM/EXP=1092319699/A=2164331/R=0/SIG=11eaelai9/
*http://www.netflix.com/Default?mqso=60183351>
> >subject=Unsubscribe>
> >
> >
> > *Yahoo! Groups Links*
> >
> > * To visit your group on the web, go to:
> > http://groups.yahoo.com/group/firebird-support/
> >
> > * To unsubscribe from this group, send an email to:
> > firebird-support-unsubscribe@yahoogroups.com
> > <mailto:firebird-support-unsubscribe@yahoogroups.com?
> >
> > * Your use of Yahoo! Groups is subject to the Yahoo! Terms of
> > Service <http://docs.yahoo.com/info/terms/>.
> >
> >