Subject RE: [firebird-support] Help
Author Bogdan
Hi

I insert cca 1.000.000 records every day with no problems.
It is a datawarehouse database, so necessary updates are also executed.
Transaction touches cca 3.000.000 records.

Just backup and restore every 6 month.

Regards
Bogdan

Ps.: Firebird 1.5 (there were problems with 1.0.3 )

-----Original Message-----
From: firebird-support@yahoogroups.com
[mailto:firebird-support@yahoogroups.com] On Behalf Of Ivan Prenosil
Sent: Friday, June 03, 2005 12:41 PM
To: firebird-support@yahoogroups.com
Subject: Re: [firebird-support] Help

"Helen Borrie" wrote:
>>I'm migrating data from DBFs to firebird tables. The thing is that when
the
>>ammount of records is bigger (10000 records), the inserts become slower.
>>Do I have to change something ?. Do I have to perform some clean up?
>
> It's advisable to commit in batches of about 5000 - 8000 records,
> especially if you don't have a lot of memory on the server. The server
> builds up an auto-undo log structure in memory for inserts, which will be
> reset when the transaction commits.

Right, but Firebird is clever enough to not hold undo-logs
for _all_ commands executed inside transaction.
After some point the undo-logs are discarded.

> If you have control over the transaction at API level, you could disable
> this logging by setting the isc_tpb_no_auto_undo parameter.

I have inserted several millions records inside one transaction
and have not noticed any slow down (without disabling auto_undo).
Perhaps the situation is different if you have huge number of indexes ?

Ivan



++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Visit http://firebird.sourceforge.net and click the Resources item
on the main (top) menu. Try Knowledgebase and FAQ links !

Also search the knowledgebases at http://www.ibphoenix.com

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Yahoo! Groups Links








--
No virus found in this incoming message.
Checked by AVG Anti-Virus.
Version: 7.0.322 / Virus Database: 267.5.1 - Release Date: 2.6.2005