|Subject||Re: [firebird-support] Import - slower and slower commits|
There is a fix in 254 snapshot for similar problem.
Download fresh 2.5.4 Firebird snapshot and try it.
Regards, Alexey Kovyazin IBSurgeon Firebird Recovery service: http://ib-aid.com/en/firebird-interbase-recovery-service/ Database Performance optimization: http://ib-aid.com/en/firebird-interbase-performance-optimization-service/
I have a huge table to import - tens millions of rows.
From my experience, it is not good practice to commit job after importing everything, because import of rows can become slower and slower.
So, i decided to make commit after every 50.000 rows. So far so good.
Now I am at 70.000.000 rows imported.
Import of 50.000 rows last about 35 seconds = 1.428 records / second - excellent.
Commit of these 50.000 rows now takes about 85 seconds, with tendency to last longer and loner. So my import probably will never finish :( .
Before I stop everything, and start again by splitting import process in few steps, can someone explain why this is happening ?