Regards,
Alexey Kovyazin
IBSurgeon
Firebird Recovery service: 
http://ib-aid.com/en/firebird-interbase-recovery-service/
Database Performance optimization: 
http://ib-aid.com/en/firebird-interbase-performance-optimization-service/

 

Hi Group,

I have a huge table to import - tens millions of rows.
From my experience, it is not good practice to commit job after importing everything, because import of rows can become slower and slower.
So, i decided to make commit after every 50.000 rows. So far so good.
Now I am at 70.000.000 rows imported.
Import of 50.000 rows last about 35 seconds = 1.428 records / second - excellent.
Commit of these 50.000 rows now takes about 85 seconds, with tendency to last longer and loner. So my import probably will never finish :( .
Before I stop everything, and start again by splitting import process in few steps, can someone explain why this is happening ?

Regards,

Zoran