Subject | Re: [firebird-support] Import data from flat files |
---|---|
Author | Thomas Miller |
Post date | 2003-09-30T20:29:32Z |
Glad this is working for you. If you want it to go faster, every
500,000 records, add
COMMIT;
The more commits you do the faster it will go. I would think no less
the 10,000 records
won't make much of a difference, but I would think every 100,000 records
would give
you a nice speed increase.
Oleg Lebedev wrote:
Thomas Miller
Delphi Client/Server Certified Developer
BSS Accounting & Distribution Software
BSS Enterprise Accounting FrameWork
http://www.bss-software.com
http://sourceforge.net/projects/dbexpressplus
500,000 records, add
COMMIT;
The more commits you do the faster it will go. I would think no less
the 10,000 records
won't make much of a difference, but I would think every 100,000 records
would give
you a nice speed increase.
Oleg Lebedev wrote:
>Well,--
>This seems like a convoluted way to import data from a flat file into a
>database.
>
>What I ended up doing is importing data from a flat file into my
>PostgreSQL database. Then, using postgres pg_dump utility, I exported
>data from the postgres database in a file in a form of INSERT
>statements. Finally, I created my table in my FB database and ran the
>INSERTs script in there.
>Inserting 1,500,000 rows took 30mins., which is not so bad.
>I have another table, which contains 6,000,000 rows, so I guess I will
>be having a long lunch today :)
>I am not sure if I have my write-back cache enabled or not. I will make
>sure to disable it before I do the next insert.
>Is there a way to find out whether the async write is enabled or
>disabled?
>
>Thanks.
>
>
Thomas Miller
Delphi Client/Server Certified Developer
BSS Accounting & Distribution Software
BSS Enterprise Accounting FrameWork
http://www.bss-software.com
http://sourceforge.net/projects/dbexpressplus