Subject | Re: Looking for library to create external tables without FB |
---|---|
Author | maximshiryaev |
Post date | 2008-04-16T12:27:22Z |
Thanks.
DBF is read by TDBF (tdbf.sourceforge.net). Simple scroll is very
fast - less than 2 minutes.
No triggers, no indicies, no forced writes, one transaction for each
1000 records, prepared query, tried ZEOS instead of DBX, tried
embedded. Embedded+ZEOS is the winner but is still not fast...
Will try FBExport. It's file format is very well documented and
supports nulls as I see. 4 minutes is a very good time indeed though
I have 12mln to pump...
Maxim.
--- In firebird-support@yahoogroups.com, Milan Babuskov <milanb@...>
wrote:
DBF is read by TDBF (tdbf.sourceforge.net). Simple scroll is very
fast - less than 2 minutes.
No triggers, no indicies, no forced writes, one transaction for each
1000 records, prepared query, tried ZEOS instead of DBX, tried
embedded. Embedded+ZEOS is the winner but is still not fast...
Will try FBExport. It's file format is very well documented and
supports nulls as I see. 4 minutes is a very good time indeed though
I have 12mln to pump...
Maxim.
--- In firebird-support@yahoogroups.com, Milan Babuskov <milanb@...>
wrote:
>external
> maximshiryaev wrote:
> > I'm looking for a tool to bulk load from DBFs. Probably via
> > table. Simple way of reading DBF and executing INSERT's takes 30min
> > for 1mln records. Copy of 1 mln inside FB between two tablestakes 5
> > min for 1 mln records.into .txt file?
>
> And how long does it take to read in DBF and just dump it
>much
> My guess is: 25 min :)
>
> Anyway, it all depends on your hardware, but 30 min seems way too
> (I just used FBExport to insert a 1.6mil records from .fbx file toslow?
> Firebird and it took about 4 minutes).
>
> Are you using prepared statements and parameters?
> Do you disable triggers and/or indexes while importing?
>
> Is it possible that it's really DBF access layer that reads it too
>
> --
> Milan Babuskov
> http://www.flamerobin.org
>