Subject | Re: Handling large imports while system is in production |
---|---|
Author | rudibrazil78 |
Post date | 2013-02-06T16:45:44Z |
--- In firebird-support@yahoogroups.com, Ann Harrison wrote:
Can you provide some internet resources I could look up?
>Ann, Im having a hard time trying to find out some concise manual or tutorial on external files/tables and how to import with them (Im finding out a lot of separate, segmented articles tho).
> On Wed, Feb 6, 2013 at 8:14 AM, André Knappstein <
> Knappstein@...> wrote:
>
> >
> > > Exporting the .DBF to a delimited text file and then importing using an
> > > external table would be faster?
> >
> > a consultant I know has made very good experience with this.
> >
> > He was regularly importing DBF tables (level 5 and 7) via ODBC.
> > I encouraged him to try exporting them to CSV first, then to integrate
> > them as external tables. He reported a massive speed gain (2 minutes
> > vs. 2 hours).
> >
> > Loading data from a file requires a round trip between the database and
> client for each row, even if you're using prepared statements. If you're
> not using prepared statements, you should. Importing data from an external
> table requires one round trip between client and database .All the
> processing happens inside the database. If your situation allows you to
> make the conversion to an external table and make the table available to
> the database, take advantage of it to improve load times. Excellent
> suggestion.
>
> Best,
>
> Ann
>
>
> [Non-text portions of this message have been removed]
>
Can you provide some internet resources I could look up?