| Subject | RE: [firebird-support] External File Construction |
|---|---|
| Author | Epstein, Ed |
| Post date | 2004-02-12T03:02:41Z |
CSV is how we receive the data. I am required to parse it correctly and
then insert into the appropriate tables. Not a big deal really. I can
parse it just fine. Its just that inside of VB I can only acheive that
ceiling of 300 tps to insert the data into IB. I was looking at External
Files since there was a suggestion that creating the external file and then
declaring it to IB would be the fastest way to insert the data. It
certainly looks like it, but its a daunting task when I need to 500,000 rows
regulary with about 15 fields per row. Last i looked I think i was right
around 4k of data per row.
The FBExport tool that was created uses a custom file structure (not CSV) to
export and import its data from disk. I needed to know how to create that
structure to use it properly.
Edwin Epstein
privileged and confidential and protected from disclosure.
If the reader of this message is not the intended recipient, or an employee
or agent responsible for delivering this message
to the intended recipient, you are hereby notified that any dissemination,
distribution or copying of this communication is
strictly prohibited. If you have received this communication in error,
please notify us immediately by replying to the message and
deleting it from your computer.
-----Original Message-----
From: Helen Borrie [mailto:helebor@...]
Sent: Wednesday, February 11, 2004 6:40 PM
To: firebird-support@yahoogroups.com
Subject: RE: [firebird-support] External File Construction
At 04:59 PM 11/02/2004 -0800, you wrote:
you the source for a little app built with the IBObjects TIB_Import
component, that reads a big, ugly CSV file into a big, ugly input table and
then filters the data into a nice, refined table. CSV isn't suitable for
use as an external file because it isn't fixed format.
/heLen
Yahoo! Groups Links
then insert into the appropriate tables. Not a big deal really. I can
parse it just fine. Its just that inside of VB I can only acheive that
ceiling of 300 tps to insert the data into IB. I was looking at External
Files since there was a suggestion that creating the external file and then
declaring it to IB would be the fastest way to insert the data. It
certainly looks like it, but its a daunting task when I need to 500,000 rows
regulary with about 15 fields per row. Last i looked I think i was right
around 4k of data per row.
The FBExport tool that was created uses a custom file structure (not CSV) to
export and import its data from disk. I needed to know how to create that
structure to use it properly.
Edwin Epstein
> Continuity Partners Inc.CONFIDENTIALITY NOTICE: The information contained in this message may be
> 2753 S. Highland Dr.
> Suite 1010
> Las Vegas, Nevada 89109
> (702) 851-7850 Ext. 247
> eepstein@...
>
privileged and confidential and protected from disclosure.
If the reader of this message is not the intended recipient, or an employee
or agent responsible for delivering this message
to the intended recipient, you are hereby notified that any dissemination,
distribution or copying of this communication is
strictly prohibited. If you have received this communication in error,
please notify us immediately by replying to the message and
deleting it from your computer.
-----Original Message-----
From: Helen Borrie [mailto:helebor@...]
Sent: Wednesday, February 11, 2004 6:40 PM
To: firebird-support@yahoogroups.com
Subject: RE: [firebird-support] External File Construction
At 04:59 PM 11/02/2004 -0800, you wrote:
>I have been looking at your tool, but I don't see any instructions on howto
>construct a file using your custom file structure. I want to be usingthis
>on a regular basis and would need my own frontend to construct the fileCan you clarify your dev environment options? If it's Delphi, I can send
>without having the data be exported from another database.
you the source for a little app built with the IBObjects TIB_Import
component, that reads a big, ugly CSV file into a big, ugly input table and
then filters the data into a nice, refined table. CSV isn't suitable for
use as an external file because it isn't fixed format.
/heLen
Yahoo! Groups Links