Subject RE: [ib-support] Importing Records
Author Mike Grover
I read in past 4 gib by creating a Database as below:

create database 'x:\experian.gdb' PAGE_SIZE = 8192 LENGTH = 500000
USER 'SYSDBA' PASSWORD 'masterkey'
FILE 'x:\experian01.gdb' LENGTH = 500000 PAGES
FILE 'x:\experian02.gdb' LENGTH = 500000 PAGES
FILE 'x:\experian03.gdb' LENGTH = 500000 PAGES
FILE 'x:\experian04.gdb' LENGTH = 500000 PAGES
FILE 'x:\experian05.gdb' LENGTH = 500000 PAGES
FILE 'x:\experian06.gdb' LENGTH = 500000 PAGES
FILE 'x:\experian07.gdb' LENGTH = 500000 PAGES
FILE 'x:\experian08.gdb' LENGTH = 500000 PAGES
FILE 'x:\experian09.gdb' LENGTH = 500000 PAGES
FILE 'x:\experian10.gdb' LENGTH = 500000 PAGES
FILE 'x:\experian11.gdb' LENGTH = 500000 PAGES
FILE 'x:\experian12.gdb' LENGTH = 500000 PAGES
FILE 'x:\experian13.gdb' LENGTH = 500000 PAGES
FILE 'x:\experian14.gdb' LENGTH = 500000 PAGES
FILE 'x:\experian15.gdb' LENGTH = 500000 PAGES;


And I create my table as below:

CREATE TABLE "EXPERIAN" (
"STATE" CHAR(2) /* "STATE" */ ,
"ZIP" CHAR(5) /* "ZIP" */ ,
"ZIP4" CHAR(4) /* "ZIP4" */ ,
"DP" CHAR(3) /* "DP" */ ,
"CART" CHAR(4) /* "CART" */ ,
"CITY" CHAR(28) /* "CITY" */ ,
"USPS_HSE_" CHAR(10) /* "USPS_HSE_" */ ,
"USPS_PREDI" CHAR(2) /* "USPS_PREDI" */ ,
"USPS_ST_NM" CHAR(28) /* "USPS_ST_NM" */ ,
"USPS_SUFFI" CHAR(4) /* "USPS_SUFFI" */ ,
"USPS_PSTDI" CHAR(2) /* "USPS_PSTDI" */ ,
"UNITDESGN" CHAR(6) /* "UNITDESGN" */ ,
"UNTDESGNUM" CHAR(8) /* "UNTDESGNUM" */ ,
"NUMUNITS" CHAR(4) /* "NUMUNITS" */ ,
"ADDRUSAGEC" CHAR(2) /* "ADDRUSAGEC" */ ,
"ADDRESSQLT" CHAR(1) /* "ADDRESSQLT" */ ,
"COUNTY_COD" CHAR(3) /* "COUNTY_COD" */ ,
"COUNTYNAME" CHAR(25) /* "COUNTYNAME" */ ,
"LATITUDE" CHAR(9) /* "LATITUDE" */ ,
"LONGITUDE" CHAR(9) /* "LONGITUDE" */ ,
"PHONE" CHAR(10) /* "PHONE" */ ,
"HOMEOWNER" CHAR(1) /* "HOMEOWNER" */ ,
"PROBHOMEOW" CHAR(1) /* "PROBHOMEOW" */ ,
"HO_PROBABL" CHAR(3) /* "HO_PROBABL" */ ,
"ESTINCOME" CHAR(1) /* "ESTINCOME" */ ,
"LOR" CHAR(2) /* "LOR" */ ,
"ESTAGEPDM" CHAR(1) /* "ESTAGEPDM" */ ,
"PERSON1PID" CHAR(10) /* "PERSON1PID" */ ,
"PERSON1TYP" CHAR(1) /* "PERSON1TYP" */ ,
"FIRST_NAME" CHAR(15) /* "FIRST_NAME" */ ,
"MIDDLE_INT" CHAR(1) /* "MIDDLE_INT" */ ,
"LAST_NAME" CHAR(20) /* "LAST_NAME" */ ,
"SUFFIX1" CHAR(6) /* "SUFFIX1" */ ,
"TITLE" CHAR(6) /* "TITLE" */ ,
"ETHNIC1" CHAR(2) /* "ETHNIC1" */ ,
"GENDER1" CHAR(1) /* "GENDER1" */ ,
"DOB1" CHAR(8) /* "DOB1" */ ,
"ESTAGE1" CHAR(2) /* "ESTAGE1" */ ,
"AGE1" CHAR(2) /* "AGE1" */ ,
"EDUCATION1" CHAR(1) /* "EDUCATION1" */ ,
"MARITAL1" CHAR(1) /* "MARITAL1" */ ,
"OCCU1" CHAR(2) /* "OCCU1" */ ,
"PID2" CHAR(10) /* "PID2" */ ,
"TYPE2" CHAR(1) /* "TYPE2" */ ,
"FIRST2" CHAR(15) /* "FIRST2" */ ,
"MI2" CHAR(1) /* "MI2" */ ,
"LAST2" CHAR(20) /* "LAST2" */ ,
"SUFFIX2" CHAR(6) /* "SUFFIX2" */ ,
"TITLE2" CHAR(6) /* "TITLE2" */ ,
"ETHNIC2" CHAR(2) /* "ETHNIC2" */ ,
"GENDER2" CHAR(1) /* "GENDER2" */ ,
"DOB2" CHAR(8) /* "DOB2" */ ,
"ESTAGE2" CHAR(2) /* "ESTAGE2" */ ,
"AGE2" CHAR(2) /* "AGE2" */ ,
"EDUCATION2" CHAR(1) /* "EDUCATION2" */ ,
"MARITAL2" CHAR(1) /* "MARITAL2" */ ,
"OCCU2" CHAR(2) /* "OCCU2" */ ,
"CHILDREN" CHAR(1) /* "CHILDREN" */ ,
"HOMEPRICE" CHAR(8) /* "HOMEPRICE" */ ,
"HOMEPURDAT" CHAR(8) /* "HOMEPURDAT" */ ,
"YR_BUILT" CHAR(4) /* "YR_BUILT" */ ,
"HOMEINDICA" CHAR(2) /* "HOMEINDICA" */ ,
"MOSAICTYPE" CHAR(2) /* "MOSAICTYPE" */ ,
"MOSAICGROU" CHAR(1) /* "MOSAICGROU" */ ,
"MOSAICGLOB" CHAR(1) /* "MOSAICGLOB" */ ,
"ESTHOMEVAL" CHAR(7) /* "ESTHOMEVAL" */ ,
"MARITAL_ST" CHAR(1) /* "MARITAL_ST" */ ,
"RECNO" INTEGER NOT NULL /* "MARITAL_ST" */ ,
"NO_MAIL" CHAR(1), /* "NO_MAIL" */
PRIMARY KEY (RECNO)
);


If anybody wants to see my delphi code, Let me know!


mike...

-----Original Message-----
From: Leyne, Sean [mailto:InterbaseSupport@...]
Sent: Monday, August 13, 2001 5:01 PM
To: 'ib-support@yahoogroups.com'
Subject: RE: [ib-support] Importing Records


Mike,

I _think_ you'll have problems importing an external file over 4gb in
size, as I had suggested.

I wouldn't be surprised if didn't end up an endless loop continually
looping from bytes zero to 4GB-1byte, since the process would an ever
reach the end-of-file.

Most of the IB file I/O operations use 32 bit functions and pointers,
thus are limited to a file size of 4gb (under NT). The Firebird project
has started supporting 64bit I/O functions and pointers but haven't yet
gotten to changing the file I/O for External Files or sort/temp files.

In terms of improving the performance of your current approach, aside
from what has already been suggested, I would try an use a local
database connection if at all possible.


Sean

To unsubscribe from this group, send an email to:
ib-support-unsubscribe@egroups.com



Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/