This is what I ended up doing.. Made a world of difference.. Working well now.. can interate through 10 million records in about 20 seconds now..

----- Original Message -----
From: Doug Chamberlin
To: IBObjects@yahoogroups.com
Sent: Thursday, September 04, 2008 3:31 PM
Subject: Re: [IBO] Performance..


Gordon Hamm wrote:
> i actually tried to load the data into a memory table, but it was over 2 gigs..
> Maybe a simple array would be better..

My first reaction to this was: Why are you using a database for these
iterations? 8 million records of 10 fields (each taking 10 bytes) would
only constitute 800 MB of data. That fits into a large array quite
nicely these days. Therefore, I would read in the whole dataset, iterate
'till your hearts content, and then write out the whole shebang in the end.





[Non-text portions of this message have been removed]