Subject | RE: [ib-support] Re: Out of memory |
---|---|
Author | Alan McDonald |
Post date | 2003-02-10T10:29:25Z |
Sounds to me like it was telling you something very sensible.
Let's imagine for a moment that your database table grows over time until it
has 50 million records. Does your current design in any way cater for this?
To select 50 million records (or even 228,000 records) in one hit is not a
good idea. There are many ways to design your processing such that only
small numbers of records are snatched off the server at any one time. I
would seriously think of these ways and ways in which you can normalise your
data such that there is little or no need to see all records in a table in
one select. Your performance will improve a hundred or more fold too. You
might be very surprised.
Alan
-----Original Message-----
From: Michael Vilhelmsen <Michael.Vilhelmsen@...>
[mailto:Michael.Vilhelmsen@...]
Sent: Monday, 10 February 2003 9:12 PM
To: ib-support@yahoogroups.com
Subject: [ib-support] Re: Out of memory
To answer my own question.
I set UniDirectional to true, and the problem was gone.
But I still would like to know why I got the error in the first place.
And if I could do something to avoid it !
Michael
--- In ib-support@yahoogroups.com, "Michael Vilhelmsen
<Michael.Vilhelmsen@M...>" <Michael.Vilhelmsen@M...> wrote:
ib-support-unsubscribe@egroups.com
Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/
Let's imagine for a moment that your database table grows over time until it
has 50 million records. Does your current design in any way cater for this?
To select 50 million records (or even 228,000 records) in one hit is not a
good idea. There are many ways to design your processing such that only
small numbers of records are snatched off the server at any one time. I
would seriously think of these ways and ways in which you can normalise your
data such that there is little or no need to see all records in a table in
one select. Your performance will improve a hundred or more fold too. You
might be very surprised.
Alan
-----Original Message-----
From: Michael Vilhelmsen <Michael.Vilhelmsen@...>
[mailto:Michael.Vilhelmsen@...]
Sent: Monday, 10 February 2003 9:12 PM
To: ib-support@yahoogroups.com
Subject: [ib-support] Re: Out of memory
To answer my own question.
I set UniDirectional to true, and the problem was gone.
But I still would like to know why I got the error in the first place.
And if I could do something to avoid it !
Michael
--- In ib-support@yahoogroups.com, "Michael Vilhelmsen
<Michael.Vilhelmsen@M...>" <Michael.Vilhelmsen@M...> wrote:
> Hianother
>
> I have an appl. that contects to an Firebird DB (1.0).
> In my appl. I have made a rutine, that select 228.000 records, and
> parse through each of them.
> For each record I call a stored procedure that either update
> record or insert a record.this
>
> That'll say it will update / insert up to 228.000 records.
>
> Does two query both uses the same transaction.
>
> Before starting I do a
>
> if not MyTrans.active then
> MyTrans.StartTransaction
>
> After the rutine has run through I do
>
> MyTrans.Commit
>
> On a smaller dataset it completes with no error.
> But on this bigger dataset (which I doesn't find that big) I get
> error:of
>
> Project xxx raised exception class EOutOfMemory with message "Out
> memory". Process stopped.To unsubscribe from this group, send an email to:
>
> I get it running both from inside D5 and running my appl. alone.
>
> I kept an eye on my Task manager and all the time I had at least 96
> Mb of physical memory, and my swapfile wasn't used that much.
>
> I have even tried running the program without any other programs
> running on my machine at the same time.
> Same result.
>
> Is this caursed by my program, because it doesn't allocate enough
> memory for it self ?
> Can I change that ?
>
> I know in Turbo Pascal 7 I could set some compiler directives to
> increase the amount of memory available to my program.
>
>
> Regards
> Michael
ib-support-unsubscribe@egroups.com
Your use of Yahoo! Groups is subject to http://docs.yahoo.com/info/terms/