Subject | Re: [IBO] Stored procedure problem |
---|---|
Author | Don Gollahon |
Post date | 2003-02-13T05:04:15Z |
Well, it's a long story. We've wrestled with it for 2+ years.
We do massive imports on a regular basis. We process phone company data,
millions of phone calls per month. We process for some 35 companies right
now and growing. Each has there own database. Our largest database gets up
to 3-4 GB of data per month. We keep the call data for 2 months and delete
data older than 2 months. We do this spread out over 3 dual processor
servers. FB can only use one processor in each though, of course.
This data has to be summarized and extracted for billing and reports each
month, also. We have changed our apps to do this many times a month so that
we don't have to do it all at once at the end.
FB/IB (we've used both) can sometimes run away with the processor for no
apparent reason. All of our sweep intervals are zero. We have tried
letting it go to see if it will stop and sometimes it does. But there have
been times when we have left it run all weekend and come in on Monday and it
is still going. So we have to kill it.
I've talked with support many times about the problem and have done all we
know to do but it still happens. Although it has been less of a problem
than it was. One thing we have found is that it occurs more regularly if we
do deletes. For example, say we have not cleaned up one of the databases
for awhile so we have to delete a 100,000 or more records at once. It
appears to work just fine but we go to exit the app and it freezes up and FB
is running away with the processor. We have done our commits, etc, at the
end of processing so what is FB doing on close of the app. All we do there
is database.close. We have changed to doing weekly backup and restores and
only restoring the recent data. That works better but is a pain if you can
imagine doing this for 30 companies each having a minimum of 3 GB of data.
Takes quit a long time. We spread them out over the week but is still quite
high maintenance for what is supposed to be a low maintenance system.
We have also experienced database corruption now and then for no apparent
reason. Even in our development server where we handle much less data.
Repair refuses to fix it sometimes so we have to scrap it and start over.
I'm hoping DBISAM will work better. If it doesn't we will have to go to
something much more expensive. We are just trying to keep our costs down
for our customers.
"Svein Erling Tysvaer" <svein.erling.tysvaer@...> wrote in
message news:5.1.0.14.0.20030212091257.047c8cb0@[158.36.132.22]...
Don,
At 17:23 11.02.2003 -0600, you wrote:
Fb/IB? I think knowing the weakness of a product is as important as knowing
its strength.
_________________________________________
Don Gollahon
(dlgllhn@...)
ICQ#: 115831669
"What in Eternity does it matter?"
_________________________________________
[Non-text portions of this message have been removed]
We do massive imports on a regular basis. We process phone company data,
millions of phone calls per month. We process for some 35 companies right
now and growing. Each has there own database. Our largest database gets up
to 3-4 GB of data per month. We keep the call data for 2 months and delete
data older than 2 months. We do this spread out over 3 dual processor
servers. FB can only use one processor in each though, of course.
This data has to be summarized and extracted for billing and reports each
month, also. We have changed our apps to do this many times a month so that
we don't have to do it all at once at the end.
FB/IB (we've used both) can sometimes run away with the processor for no
apparent reason. All of our sweep intervals are zero. We have tried
letting it go to see if it will stop and sometimes it does. But there have
been times when we have left it run all weekend and come in on Monday and it
is still going. So we have to kill it.
I've talked with support many times about the problem and have done all we
know to do but it still happens. Although it has been less of a problem
than it was. One thing we have found is that it occurs more regularly if we
do deletes. For example, say we have not cleaned up one of the databases
for awhile so we have to delete a 100,000 or more records at once. It
appears to work just fine but we go to exit the app and it freezes up and FB
is running away with the processor. We have done our commits, etc, at the
end of processing so what is FB doing on close of the app. All we do there
is database.close. We have changed to doing weekly backup and restores and
only restoring the recent data. That works better but is a pain if you can
imagine doing this for 30 companies each having a minimum of 3 GB of data.
Takes quit a long time. We spread them out over the week but is still quite
high maintenance for what is supposed to be a low maintenance system.
We have also experienced database corruption now and then for no apparent
reason. Even in our development server where we handle much less data.
Repair refuses to fix it sometimes so we have to scrap it and start over.
I'm hoping DBISAM will work better. If it doesn't we will have to go to
something much more expensive. We are just trying to keep our costs down
for our customers.
"Svein Erling Tysvaer" <svein.erling.tysvaer@...> wrote in
message news:5.1.0.14.0.20030212091257.047c8cb0@[158.36.132.22]...
Don,
At 17:23 11.02.2003 -0600, you wrote:
>BTW: I have mentioned your IBO to my managers but we probably won't usethem
>since we may switch to DBISAM instead of Firebird. The type of processingI'm just curious as to what kind of processing isn't working well with
>we do isn't working well with Firebird/InterBase.
Fb/IB? I think knowing the weakness of a product is as important as knowing
its strength.
_________________________________________
Don Gollahon
(dlgllhn@...)
ICQ#: 115831669
"What in Eternity does it matter?"
_________________________________________
[Non-text portions of this message have been removed]