Subject | Re: Performance Problem with BOLBs?? |
---|---|
Author | ggroper |
Post date | 2005-04-14T16:59:27Z |
Hi Rajesh,
My test app is a simple slect records from a single table with a
criteria that returns 35 records from 66,000. I displayed the text in
an info power grid so the Blob fields display in the grid. My app
needs to do this so the user can scroll and review the memo fields. I
can not change the design so that it to only return on row at a time.
The users will kill.
Below are my test results to a remote host from last night. I am
shocked at mySQL performance, it looks like the solution but I do not
want to use it??
With Blob Fields/Without Blob Fields
mySQL Database with Borland db Express Driver: 0.79/0.64
FIB PLus to a Client Data Set 8.72/1.54
dbExpress using Borland's IB driver 30.1/1.18
dbExpress using 3rd party FB driver 29.5/1.12
dbExpress using OLEdbExpress(with FB's ODBC driver) 7.9/1.65
Yet all tests are nearly subsecond on a local database connection. And
all tests, except FIBPlus, are using the same dbExpress components??
mySQL just blows away Firebird, why????
Austin
--- In firebird-support@yahoogroups.com, Rajesh Punjabi <rajesh@i...>
wrote:
My test app is a simple slect records from a single table with a
criteria that returns 35 records from 66,000. I displayed the text in
an info power grid so the Blob fields display in the grid. My app
needs to do this so the user can scroll and review the memo fields. I
can not change the design so that it to only return on row at a time.
The users will kill.
Below are my test results to a remote host from last night. I am
shocked at mySQL performance, it looks like the solution but I do not
want to use it??
With Blob Fields/Without Blob Fields
mySQL Database with Borland db Express Driver: 0.79/0.64
FIB PLus to a Client Data Set 8.72/1.54
dbExpress using Borland's IB driver 30.1/1.18
dbExpress using 3rd party FB driver 29.5/1.12
dbExpress using OLEdbExpress(with FB's ODBC driver) 7.9/1.65
Yet all tests are nearly subsecond on a local database connection. And
all tests, except FIBPlus, are using the same dbExpress components??
mySQL just blows away Firebird, why????
Austin
--- In firebird-support@yahoogroups.com, Rajesh Punjabi <rajesh@i...>
wrote:
>1000
> Hi Austin,
>
> I use D7 with dbExpress component set for Interbase. The gds32.dll is
> the one that the FB installation provides. I had performance slowdown
> problems when I was using the gds32.dll provided by Borland. The moment
> I switched to the FB one there was no problem.
>
> My queries typically look like this :
>
> select code, name, city, email1, email2, ... etc.
> from candidates
> where workdone containing 'J2EE';
> //workdone is the blob where resumes are stored.
>
> I have recently shifted my architecture retrieve only one blob at a
> time. However I am running some tests now after your e-mail and am
> checking whether I experience these problems as well. Should be able to
> update you by tommorrow about what is happenning.
>
> My blobs are typically large in comparison to yours. I tend to have
> or more chars in them and I also store them with RTF formatting just95,000
> like you. However I use the TRichedit control to display them not the
> Infopower ones.
>
> Regards,
>
>
> RP
>
> ggroper wrote:
>
> >Rajesh,
> >
> >Thanks for the input.
> >
> >I am using a remote host that is using Win 2000 server, and FB 1.52
> >classic. I do not know their detail configuration settings.
> >
> >What client program are you using?? Delphi? and if so what compoonent
> >set???
> > Are you retreving multiple Blobs at a time or only one? Mine are
> >short plain text message that will require RTF formating so I need to
> >put them in Blobs for infopower to get them. Average about 50
> >characters per Blob.
> >
> >I have done some more testing and the problem looks more complex,
> >possibly a combination of Delphi and Firebird.
> >
> >Using dbExpress componets with OLEDBExpress driver and FB's ODBC I can
> >get the time down from 30 to 7.9 sec with Blobs and 1.71 seconds with
> >out Blobs. The Borland IB dbExpress driver takes 30 seconds with
> >Blobs(and so does a FB third pary driver) and 1.18 seconds without
> >Blobs. I tried FIBPlus to Client Data Sets and it took 8.7 seconds
> >with Blobs and 1.54 seconds with out blobs, about a second less with
> >out client data sets.
> >
> >The worst time on a local connection was 0.37 seconds with Blobs and
> >0.07 seconds without blobs.
> >
> >Even an 8 second response time is not good enough to read 35 records???
> >
> >Maybe there is some harware problem in the loop?? I'm going to see if
> >I can set up a test with mySQL and MS SQL Server.
> >
> >Thanks for the help,
> >
> >
> >Austin
> >
> >--- In firebird-support@yahoogroups.com, Rajesh Punjabi <rajesh@i...>
> >wrote:
> >
> >
> >>Hi Austin,
> >>
> >>I use blobs to store resumes in Firebird. I have currently about
> >>of those and they can each go upto a 4-5 page word document each. Iblob,
> >>
> >>
> >have
> >
> >
> >>experienced problems only when I try to query something inside my
> >>not otherwise. Whether I fetch a blob field or not in the select listusing
> >>has not yet presented a problem.
> >>
> >>
> >>
> >
> >
> >
> >
> >
> >>What is your server config. What is the swap space setting. Are u
> >>XP or some other server OS. Can u put out the plan on your query astends to
> >>
> >>
> >well.
> >
> >
> >>I use RH8 Linux and have had a problem with swap space sometimes.
> >>Whenever I start running low on physical ram or swap space FB
> >>slow down considerably. Just my 2 bits.
> >>
> >>Regards,
> >>
> >>
> >>RP
> >>