Subject | Re: [firebird-support] Removing 90% of data from 200 mln record table |
---|---|
Author | David Johnson |
Post date | 2006-03-25T19:52:57Z |
Of course, back up the data first.
It might be faster to simply migrate the data you want to keep and drop
the entire old table (and recreate it afterwards with only the migrated
data if desired).
It might be faster to simply migrate the data you want to keep and drop
the entire old table (and recreate it afterwards with only the migrated
data if desired).
On Sat, 2006-03-25 at 16:17 +0100, Aage Johansen wrote:
> k_smith_000 wrote:
> > I've a table with a large number (200 000 000) of records. I'd like
> to
> > remove ~90% of records from table that fulfill given criteria.
> > I know such operation can take a long time and I should backup and
> > restore database after operation has finished.
> > My question is, what is the most efficient way of performing such
> > operations. Should I put one delete statement into one transaction,
> or
> > divide it into few statements with seperate transactions?
> >
>
>
> One possibility is to create a new (empty) database with the same
> metadata, and then copy records from the old database into the new
> one.
> You could start with a metadata-only backup. Restoring this gives
> you the new (empty) database. Watch out for generator values, and
> you might choose to deactive triggers in the new one during transfer.
>
> If you do one big delete (or several small ones) you should probably
> make a backup (without garbage collection), and restore this. And
> hope that no user issues a "select count(*) ..." before the new
> database is ready.
>
> If you make many small deletes you might do a "select count(*) ..."
> on the parts where records are deleted (delete+commit+select), but
> this could mean the that database is inconsistent until you are
> finished.
>
>
> --
> Aage J.
>
>
>
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
> Visit http://firebird.sourceforge.net and click the Resources item
> on the main (top) menu. Try Knowledgebase and FAQ links !
>
> Also search the knowledgebases at http://www.ibphoenix.com
>
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>
>
>
>
> SPONSORED LINKS
> Technical support
> Computer technical
> support
> Compaq computer
> technical support
> Compaq technical
> support
> Hewlett packard
> technical support
> Microsoft technical
> support
>
>
> ______________________________________________________________________
> YAHOO! GROUPS LINKS
>
> 1. Visit your group "firebird-support" on the web.
>
> 2. To unsubscribe from this group, send an email to:
> firebird-support-unsubscribe@yahoogroups.com
>
> 3. Your use of Yahoo! Groups is subject to the Yahoo! Terms of
> Service.
>
>
> ______________________________________________________________________
>