Subject | Importing data into Firebird |
---|---|
Author | robert_hollay <rhollay@thedoghousemail.c |
Post date | 2003-01-29T05:32:30Z |
Hi all,
I have the following problem:
- We are in progress of migrating large database tables - millions
of records per table - from an old ISAM based DBMS
(CTOS OS - anybody else still using it? ;-) ) to Firebird 1.0.
The raw data was successfully imported into Firebird using
external tables. This is OK.
Now we have to perform extensive data manipulations (restructurings,
normalize-denormalize, conversions, translations ...), because the
new database will have a completely different structure than
the old one.
The questions:
- Is it possible somehow to keep track of progress of long-running
update batches and stored procedures from ISQL or other
DB admin tool? I mean, to display the number of processed records.
Currently I am able to watch only the hour-glass cursor on my
screen. Some of the batches take hours, and I have no insight into
their progress.
- Is it possible to cancel the long-running batches?
(if an update batch does not finish in a reasonably long time
interval, then it's likely that something went wrong ...).
If I stop the Firebird server while there is a running update
process, then I suppose that it could lead to data corruption.
- Is there a well-tried practice to carry out such data migration
tasks?
TIA for any help,
Robi
I have the following problem:
- We are in progress of migrating large database tables - millions
of records per table - from an old ISAM based DBMS
(CTOS OS - anybody else still using it? ;-) ) to Firebird 1.0.
The raw data was successfully imported into Firebird using
external tables. This is OK.
Now we have to perform extensive data manipulations (restructurings,
normalize-denormalize, conversions, translations ...), because the
new database will have a completely different structure than
the old one.
The questions:
- Is it possible somehow to keep track of progress of long-running
update batches and stored procedures from ISQL or other
DB admin tool? I mean, to display the number of processed records.
Currently I am able to watch only the hour-glass cursor on my
screen. Some of the batches take hours, and I have no insight into
their progress.
- Is it possible to cancel the long-running batches?
(if an update batch does not finish in a reasonably long time
interval, then it's likely that something went wrong ...).
If I stop the Firebird server while there is a running update
process, then I suppose that it could lead to data corruption.
- Is there a well-tried practice to carry out such data migration
tasks?
TIA for any help,
Robi