Subject | Database file size |
---|---|
Author | mahendra.nepali@iflexsolutions.com |
Post date | 2006-04-25T14:23:32Z |
Hi,
I am facing an issue with the size of the firebird database file.
I run a data upload process that loads data from series of XML files
(around 70 GB+ data) into Firebird 1.5 Database via a .net application.
The process takes atleast 10+days to complete but when I check the
database file size, it is 5 times greater than the total xml file size.
To speed up the process I load lots of data into temp tables and then
delete the records from them for each xml file I load. However I think
the delete doesn't shrink the database size.
Then I tried backup and restore, where the database file size got
reduced drastically.
Can someone please let me know how I can reduce the database size when
the delete is fired? This is because my application is going to receive
daily data updates of minimum 40 MB and the same process is going to
run. But that could cause concerns as the database size may exceed the
harddisk size and every time a backup and restore will have a large down
time on an online application.
Regards,
Mahendra Nepali
Desk: +91-22-67184586
Mobile: +919820191887
Email: mahendra.nepali@...
DISCLAIMER:
This message contains privileged and confidential information and is intended only for the individual named.If you are not the intended recipient you should not disseminate,distribute,store,print, copy or deliver this message.Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system.E-mail transmission cannot be guaranteed to be secure or error-free as information could be intercepted,corrupted,lost,destroyed,arrive late or incomplete or contain viruses.The sender therefore does not accept liability for any errors or omissions in the contents of this message which arise as a result of e-mail transmission. If verification is required please request a hard-copy version.
[Non-text portions of this message have been removed]
I am facing an issue with the size of the firebird database file.
I run a data upload process that loads data from series of XML files
(around 70 GB+ data) into Firebird 1.5 Database via a .net application.
The process takes atleast 10+days to complete but when I check the
database file size, it is 5 times greater than the total xml file size.
To speed up the process I load lots of data into temp tables and then
delete the records from them for each xml file I load. However I think
the delete doesn't shrink the database size.
Then I tried backup and restore, where the database file size got
reduced drastically.
Can someone please let me know how I can reduce the database size when
the delete is fired? This is because my application is going to receive
daily data updates of minimum 40 MB and the same process is going to
run. But that could cause concerns as the database size may exceed the
harddisk size and every time a backup and restore will have a large down
time on an online application.
Regards,
Mahendra Nepali
Desk: +91-22-67184586
Mobile: +919820191887
Email: mahendra.nepali@...
DISCLAIMER:
This message contains privileged and confidential information and is intended only for the individual named.If you are not the intended recipient you should not disseminate,distribute,store,print, copy or deliver this message.Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system.E-mail transmission cannot be guaranteed to be secure or error-free as information could be intercepted,corrupted,lost,destroyed,arrive late or incomplete or contain viruses.The sender therefore does not accept liability for any errors or omissions in the contents of this message which arise as a result of e-mail transmission. If verification is required please request a hard-copy version.
[Non-text portions of this message have been removed]