Subject | Looking for a fast solution for loading data from a text file into Firebird |
---|---|
Author | Myles Wakeham |
Post date | 2009-02-19T01:09:46Z |
I have a requirement to load a LOT of data from a text file. The format of the text file is very simple. It’s a single column of data, but there could be millions of rows of it. The text file is uploaded to a Linux server with Firebird 1.5 on it, and currently I'm trying to load it with PHP, but its taking FOREVER!
It has to run without any user intervention and be called by my PHP code. I'm thinking a UDF might be the answer here. I need to find a fast bulk loader UDF that can load the data into a table with a single column in it (varchar). Nothing really complex - just need something that runs really fast.
There isn't a huge burden on the Firebird database, so I don't mind taking a performance hit in Firebird while this runs, but does anyone know of a UDF that will do this? I did a bit of searching and found a few BLOB UDFs that do it, but they all seem to be for Windows.
Or is there a better way to do this that I am missing?
Myles
===============================
Myles Wakeham
Director of Engineering
Tech Solutions USA, Inc.
Scottsdale, Arizona USA
www.techsolusa.com
Phone +1-480-451-7440
It has to run without any user intervention and be called by my PHP code. I'm thinking a UDF might be the answer here. I need to find a fast bulk loader UDF that can load the data into a table with a single column in it (varchar). Nothing really complex - just need something that runs really fast.
There isn't a huge burden on the Firebird database, so I don't mind taking a performance hit in Firebird while this runs, but does anyone know of a UDF that will do this? I did a bit of searching and found a few BLOB UDFs that do it, but they all seem to be for Windows.
Or is there a better way to do this that I am missing?
Myles
===============================
Myles Wakeham
Director of Engineering
Tech Solutions USA, Inc.
Scottsdale, Arizona USA
www.techsolusa.com
Phone +1-480-451-7440