Subject | Firebird is hanging |
---|---|
Author | mivi71dk |
Post date | 2010-01-15T07:39:44Z |
hi
We just had another incident where the firebird server hang again.
At this point it happen around 18 at the evening.
At this point we do not have many connections to the DB and the usage of firebird is minimal.
Its only firebird that not working at this point.
We can use Putty to connect to the server. But Firebird is hanging.
Noone can connect. And those connected cant do anything.
strace showed this:
===================
Process 31975 attached - interrupt to quit
futex(0x2b0826f23904, FUTEX_WAIT, 712587, NULL
gdb with an back trace showed:
==============================
GNU gdb 6.4.90-debian
Copyright (C) 2006 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Attaching to process 31975
Reading symbols from /opt/firebird/bin/fbserver...(no debugging symbols found)...done.
Using host libthread_db library "/lib/libthread_db.so.1".
Reading symbols from /lib/libdl.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libdl.so.2
Reading symbols from /lib/libncurses.so.5...(no debugging symbols found)...done.
Loaded symbols for /lib/libncurses.so.5
Reading symbols from /opt/firebird/lib/libicuuc.so.30...(no debugging symbols found)...done.
Loaded symbols for /opt/firebird/lib/libicuuc.so.30
Reading symbols from /opt/firebird/lib/libicudata.so.30...(no debugging symbols found)...done.
Loaded symbols for /opt/firebird/lib/libicudata.so.30
Reading symbols from /opt/firebird/lib/libicui18n.so.30...
(no debugging symbols found)...done.
Loaded symbols for /opt/firebird/lib/libicui18n.so.30
Reading symbols from /usr/lib/libstdc++.so.5...(no debugging symbols found)...done.
Loaded symbols for /usr/lib/libstdc++.so.5
Reading symbols from /lib/libm.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib/libm.so.6
Reading symbols from /lib/libgcc_s.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib/libgcc_s.so.1
Reading symbols from /lib/libpthread.so.0...(no debugging symbols found)...done.
[Thread debugging using libthread_db enabled]
[New Thread 47314006688144 (LWP 31975)]
[New Thread 1208023392 (LWP 26944)]
[New Thread 1191237984 (LWP 26069)]
[New Thread 1182845280 (LWP 26068)]
[New Thread 1166059872 (LWP 16445)]
[New Thread 1174452576 (LWP 16444)]
[New Thread 1124096352 (LWP 14696)]
[New Thread 1157667168 (LWP 14695)]
[New Thread 1115703648 (LWP 12153)]
[New Thread 1140881760 (LWP 8233)]
[New Thread 1149274464 (LWP 8232)]
[New Thread 1098918240 (LWP 8231)]
[New Thread 1107310944 (LWP 8230)]
[New Thread 1132489056 (LWP 4938)]
[New Thread 1090525536 (LWP 31979)]
[New Thread 1082132832 (LWP 31978)]
Loaded symbols for /lib/libpthread.so.0
Reading symbols from /lib/libc.so.6...
(no debugging symbols found)...done.
Loaded symbols for /lib/libc.so.6
Reading symbols from /lib/ld-linux-x86-64.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/ld-linux-x86-64.so.2
Reading symbols from /lib/libnss_compat.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libnss_compat.so.2
Reading symbols from /lib/libnsl.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib/libnsl.so.1
Reading symbols from /lib/libnss_nis.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libnss_nis.so.2
Reading symbols from /lib/libnss_files.so.2...
(no debugging symbols found)...done.
Loaded symbols for /lib/libnss_files.so.2
Reading symbols from /opt/firebird/intl/fbintl...(no debugging symbols found)...done.
Loaded symbols for /opt/firebird/intl/fbintl
Reading symbols from /opt/firebird/UDF/ib_udf.so...(no debugging symbols found)...done.
Loaded symbols for /opt/firebird/UDF/ib_udf.so
0x00002b08265b1b3a in pthread_cond_wait@@GLIBC_2.3.2 ()
from /lib/libpthread.so.0
(gdb) bt
#0 0x00002b08265b1b3a in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#1 0x00000000004241a0 in gds__default_printer ()
#2 0x00000000004264ac in gds__default_printer ()
#3 0x00000000004259f8 in gds__default_printer ()
#4 0x00000000005e4abb in ERRD_post ()
#5 0x00000000005e46df in ERRD_post ()
#6 0x00000000005f639d in ERRD_post ()
#7 0x000000000040b37c in putchar ()
#8 0x000000000040aa1f in ?? ()
#9 0x0000000000413739 in putchar ()
#10 0x00002b08266da4ca in __libc_start_main () from /lib/libc.so.6
#11 0x000000000040a32a in ?? ()
#12 0x00007fffab9b3508 in ?? ()
#13 0x0000000000000000 in ?? ()
(gdb)
This is the first time it has happen with few users connected and little work for firebird to do.
It happened quite some times befores christmas and that was when there was a lot of users connected and heavy lot on firebird.
More of this in this thread
http://tech.groups.yahoo.com/group/firebird-support/message/106111
We have tried quite a lot, but nothing has helped so far.
I still have the feeling, that somehow Firebird enters a loop, that it cannot get out of.
Please come with some input.
Regards
Micahel
We just had another incident where the firebird server hang again.
At this point it happen around 18 at the evening.
At this point we do not have many connections to the DB and the usage of firebird is minimal.
Its only firebird that not working at this point.
We can use Putty to connect to the server. But Firebird is hanging.
Noone can connect. And those connected cant do anything.
strace showed this:
===================
Process 31975 attached - interrupt to quit
futex(0x2b0826f23904, FUTEX_WAIT, 712587, NULL
gdb with an back trace showed:
==============================
GNU gdb 6.4.90-debian
Copyright (C) 2006 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Attaching to process 31975
Reading symbols from /opt/firebird/bin/fbserver...(no debugging symbols found)...done.
Using host libthread_db library "/lib/libthread_db.so.1".
Reading symbols from /lib/libdl.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libdl.so.2
Reading symbols from /lib/libncurses.so.5...(no debugging symbols found)...done.
Loaded symbols for /lib/libncurses.so.5
Reading symbols from /opt/firebird/lib/libicuuc.so.30...(no debugging symbols found)...done.
Loaded symbols for /opt/firebird/lib/libicuuc.so.30
Reading symbols from /opt/firebird/lib/libicudata.so.30...(no debugging symbols found)...done.
Loaded symbols for /opt/firebird/lib/libicudata.so.30
Reading symbols from /opt/firebird/lib/libicui18n.so.30...
(no debugging symbols found)...done.
Loaded symbols for /opt/firebird/lib/libicui18n.so.30
Reading symbols from /usr/lib/libstdc++.so.5...(no debugging symbols found)...done.
Loaded symbols for /usr/lib/libstdc++.so.5
Reading symbols from /lib/libm.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib/libm.so.6
Reading symbols from /lib/libgcc_s.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib/libgcc_s.so.1
Reading symbols from /lib/libpthread.so.0...(no debugging symbols found)...done.
[Thread debugging using libthread_db enabled]
[New Thread 47314006688144 (LWP 31975)]
[New Thread 1208023392 (LWP 26944)]
[New Thread 1191237984 (LWP 26069)]
[New Thread 1182845280 (LWP 26068)]
[New Thread 1166059872 (LWP 16445)]
[New Thread 1174452576 (LWP 16444)]
[New Thread 1124096352 (LWP 14696)]
[New Thread 1157667168 (LWP 14695)]
[New Thread 1115703648 (LWP 12153)]
[New Thread 1140881760 (LWP 8233)]
[New Thread 1149274464 (LWP 8232)]
[New Thread 1098918240 (LWP 8231)]
[New Thread 1107310944 (LWP 8230)]
[New Thread 1132489056 (LWP 4938)]
[New Thread 1090525536 (LWP 31979)]
[New Thread 1082132832 (LWP 31978)]
Loaded symbols for /lib/libpthread.so.0
Reading symbols from /lib/libc.so.6...
(no debugging symbols found)...done.
Loaded symbols for /lib/libc.so.6
Reading symbols from /lib/ld-linux-x86-64.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/ld-linux-x86-64.so.2
Reading symbols from /lib/libnss_compat.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libnss_compat.so.2
Reading symbols from /lib/libnsl.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib/libnsl.so.1
Reading symbols from /lib/libnss_nis.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libnss_nis.so.2
Reading symbols from /lib/libnss_files.so.2...
(no debugging symbols found)...done.
Loaded symbols for /lib/libnss_files.so.2
Reading symbols from /opt/firebird/intl/fbintl...(no debugging symbols found)...done.
Loaded symbols for /opt/firebird/intl/fbintl
Reading symbols from /opt/firebird/UDF/ib_udf.so...(no debugging symbols found)...done.
Loaded symbols for /opt/firebird/UDF/ib_udf.so
0x00002b08265b1b3a in pthread_cond_wait@@GLIBC_2.3.2 ()
from /lib/libpthread.so.0
(gdb) bt
#0 0x00002b08265b1b3a in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#1 0x00000000004241a0 in gds__default_printer ()
#2 0x00000000004264ac in gds__default_printer ()
#3 0x00000000004259f8 in gds__default_printer ()
#4 0x00000000005e4abb in ERRD_post ()
#5 0x00000000005e46df in ERRD_post ()
#6 0x00000000005f639d in ERRD_post ()
#7 0x000000000040b37c in putchar ()
#8 0x000000000040aa1f in ?? ()
#9 0x0000000000413739 in putchar ()
#10 0x00002b08266da4ca in __libc_start_main () from /lib/libc.so.6
#11 0x000000000040a32a in ?? ()
#12 0x00007fffab9b3508 in ?? ()
#13 0x0000000000000000 in ?? ()
(gdb)
This is the first time it has happen with few users connected and little work for firebird to do.
It happened quite some times befores christmas and that was when there was a lot of users connected and heavy lot on firebird.
More of this in this thread
http://tech.groups.yahoo.com/group/firebird-support/message/106111
We have tried quite a lot, but nothing has helped so far.
I still have the feeling, that somehow Firebird enters a loop, that it cannot get out of.
Please come with some input.
Regards
Micahel