Subject | Endless error reporting of SIGPIPE for Firebird 1.5.1 on Fedora Core 2.0 |
---|---|
Author | Trond |
Post date | 2004-10-08T10:51:43Z |
Configuration:
AMD 64 (Single processor)
SATA disk raid 1 (2x200GB)
2GB memory
Fedora Core 2.0 (32 bit)
Firebird SS 1.5.1 4481 and Firebird SS 1.5.1 4481 nptl.
The problem starts after an INET/inet_error: send errno = 32 error. And
the Server starts to log approximately 200 error messages resulting in
about 1000 lines pr SECOND in firebird.log. The first time it happened, we
didn't catch it before Firebird.log was 158 GB in size, and there was no
more room on the disk. This happens about once pr 1.5 days. We tried to
switch to the nptl version, and at first it looked like the problem was
solved. Firebird reported the same error just once a couple of time in the
log. But just hours later it started to go crazy again.
Please look at the snip from firebird.log, and a logging of port 3050
below. Any suggestions is highly appreciated.
From Firebird.log:
ildfugl.levanger (Server) Tue Oct 5 10:01:14 2004
INET/inet_error: send errno = 113
ildfugl.levanger (Server) Tue Oct 5 10:01:14 2004
Super Server/main: Bad client socket, send() resulted in SIGPIPE,
caught by server
client exited improperly or crashed ????
ildfugl.levanger (Server) Tue Oct 5 10:01:14 2004
INET/inet_error: send errno = 32
ildfugl.levanger (Server) Tue Oct 5 10:01:14 2004
Super Server/main: Bad client socket, send() resulted in SIGPIPE,
caught by server
client exited improperly or crashed ????
...
From logging of port 3050: NB! 192.168.1.89 = Firebird Server,
192.168.1.25 is a Client. The client can differ for etch time the error
occurs.
673.665120 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122643952 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.665154 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [PSH, ACK]
Seq=122645212 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=632
673.665627 192.168.1.25 -> 192.168.1.89 TCP 1273 > gds_db [ACK] Seq=573128
Ack=122640172 Win=64512 Len=0
673.665733 192.168.1.25 -> 192.168.1.89 TCP 1273 > gds_db [ACK] Seq=573128
Ack=122641432 Win=64512 Len=0
673.665856 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122645844 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.665859 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122647104 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.665861 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122648364 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.665864 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122649624 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.665868 192.168.1.89 -> 192.168.1.25 IB Reply void
673.665871 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122652144 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.665947 192.168.1.25 -> 192.168.1.89 TCP 1273 > gds_db [ACK] Seq=573128
Ack=122643952 Win=64512 Len=0
673.666055 192.168.1.25 -> 192.168.1.89 TCP 1273 > gds_db [ACK] Seq=573128
Ack=122645212 Win=64512 Len=0
673.666070 192.168.1.89 -> 192.168.1.25 IB Reply void
673.666074 192.168.1.89 -> 192.168.1.25 IB Reply connect
673.666076 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122655924 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.666079 192.168.1.89 -> 192.168.1.25 IB Reply void
673.666083 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122658444 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.666087 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122659704 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.666090 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122660964 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.666243 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122662224 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.666247 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122663484 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.666252 192.168.1.89 -> 192.168.1.25 IB Reply void
673.666255 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122666004 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.666258 192.168.1.89 -> 192.168.1.25 IB Reply void
673.666262 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122668524 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.666274 192.168.1.25 -> 192.168.1.89 TCP 1273 > gds_db [ACK] Seq=573128
Ack=122647104 Win=64512 Len=0
673.666277 192.168.1.89 -> 192.168.1.25 IB Reply void
673.666398 192.168.1.89 -> 192.168.1.25 IB Reply void
673.666402 192.168.1.89 -> 192.168.1.25 IB Reply void
673.666412 192.168.1.89 -> 192.168.1.25 IB Reply void
673.666416 192.168.1.89 -> 192.168.1.25 IB Reply void
673.666419 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122675460 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.666423 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122676720 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.666490 192.168.1.25 -> 192.168.1.89 TCP 1273 > gds_db [ACK] Seq=573128
Ack=122649624 Win=64512 Len=0
673.666566 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122677980 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.666569 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122679240 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.666574 192.168.1.89 -> 192.168.1.25 IB Reply void
673.666577 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122681760 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.666580 192.168.1.89 -> 192.168.1.25 IB Reply void
673.666584 192.168.1.89 -> 192.168.1.25 IB Reply void
673.666587 192.168.1.89 -> 192.168.1.25 IB Reply void
673.666647 192.168.1.89 -> 192.168.1.25 IB Reply void
673.666650 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122688060 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.668901 192.168.1.25 -> 192.168.1.89 TCP 1273 > gds_db [ACK] Seq=573128
Ack=122677980 Win=63252 Len=0
673.669036 192.168.1.25 -> 192.168.1.89 IB Request fetch
673.669218 192.168.1.25 -> 192.168.1.89 TCP 1273 > gds_db [ACK] Seq=573148
Ack=122681760 Win=59472 Len=0
673.669432 192.168.1.25 -> 192.168.1.89 TCP 1273 > gds_db [ACK] Seq=573148
Ack=122684280 Win=56952 Len=0
673.669608 192.168.1.25 -> 192.168.1.89 TCP 1273 > gds_db [ACK] Seq=573148
Ack=122685540 Win=64512 Len=0
673.669757 192.168.1.25 -> 192.168.1.89 TCP 1273 > gds_db [ACK] Seq=573148
Ack=122688060 Win=61992 Len=0
673.669943 192.168.1.25 -> 192.168.1.89 TCP 1273 > gds_db [ACK] Seq=573148
Ack=122690272 Win=59780 Len=0
673.670439 192.168.1.25 -> 192.168.1.89 TCP [TCP Dup ACK 197270#1] 1273 >
gds_db [ACK] Seq=573148 Ack=122690272 Win=63540 Len=0
673.686085 192.168.1.89 -> 192.168.1.25 IB Reply fetch response
673.686096 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122691532 Ack=573148 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.686099 192.168.1.89 -> 192.168.1.25 IB Reply void
673.686103 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122694052 Ack=573148 Win=32767 [CHECKSUM INCORRECT] Len=1260
Best regards
Trond.
--
Using M2, Opera's revolutionary e-mail client: http://www.opera.com/m2/
AMD 64 (Single processor)
SATA disk raid 1 (2x200GB)
2GB memory
Fedora Core 2.0 (32 bit)
Firebird SS 1.5.1 4481 and Firebird SS 1.5.1 4481 nptl.
The problem starts after an INET/inet_error: send errno = 32 error. And
the Server starts to log approximately 200 error messages resulting in
about 1000 lines pr SECOND in firebird.log. The first time it happened, we
didn't catch it before Firebird.log was 158 GB in size, and there was no
more room on the disk. This happens about once pr 1.5 days. We tried to
switch to the nptl version, and at first it looked like the problem was
solved. Firebird reported the same error just once a couple of time in the
log. But just hours later it started to go crazy again.
Please look at the snip from firebird.log, and a logging of port 3050
below. Any suggestions is highly appreciated.
From Firebird.log:
ildfugl.levanger (Server) Tue Oct 5 10:01:14 2004
INET/inet_error: send errno = 113
ildfugl.levanger (Server) Tue Oct 5 10:01:14 2004
Super Server/main: Bad client socket, send() resulted in SIGPIPE,
caught by server
client exited improperly or crashed ????
ildfugl.levanger (Server) Tue Oct 5 10:01:14 2004
INET/inet_error: send errno = 32
ildfugl.levanger (Server) Tue Oct 5 10:01:14 2004
Super Server/main: Bad client socket, send() resulted in SIGPIPE,
caught by server
client exited improperly or crashed ????
...
From logging of port 3050: NB! 192.168.1.89 = Firebird Server,
192.168.1.25 is a Client. The client can differ for etch time the error
occurs.
673.665120 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122643952 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.665154 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [PSH, ACK]
Seq=122645212 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=632
673.665627 192.168.1.25 -> 192.168.1.89 TCP 1273 > gds_db [ACK] Seq=573128
Ack=122640172 Win=64512 Len=0
673.665733 192.168.1.25 -> 192.168.1.89 TCP 1273 > gds_db [ACK] Seq=573128
Ack=122641432 Win=64512 Len=0
673.665856 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122645844 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.665859 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122647104 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.665861 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122648364 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.665864 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122649624 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.665868 192.168.1.89 -> 192.168.1.25 IB Reply void
673.665871 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122652144 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.665947 192.168.1.25 -> 192.168.1.89 TCP 1273 > gds_db [ACK] Seq=573128
Ack=122643952 Win=64512 Len=0
673.666055 192.168.1.25 -> 192.168.1.89 TCP 1273 > gds_db [ACK] Seq=573128
Ack=122645212 Win=64512 Len=0
673.666070 192.168.1.89 -> 192.168.1.25 IB Reply void
673.666074 192.168.1.89 -> 192.168.1.25 IB Reply connect
673.666076 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122655924 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.666079 192.168.1.89 -> 192.168.1.25 IB Reply void
673.666083 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122658444 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.666087 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122659704 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.666090 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122660964 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.666243 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122662224 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.666247 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122663484 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.666252 192.168.1.89 -> 192.168.1.25 IB Reply void
673.666255 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122666004 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.666258 192.168.1.89 -> 192.168.1.25 IB Reply void
673.666262 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122668524 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.666274 192.168.1.25 -> 192.168.1.89 TCP 1273 > gds_db [ACK] Seq=573128
Ack=122647104 Win=64512 Len=0
673.666277 192.168.1.89 -> 192.168.1.25 IB Reply void
673.666398 192.168.1.89 -> 192.168.1.25 IB Reply void
673.666402 192.168.1.89 -> 192.168.1.25 IB Reply void
673.666412 192.168.1.89 -> 192.168.1.25 IB Reply void
673.666416 192.168.1.89 -> 192.168.1.25 IB Reply void
673.666419 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122675460 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.666423 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122676720 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.666490 192.168.1.25 -> 192.168.1.89 TCP 1273 > gds_db [ACK] Seq=573128
Ack=122649624 Win=64512 Len=0
673.666566 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122677980 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.666569 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122679240 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.666574 192.168.1.89 -> 192.168.1.25 IB Reply void
673.666577 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122681760 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.666580 192.168.1.89 -> 192.168.1.25 IB Reply void
673.666584 192.168.1.89 -> 192.168.1.25 IB Reply void
673.666587 192.168.1.89 -> 192.168.1.25 IB Reply void
673.666647 192.168.1.89 -> 192.168.1.25 IB Reply void
673.666650 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122688060 Ack=573128 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.668901 192.168.1.25 -> 192.168.1.89 TCP 1273 > gds_db [ACK] Seq=573128
Ack=122677980 Win=63252 Len=0
673.669036 192.168.1.25 -> 192.168.1.89 IB Request fetch
673.669218 192.168.1.25 -> 192.168.1.89 TCP 1273 > gds_db [ACK] Seq=573148
Ack=122681760 Win=59472 Len=0
673.669432 192.168.1.25 -> 192.168.1.89 TCP 1273 > gds_db [ACK] Seq=573148
Ack=122684280 Win=56952 Len=0
673.669608 192.168.1.25 -> 192.168.1.89 TCP 1273 > gds_db [ACK] Seq=573148
Ack=122685540 Win=64512 Len=0
673.669757 192.168.1.25 -> 192.168.1.89 TCP 1273 > gds_db [ACK] Seq=573148
Ack=122688060 Win=61992 Len=0
673.669943 192.168.1.25 -> 192.168.1.89 TCP 1273 > gds_db [ACK] Seq=573148
Ack=122690272 Win=59780 Len=0
673.670439 192.168.1.25 -> 192.168.1.89 TCP [TCP Dup ACK 197270#1] 1273 >
gds_db [ACK] Seq=573148 Ack=122690272 Win=63540 Len=0
673.686085 192.168.1.89 -> 192.168.1.25 IB Reply fetch response
673.686096 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122691532 Ack=573148 Win=32767 [CHECKSUM INCORRECT] Len=1260
673.686099 192.168.1.89 -> 192.168.1.25 IB Reply void
673.686103 192.168.1.89 -> 192.168.1.25 TCP gds_db > 1273 [ACK]
Seq=122694052 Ack=573148 Win=32767 [CHECKSUM INCORRECT] Len=1260
Best regards
Trond.
--
Using M2, Opera's revolutionary e-mail client: http://www.opera.com/m2/