Re: 2.4 Stable1 SIGSEV, Segmentation fault

There has been disturbingly many reports like this using the diskd store
in various Squid-2.4 versions, all crashing in linklistPush.

/Henrik

Alejandro A. Ramirez wrote:
>
> Hi,
>
> I have found a BUG in Squid 2.4Stable1, the HEAD branch from today
> "squid-2.4-200103300000", after getting more than 300 req/s, thats bad,
> because I cant load the server, I cant really get all from this hardware, Im
> using FreeBSD4.2 RELEASE, the crash has the following message:
>
> Program received signal SIGSEGV, Segmentation fault.
> 0x80aab9b in linklistPush (L=0x1fcfe7, p=0x502d0000) at tools.c:873
> 873 while (*L)
>
> Below you can find the Backtrace of this crash:
>
> P.S. If you need something else (patching, testing, root access, etc) , just
> let me know (I can provide this because this is a testing server).
>
> P.S.2 I can reproduce this in less than 1 minute, I have done it several
> times, it alwas fails with the same error.
>
> Greetings...
> Ales
>
> Script started on Fri Mar 30 12:46:08 2001
> GNU gdb 4.18
> Copyright 1998 Free Software Foundation, Inc.
> GDB is free software, covered by the GNU General Public License, and you are
> welcome to change it and/or distribute copies of it under certain
> conditions.
> Type "show copying" to see the conditions.
> There is absolutely no warranty for GDB. Type "show warranty" for details.
> This GDB was configured as "i386-unknown-freebsd"...
> (gdb) handle SIGPIPE noprint nostop pass
> Signal Stop Print Pass to program Description
> SIGPIPE No No Yes Broken pipe
> (gdb) r -CNd1
> Starting program: /usr/local/sbin/squid -CNd1
> 2001/03/30 12:46:21| Starting Squid Cache version 2.4.STABLE1 for
> i386-unknown-freebsd4.2...
> 2001/03/30 12:46:21| Process ID 12083
> 2001/03/30 12:46:21| With 32768 file descriptors available
> 2001/03/30 12:46:21| Performing DNS Tests...
> 2001/03/30 12:46:21| Successful DNS name lookup tests...
> 2001/03/30 12:46:21| DNS Socket created on FD 7
> 2001/03/30 12:46:21| Adding nameserver 127.0.0.1 from /etc/resolv.conf
> 2001/03/30 12:46:21| Unlinkd pipe opened on FD 12
> 2001/03/30 12:46:21| Swap maxSize 43008000 KB, estimated 3308307 objects
> 2001/03/30 12:46:21| Target number of buckets: 165415
> 2001/03/30 12:46:21| Using 262144 Store buckets
> 2001/03/30 12:46:21| Max Mem size: 131072 KB
> 2001/03/30 12:46:21| Max Swap size: 43008000 KB
> 2001/03/30 12:46:21| Store logging disabled
> 2001/03/30 12:46:21| Rebuilding storage in /cache0/0 (DIRTY)
> 2001/03/30 12:46:21| Rebuilding storage in /cache1/0/0 (DIRTY)
> 2001/03/30 12:46:21| Rebuilding storage in /cache1/1/0 (DIRTY)
> 2001/03/30 12:46:21| Rebuilding storage in /cache1/2/0 (DIRTY)
> 2001/03/30 12:46:21| Rebuilding storage in /cache1/3/0 (DIRTY)
> 2001/03/30 12:46:21| Rebuilding storage in /cache1/4/0 (DIRTY)
> 2001/03/30 12:46:21| Rebuilding storage in /cache1/5/0 (DIRTY)
> 2001/03/30 12:46:21| Using Round Robin store dir selection
> 2001/03/30 12:46:21| Set Current Directory to /cache0/0
> 2001/03/30 12:46:21| Loaded Icons.
> 2001/03/30 12:46:21| Accepting HTTP connections at 0.0.0.0, port 80, FD 31.
> 2001/03/30 12:46:21| Accepting SNMP messages on port 1610, FD 33.
> 2001/03/30 12:46:21| Accepting WCCP messages on port 2048, FD 34.
> 2001/03/30 12:46:21| Ready to serve requests.
> 2001/03/30 12:46:26| Store rebuilding is 1.0% complete
> 2001/03/30 12:46:47| Store rebuilding is 3.2% complete
> ...
> ...
> ...
> 2001/03/30 13:00:01| Store rebuilding is 93.7% complete
> 2001/03/30 13:00:19| Store rebuilding is 95.7% complete
> 2001/03/30 13:00:30| Done reading /cache1/5/0 swaplog (391346 entries)
> 2001/03/30 13:00:34| Store rebuilding is 97.8% complete
> 2001/03/30 13:00:38| WARNING: newer swaplog entry for dirno 0, fileno
> 00004161
> 2001/03/30 13:00:38| Done reading /cache1/0/0 swaplog (395861 entries)
> 2001/03/30 13:00:39| Done reading /cache0/0 swaplog (396562 entries)
> 2001/03/30 13:00:39| WARNING: newer swaplog entry for dirno 2, fileno
> 00000E94
> 2001/03/30 13:00:41| Done reading /cache1/1/0 swaplog (398381 entries)
> 2001/03/30 13:00:42| Done reading /cache1/3/0 swaplog (399405 entries)
> 2001/03/30 13:00:44| Done reading /cache1/2/0 swaplog (403705 entries)
> 2001/03/30 13:00:45| Done reading /cache1/4/0 swaplog (409005 entries)
> 2001/03/30 13:00:45| Finished rebuilding storage from disk.
> 2001/03/30 13:00:45| 2787217 Entries scanned
> 2001/03/30 13:00:45| 0 Invalid entries.
> 2001/03/30 13:00:45| 0 With invalid flags.
> 2001/03/30 13:00:45| 2780110 Objects loaded.
> 2001/03/30 13:00:45| 0 Objects expired.
> 2001/03/30 13:00:45| 6781 Objects cancelled.
> 2001/03/30 13:00:45| 592 Duplicate URLs purged.
> 2001/03/30 13:00:45| 27 Swapfile clashes avoided.
> 2001/03/30 13:00:45| Took 864.1 seconds (3217.5 objects/sec).
> 2001/03/30 13:00:45| Beginning Validation Procedure
> 2001/03/30 13:00:48| 262144 Entries Validated so far.
> 2001/03/30 13:00:52| 524288 Entries Validated so far.
> 2001/03/30 13:00:55| 786432 Entries Validated so far.
> 2001/03/30 13:00:58| 1048576 Entries Validated so far.
> 2001/03/30 13:01:02| 1310720 Entries Validated so far.
> 2001/03/30 13:01:05| 1572864 Entries Validated so far.
> 2001/03/30 13:01:09| 1835008 Entries Validated so far.
> 2001/03/30 13:01:13| 2097152 Entries Validated so far.
> 2001/03/30 13:01:16| 2359296 Entries Validated so far.
> 2001/03/30 13:01:19| 2621440 Entries Validated so far.
> 2001/03/30 13:01:21| Completed Validation Procedure
> 2001/03/30 13:01:21| Validated 2779770 Entries
> 2001/03/30 13:01:21| store_swap_size = 38440168k
> 2001/03/30 13:01:30| storeLateRelease: released 4451 objects
> 2001/03/30 13:01:57| WARNING: failed to unpack meta data
> 2001/03/30 13:02:30| WARNING: failed to unpack meta data
> ...
> ...
> ...
> 2001/03/30 13:07:15| WARNING: failed to unpack meta data
> 2001/03/30 13:07:16| WARNING: failed to unpack meta data
> 2001/03/30 13:08:06| clientReadRequest: FD 3470 Invalid Request
>
> Program received signal SIGSEGV, Segmentation fault.
> 0x80aab9b in linklistPush (L=0x1fcfe7, p=0x502d0000) at tools.c:873
> 873 while (*L)
> (gdb) bt
> #0 0x80aab9b in linklistPush (L=0x1fcfe7, p=0x502d0000) at tools.c:873
> #1 0x80b7ca0 in storeDiskdShmPut (sd=0x820dbd8, offset=294912)
> at store_dir_diskd.c:1649
> #2 0x80b4aac in storeDiskdDirCallback (SD=0x820dbd8) at
> store_dir_diskd.c:532
> #3 0x80a6e17 in storeDirCallback () at store_dir.c:467
> #4 0x80661ca in comm_poll (msec=0) at comm_select.c:330
> #5 0x80885ad in main (argc=2, argv=0xbfbffbf8) at main.c:720
> #6 0x804a529 in _start ()
> (gdb) c
> Continuing.
>
> Program terminated with signal SIGSEGV, Segmentation fault.
> The program no longer exists.
> (gdb) quit
>
> Script done on Fri Mar 30 13:09:35 2001
Received on Sat Mar 31 2001 - 05:59:07 MST