Re: [SQU] Squid 2.4 Head FATAL: Received Segment Violation...dying

Hi Henrik,

> Can you repeat it?

Of course:

cache# script squid24.gdb5 gdb /usr/local/sbin/squid
Script started, output file is squid24.gdb5
GNU gdb 4.18
Copyright 1998 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain
conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "i386-unknown-freebsd"...
(gdb) handle SIGPIPE noprint nostop pass
Signal Stop Print Pass to program Description
SIGPIPE No No Yes Broken pipe
(gdb) r -CNd1
Starting program: /usr/local/sbin/squid -CNd1
2001/02/19 16:13:07| Starting Squid Cache version 2.4.PRE-STABLE for
i386-unknown-freeb
sd4.2...
2001/02/19 16:13:07| Process ID 251
2001/02/19 16:13:07| With 32768 file descriptors available
2001/02/19 16:13:07| Performing DNS Tests...
2001/02/19 16:13:07| Successful DNS name lookup tests...
2001/02/19 16:13:07| DNS Socket created on FD 7
2001/02/19 16:13:07| Adding nameserver 127.0.0.1 from /etc/resolv.conf
2001/02/19 16:13:07| Unlinkd pipe opened on FD 12
2001/02/19 16:13:07| Swap maxSize 43008000 KB, estimated 3308307 objects
2001/02/19 16:13:07| Target number of buckets: 165415
2001/02/19 16:13:07| Using 262144 Store buckets
2001/02/19 16:13:07| Max Mem size: 131072 KB
2001/02/19 16:13:07| Max Swap size: 43008000 KB
2001/02/19 16:13:07| Store logging disabled
2001/02/19 16:13:07| Rebuilding storage in /cache0/0 (DIRTY)
2001/02/19 16:13:07| Rebuilding storage in /cache1/0/0 (DIRTY)
2001/02/19 16:13:07| Rebuilding storage in /cache1/1/0 (DIRTY)
2001/02/19 16:13:07| Rebuilding storage in /cache1/2/0 (DIRTY)
2001/02/19 16:13:07| Rebuilding storage in /cache1/3/0 (DIRTY)
2001/02/19 16:13:07| Rebuilding storage in /cache1/4/0 (DIRTY)
2001/02/19 16:13:07| Rebuilding storage in /cache1/5/0 (DIRTY)
2001/02/19 16:13:07| Using Round Robin store dir selection
2001/02/19 16:13:07| Set Current Directory to /cache0/0
2001/02/19 16:13:07| Loaded Icons.
2001/02/19 16:13:07| Accepting HTTP connections at 0.0.0.0, port 80, FD 25.
2001/02/19 16:13:07| Accepting SNMP messages on port 1610, FD 26.
2001/02/19 16:13:07| Accepting WCCP messages on port 2048, FD 27.
2001/02/19 16:13:07| Ready to serve requests.
2001/02/19 16:13:09| Store rebuilding is 0.9% complete
2001/02/19 16:13:16| WARNING: newer swaplog entry for dirno 0, fileno
0000701E
2001/02/19 16:13:17| WARNING: newer swaplog entry for dirno 5, fileno
000004BC
2001/02/19 16:13:17| WARNING: newer swaplog entry for dirno 0, fileno
00007CE5
2001/02/19 16:13:17| WARNING: newer swaplog entry for dirno 5, fileno
000080D4
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 3, fileno
000052DD
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 3, fileno
00005C71
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 3, fileno
000063F5
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 1, fileno
00000B35
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 1, fileno
00001263
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 0, fileno
00001124
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 3, fileno
00007516
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 1, fileno
00003271
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 4, fileno
00000A9D
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 3, fileno
00008601
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 1, fileno
00006792
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 2, fileno
00009251
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 5, fileno
00000AD4
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 6, fileno
00000BE3
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 6, fileno
00001E40
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 0, fileno
000066FD
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 3, fileno
0000979D
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 1, fileno
0000873D
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 3, fileno
0000B43B
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 1, fileno
0000A3E5
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 0, fileno
0000983A
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 1, fileno
0000A751
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 3, fileno
0000D32F
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 5, fileno
000094BF
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 6, fileno
00009B58
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 1, fileno
0000C105
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 1, fileno
0000CD57
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 1, fileno
0000D022
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 0, fileno
0000CEA1
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 4, fileno
0000C1A6
2001/02/19 16:13:22| WARNING: newer swaplog entry for dirno 5, fileno
0000B57D
2001/02/19 16:13:24| Store rebuilding is 12.7% complete
2001/02/19 16:13:26| WARNING: newer swaplog entry for dirno 2, fileno
00009553
2001/02/19 16:13:26| WARNING: newer swaplog entry for dirno 2, fileno
0000C409
2001/02/19 16:13:26| WARNING: newer swaplog entry for dirno 3, fileno
000014C8
2001/02/19 16:13:26| WARNING: newer swaplog entry for dirno 3, fileno
00004DFA
2001/02/19 16:13:26| WARNING: newer swaplog entry for dirno 2, fileno
0000E40B
2001/02/19 16:13:26| WARNING: newer swaplog entry for dirno 2, fileno
0000E4F5
2001/02/19 16:13:26| WARNING: newer swaplog entry for dirno 3, fileno
00007E95
2001/02/19 16:13:26| WARNING: newer swaplog entry for dirno 2, fileno
0000EBF9
2001/02/19 16:13:26| WARNING: newer swaplog entry for dirno 3, fileno
0000D860
2001/02/19 16:13:26| WARNING: newer swaplog entry for dirno 2, fileno
0000EE84
2001/02/19 16:13:26| WARNING: newer swaplog entry for dirno 3, fileno
0000DD92
2001/02/19 16:13:26| WARNING: newer swaplog entry for dirno 3, fileno
0000E086
2001/02/19 16:13:26| WARNING: newer swaplog entry for dirno 1, fileno
0000E031
2001/02/19 16:13:26| WARNING: newer swaplog entry for dirno 3, fileno
0000FEFE
2001/02/19 16:13:26| WARNING: newer swaplog entry for dirno 0, fileno
0000E193
2001/02/19 16:13:26| WARNING: newer swaplog entry for dirno 0, fileno
0000EA8E
2001/02/19 16:13:26| WARNING: newer swaplog entry for dirno 4, fileno
0000F747

Program received signal SIGSEGV, Segmentation fault.
0x80b2416 in storeUfsDirReplRemove (e=0xceea980) at store_dir_ufs.c:1426
1426 SD->repl->Remove(SD->repl, e, &e->repl);
(gdb) bt
#0 0x80b2416 in storeUfsDirReplRemove (e=0xceea980) at store_dir_ufs.c:1426
#1 0x80afe2d in storeUfsDirRebuildFromSwapLog (data=0x9b9b000) at
store_dir_ufs.c:567
#2 0x806b456 in eventRun () at event.c:147
#3 0x80882ca in main (argc=2, argv=0xbfbffc24) at main.c:716
#4 0x804a529 in _start ()

> If so, can you please print the following values:
> print *e
> print *SD
> print *SD->repl

(gdb) print *e
$1 = {hash = {key = 0xcee8be0, next = 0xca6b4c0}, mem_obj = 0xc1b2f80, repl
= {
    data = 0x0}, timestamp = 982620505, lastref = 982620811, expires =
982620811,
  lastmod = 972413573, swap_file_sz = 0, swap_filen = -1, swap_dirn = -1,
  refcount = 1, flags = 1224, lock_count = 1, mem_status = 0, ping_status =
2,
  store_status = 0, swap_status = 0}
(gdb) print *SD
$2 = {type = 0x0, cur_size = 0, low_size = 0, max_size = 0, path = 0x0,
index = 0,
  suggest = 0, max_objsize = 0, repl = 0x0, removals = 0, scanned = 0, flags
= {
    selected = 0, read_only = 0}, init = 0, newfs = 0, dump = 0, freefs = 0,
  dblcheck = 0, statfs = 0, maintainfs = 0, checkobj = 0, refobj = 0,
unrefobj = 0,
  callback = 0, sync = 0, obj = {create = 0, open = 0, close = 0, read = 0,
    write = 0, unlink = 0}, log = {open = 0, close = 0, write = 0, clean = {
      start = 0, nextentry = 0, write = 0, done = 0, state = 0x0},
    writes_since_clean = 0}, fs = {blksize = 0}, fsdata = 0x0}
(gdb) print *SD->repl
Error accessing memory address 0x0: Bad address.
(gdb) q
The program is running. Exit anyway? (y or n) y

Script done, output file is squid24.gdb5

> Btw, what compiler is being used?

cache# gcc -v
Using builtin specs.
gcc version 2.95.2 19991024 (release)

I hope this can help...

Greetings
Ales

----- Original Message -----
From: "Henrik Nordstrom" <hno@hem.passagen.se>
To: "Alejandro A. Ramirez" <ales@megared.net.mx>
Cc: <squid-dev@squid-cache.org>
Sent: Monday, February 19, 2001 3:57 PM
Subject: Re: [SQU] Squid 2.4 Head FATAL: Received Segment Violation...dying

> Interesting.. a quite different trace from the other..
>
> Can you repeat it?
>
> If so, can you please print the following values:
>
> print *e
> print *SD
> print *SD->repl
>
> The only way I see that this particular line could actually fail is if
> there is no removal policy active for the cache_dir, but Squid should
> not even start if it fails to register a removal policy for the
> cache_dir..
>
> Btw, what compiler is being used?
> gcc -v
>
> /Henrik
>
>
> Alejandro A. Ramirez wrote:
> >
> > Hi Henrik,
> >
> > I have changed the diskd storage for ufs, in order to get a
backtrace,
> > and it crashes almost instantly, if you like me to clean my current
cache in
> > order to make another test (or need a diferent test, I have a lot of
> > traffic, I can make it crash in just a few minutes, and have some
results),
> > just let me know.
> >
> > Here you have the backtrace:
> >
> > Script started on Mon Feb 19 10:16:04 2001
> > GNU gdb 4.18
> > Copyright 1998 Free Software Foundation, Inc.
> > GDB is free software, covered by the GNU General Public License, and you
are
> > welcome to change it and/or distribute copies of it under certain
> > conditions.
> > Type "show copying" to see the conditions.
> > There is absolutely no warranty for GDB. Type "show warranty" for
details.
> > This GDB was configured as "i386-unknown-freebsd"...
> > (gdb) handle SIGPIPE noprint nostop pass
> > Signal Stop Print Pass to program Description
> > SIGPIPE No No Yes Broken pipe
> > (gdb) r -CNd1
> > Starting program: /usr/local/sbin/squid -CNd1
> > 2001/02/19 10:16:19| Starting Squid Cache version 2.4.PRE-STABLE for
> > i386-unknown-freebsd4.2...
> > 2001/02/19 10:16:19| Process ID 205
> > 2001/02/19 10:16:19| With 32768 file descriptors available
> > 2001/02/19 10:16:19| Performing DNS Tests...
> > 2001/02/19 10:16:19| Successful DNS name lookup tests...
> > 2001/02/19 10:16:19| DNS Socket created on FD 7
> > 2001/02/19 10:16:19| Adding nameserver 127.0.0.1 from /etc/resolv.conf
> > 2001/02/19 10:16:19| Unlinkd pipe opened on FD 12
> > 2001/02/19 10:16:19| Swap maxSize 43008000 KB, estimated 3308307 objects
> > 2001/02/19 10:16:19| Target number of buckets: 165415
> > 2001/02/19 10:16:19| Using 262144 Store buckets
> > 2001/02/19 10:16:19| Max Mem size: 131072 KB
> > 2001/02/19 10:16:19| Max Swap size: 43008000 KB
> > 2001/02/19 10:16:19| Store logging disabled
> > 2001/02/19 10:16:19| Rebuilding storage in /cache0/0 (DIRTY)
> > 2001/02/19 10:16:19| Rebuilding storage in /cache1/0/0 (DIRTY)
> > 2001/02/19 10:16:19| Rebuilding storage in /cache1/1/0 (DIRTY)
> > 2001/02/19 10:16:19| Rebuilding storage in /cache1/2/0 (DIRTY)
> > 2001/02/19 10:16:19| Rebuilding storage in /cache1/3/0 (DIRTY)
> > 2001/02/19 10:16:19| Rebuilding storage in /cache1/4/0 (DIRTY)
> > 2001/02/19 10:16:19| Rebuilding storage in /cache1/5/0 (DIRTY)
> > 2001/02/19 10:16:19| Using Round Robin store dir selection
> > 2001/02/19 10:16:19| Set Current Directory to /cache0/0
> > 2001/02/19 10:16:19| Loaded Icons.
> > 2001/02/19 10:16:19| Accepting HTTP connections at 0.0.0.0, port 80, FD
25.
> > 2001/02/19 10:16:19| Accepting SNMP messages on port 1610, FD 26.
> > 2001/02/19 10:16:19| Accepting WCCP messages on port 2048, FD 27.
> > 2001/02/19 10:16:19| Ready to serve requests.
> > 2001/02/19 10:16:23| Store rebuilding is 0.9% complete
> > 2001/02/19 10:16:30| WARNING: newer swaplog entry for dirno 0, fileno
> > 0000701E
> > 2001/02/19 10:16:30| WARNING: newer swaplog entry for dirno 5, fileno
> > 000004BC
> > 2001/02/19 10:16:30| WARNING: newer swaplog entry for dirno 0, fileno
> > 00007CE5
> > 2001/02/19 10:16:31| WARNING: newer swaplog entry for dirno 5, fileno
> > 000080D4
> >
> > Program received signal SIGSEGV, Segmentation fault.
> > 0x80b2416 in storeUfsDirReplRemove (e=0xbbecd00) at store_dir_ufs.c:1426
> > 1426 SD->repl->Remove(SD->repl, e, &e->repl);
> > (gdb) bt
> > #0 0x80b2416 in storeUfsDirReplRemove (e=0xbbecd00) at
store_dir_ufs.c:1426
> > #1 0x80afe2d in storeUfsDirRebuildFromSwapLog (data=0x9b9b400) at
> > store_dir_ufs.c:567
> > #2 0x806b456 in eventRun () at event.c:147
> > #3 0x80882ca in main (argc=2, argv=0xbfbffc24) at main.c:716
> > #4 0x804a529 in _start ()
> > (gdb) q
> > The program is running. Exit anyway? (y or n) y
> >
> > If you think you need access to this server, I think I can provide it to
> > you, in order for you to debug this.
> >
> > Greetings...
> > Ales
> >
> > ----- Original Message -----
> > From: "Henrik Nordstrom" <hno@hem.passagen.se>
> > To: "Jeremy Lyon" <jxlyon@uswest.com>
> > Cc: "squid users" <squid-users@ircache.net>
> > Sent: Sunday, February 18, 2001 2:45 PM
> > Subject: Re: [SQU] Squid 2.4 Head FATAL: Received Segment
Violation...dying
> >
> > > It would be very helpful if you could try to get a trace of where
Squid
> > > fails for you without diskd (the only trace we have so far in this
> > > thread is a crash inside the diskd store).
> > >
> > > --
> > > Henrik Nordstrom
> > > Squid hacker
> > >
> > >
> > > Jeremy Lyon wrote:
> > > >
> > > > I have had this same problem not using diskd. That's why I haven't
> > > > pushed 2.4PRE-STABLE into production.
> > >
> > > --
> > > To unsubscribe, see http://www.squid-cache.org/mailing-lists.html
Received on Mon Feb 19 2001 - 16:34:35 MST