RE: [squid-users] Squid Restarting

Hi Amos,

I'm looking into this now. Could you guide me, how to get the "two values in those FD" form the core dump file.
I did something... hope will give you clues. This is from Solaris.

pflags core_mib01_01-19_04_2012
core 'core-19_04_2012' of 22938: (squid) -f /squid_dir/etc/squid.conf
        data model = _ILP32 flags = MSACCT|MSFORK
 /1: flags = 0
        sigmask = 0xffffbefc,0x0000ffff cursig = SIGABRT

pstack core_mib01_01-19_04_2012
core 'core-19_04_2012' of 22938: (squid) -f /squid_dir/etc/squid.conf
----------------- lwp# 1 / thread# 1 --------------------
 feccc5f8 _lwp_kill (6, 0, fed34f98, fecabf18, ffffffff, 6) + 8
 fec4194c abort (23dd4e28, 1, 286790, eeb60, fed333d8, 0) + 110
 000c2aa4 xassert (23b3b0, 23aca0, 1f0, 49, 1, 2) + c4
 000d6d10 _ZN8FwdState12serverClosedEi (1f706cd0, e, 0, fed392a4, 3, 47c) + 48
 0017cf1c _ZN17CommCloseCbPtrFun4dialEv (232a4ba4, 0, 2ea174, 1, 2ea178, 217384) + c
 0016c178 _ZN9AsyncCall4makeEv (232a4b88, 3d28b8, ffffffff, 2ea000, 1, 14) + 1b8
 0016e5c4 _ZN14AsyncCallQueue8fireNextEv (47b828, 237800, 2ea174, 2ea178, 17a950, 232a4b88) + 1e4
 0016e778 _ZN14AsyncCallQueue4fireEv (47b828, 1a20fd11, 6b061, 3000, 1, 3bf400) + 18
 000cd680 _ZN9EventLoop13dispatchCallsEv (ffbffa50, ffbffa38, 1, 0, 81ca50, 15cae8) + c
 000cd8a4 _ZN9EventLoop7runOnceEv (ffbffa50, ffbff9a0, 10, ffbffa38, 81ca50, ffbffa58) + 110
 000cd990 _ZN9EventLoop3runEv (ffbffa50, ffbffa30, 246000, c0648, 0, 4835a0) + c
 0011b934 _Z9SquidMainiPPc (3, ffbffc64, 288800, ffffffff, ff312a00, fecb6144) + 8dc
 0011bef0 main (3, ffbffc64, ffbffc74, 3f36b0, ff310140, 0) + 8
 000833e4 _start (0, 0, 0, 0, 0, 0) + 5c

Hope this will help.

Thanks & regards,

---
Din
-----Original Message-----
From: Justin Lawler 
Sent: Friday, May 25, 2012 3:48 PM
To: Kamarudin Samsudin
Subject: FW: [squid-users] Squid Restarting
FYI
-----Original Message-----
From: Amos Jeffries [mailto:squid3_at_treenet.co.nz] 
Sent: Monday, May 14, 2012 8:16 PM
To: Justin Lawler
Cc: squid-users_at_squid-cache.org
Subject: Re: [squid-users] Squid Restarting
On 14/05/2012 11:03 p.m., Justin Lawler wrote:
> Thanks Amos - we have heap dumps but unfortunately we could not share with the wider community as they're taken from a customer production environment. However, we can send on information taken from the heap dump - like output from pflags/pstack/etc. Would this be sufficient to investigate the issue?
Private data should not be a problem. Initially we just need a backtrace from the dump to find which function calls led to it, and the two values in those FD.
Amos
> Thanks and regards,
> Justin
>
> -----Original Message-----
> From: Amos Jeffries
>
> On 4/05/2012 9:59 p.m., Justin Lawler wrote:
>> Hi,
>>
>> We're running squid 3.1.19 - and have seen it restarting from the logs, just after the below error:
>>
>> 2012/04/19 12:12:28| assertion failed: forward.cc:496: "server_fd == fd"
>> 2012/04/19 12:12:59| Starting Squid Cache version 3.1.19 for sparc-sun-solaris2.10...
>>
>> Is this a known issue? any workaround?
> Seems to be new and a bit strange. Squid opens one connection to the server to fetch content sometime later a connection was closed, but not the one which was opened to begin with.
>
> Do you have a core dump or stack trace available to identify what the fd and server_fd values actually were during the crash?
>
>> It's been in production for 6 weeks now, and have only seen it once, but we need to have an answer for the customer. We're worried it'll be more frequently as traffic goes up.
> Being the first report over a month after the release, it would seem to be very rare.
>
> Amos
> This message and the information contained herein is proprietary and 
> confidential and subject to the Amdocs policy statement, you may 
> review at http://www.amdocs.com/email_disclaimer.asp
>
This message and the information contained herein is proprietary and confidential and subject to the Amdocs policy statement,
you may review at http://www.amdocs.com/email_disclaimer.asp