Re: AW: [squid-users] Squid unreachable every hour and 6 minutes.

The "disk space is over limit" error is not saying the disk is full. The
cache has reached the limit that's been set in the squid.conf file.
It could be causing squid to die, but how likely is it that this would be
the cause, if squid dies 6 minutes after every hour?

My suggestion is to check and see what cron jobs are running:
cat /etc/crontab
or (as root): crontab -l and then crontab -l <any other users that might
be running cron jobs>

If there's a timely pattern to the connectivity issue, the root of the
problem probably has something to do with a schedule for something.
Cron would be a good place to start.

On the "disk space is over limit" issue...
You really shouldn't have to tend to this. Squid should use whatever
replacement policy was specified at compile time (forget which one is
default if none is specified)
To remove old/unused cache objects in an effort to free up space. However,
if squid is trying to do this, and is actively handling proxy requests at
the same time,
squid could be running out of resources. What specs do you have on this
machine? CPU/Ram/etc.

Tim Rainier
Information Services, Kalsec, INC
trainier@kalsec.com

<Werner.Rost@zf.com>
11/09/2005 09:45 AM

To
<Lilian.Gix@boschrexroth.de>, <dave@raven.za.net>,
<squid-users@squid-cache.org>
cc

Subject
AW: [squid-users] Squid unreachable every hour and 6 minutes.

Please repeat that again.

(1) stop squid

(2) find out wht are the cache directories squid uses, for example

       # grep cache_dir squid.conf
       cache_dir ufs /data1/squid_cache 6000 32 512
       cache_dir ufs /data2/squid_cache 10000 32 512
       #

     In this example /data1/squid_cache and /data2/squid_cache are the
cache dirs.

(3) Clean all cache dirs - in this example:

       cd /data1/squid_cache
       rm -f *
       cd /data2/squid_cache
       rm -f *

(3) create the cache structures again: squid -z

(4) Start squid.
    What happens?
    Is squid running? ps -ef | grep squid
    What does cache.log say since starting of squid?
    Is squid reachable?

(5) What happens after 1 hour an 6 minutes?

Werner Rost

>>-----Ursprüngliche Nachricht-----
>>Von: Gix, Lilian (CI/OSR) * [mailto:Lilian.Gix@boschrexroth.de]
>>Gesendet: Mittwoch, 9. November 2005 15:10
>>An: Dave Raven; squid-users@squid-cache.org
>>Betreff: RE: [squid-users] Squid unreachable every hour and 6 minutes.
>>
>>
>>I already tried to :
>>- Stop Squid, delete swap.state, restart squid
>>- Stop Squid, format my cache parition, squid -z, start squid
>>- change cache_dir ufs /cache 5000 16 256 to cache_dir ufs
>>/cache 100 16 256, squid -k restart.
>>- reboot completely the server
>>
>>But nothing worked.
>>
>>
>>
>>
>>-----Original Message-----
>>From: Dave Raven [mailto:dave@raven.za.net]
>>Sent: Mittwoch, 9. November 2005 14:58
>>To: Gix, Lilian (CI/OSR) *; squid-users@squid-cache.org
>>Subject: RE: [squid-users] Squid unreachable every hour and 6 minutes.
>>
>>Try use my method posted earlier to search for code files.
>>The fact that your log suddenly shows squid restarting means
>>it died unexpectedly. If there is a core file it'll be squids
>>problem - if not its probably something else causing the problem.
>>
>>Also, you should try clean out your cache_dir potentially...
>>Remove everything and run squid -z to recreate it
>>
>>-----Original Message-----
>>From: Gix, Lilian (CI/OSR) * [mailto:Lilian.Gix@boschrexroth.de]
>>Sent: 09 November 2005 03:32 PM
>>To: Mike Cudmore
>>Cc: squid-users@squid-cache.org
>>Subject: RE: [squid-users] Squid unreachable every hour and 6 minutes.
>>
>>Great, thanks for your answer and questions :
>>
>>1- I have a message form my browser (IE, Firefox) witch says
>>the proxy is unreachable. My MSN, yahoo messengers loose their access.
>>2- Ping like all other services still work perfectly. (SSH, Apache,
>>Ping,...)
>>3- Cache.log part is on the previous mail. You can see that
>>there is nothing special between 09:44:45 and 10:07:05 (when
>>squid come back)
>>
>>Thanks for help.
>>
>>L.G.
>>
>>________________________________
>>
>>From: Mike Cudmore [mailto:Mike.Cudmore@dft.gsi.gov.uk]
>>Sent: Mittwoch, 9. November 2005 14:10
>>To: Gix, Lilian (CI/OSR) *
>>Subject: RE: [squid-users] Squid unreachable every hour and 6 minutes.
>>
>>
>>Lilian
>>
>>I may have missed earlier entries in this thread so apologies
>>if I ask you to repeat any info.
>>
>>
>>1) How do you know squid is unreachable at these times ?
>>
>>2) try pinging the host squid is running on for a period that
>>covers the time that the squid is unreachable. Does the host
>>become unreachable as well?
>>
>>3) What does cache.log say for these periods ?
>>
>>I have more thoughts depending on the answers to these
>>
>>Regards
>>
>>Mike
>>
>>
>>>>> "Gix, Lilian (CI/OSR) *" <Lilian.Gix@boschrexroth.de> 09/11/05
>>12:44:30 >>>
>>
>>Hello,
>>
>>
>>Realy no body have an idea ?
>>
>>:(
>>
>>L.G.
>>
>>-----Original Message-----
>>From: Gix, Lilian (CI/OSR) *
>>Sent: Mittwoch, 2. November 2005 10:26
>>To: squid-users@squid-cache.org
>>Subject: [squid-users] Squid unreachable every hour and 6 minutes.
>>
>>Hello,
>>
>>I have a problem with my squid :
>>every hour and 6 minutes, it is unreachable for few second.
>>
>>Here is a part of Cache.log :
>>
>>
>>
>> 2005/11/02 09:44:45| Detected REVIVED Parent: virus2.com/8080/0
>> 2005/11/02 10:07:05| Starting Squid Cache version
>>2.5.STABLE6 for i386-debian-li
>> nux-gnu...
>> 2005/11/02 10:07:05| Process ID 1430
>> 2005/11/02 10:07:05| With 4096 file descriptors available
>> 2005/11/02 10:07:05| DNS Socket created at 0.0.0.0, port
>>32772, FD 5
>> 2005/11/02 10:07:05| Adding nameserver 193.108.217.70
>>from /etc/resolv.conf
>> 2005/11/02 10:07:05| User-Agent logging is disabled.
>> 2005/11/02 10:07:05| Referer logging is disabled.
>> 2005/11/02 10:07:05| Unlinkd pipe opened on FD 10
>> 2005/11/02 10:07:05| Swap maxSize 102400 KB, estimated
>>7876 objects
>> 2005/11/02 10:07:05| Target number of buckets: 393
>> 2005/11/02 10:07:05| Using 8192 Store buckets
>> 2005/11/02 10:07:05| Max Mem size: 102400 KB
>> 2005/11/02 10:07:05| Max Swap size: 102400 KB
>> 2005/11/02 10:07:05| Local cache digest enabled;
>>rebuild/rewrite every 3600/3600
>> sec
>> 2005/11/02 10:07:05| Store logging disabled
>> 2005/11/02 10:07:05| Rebuilding storage in /cache (DIRTY)
>> 2005/11/02 10:07:05| Using Least Load store dir selection
>> 2005/11/02 10:07:05| Set Current Directory to /cache_log/
>> 2005/11/02 10:07:05| Loaded Icons.
>> 2005/11/02 10:07:15| Accepting HTTP connections at
>>0.0.0.0, port 8080, FD 11.
>> 2005/11/02 10:07:15| Accepting ICP messages at 0.0.0.0,
>>port 3130, FD 12.
>> 2005/11/02 10:07:15| HTCP Disabled.
>> 2005/11/02 10:07:15| WCCP Disabled.
>> 2005/11/02 10:07:15| Configuring Parent 10.4.13.184/8080/0
>> 2005/11/02 10:07:15| Ready to serve requests.
>> 2005/11/02 10:07:15| Configuring Parent virus1.com/8080/0
>> 2005/11/02 10:07:15| Configuring Parent virus2.com/8080/0
>> 2005/11/02 10:07:15| Store rebuilding is 1.9% complete
>> 2005/11/02 10:07:16| WARNING: newer swaplog entry for
>>dirno 0, fileno 0000031F
>> 2005/11/02 10:07:16| WARNING: newer swaplog entry for
>>dirno 0, fileno 00000371
>> ....
>> 2005/11/02 10:07:19| WARNING: newer swaplog entry for
>>dirno 0, fileno 000039E4
>> 2005/11/02 10:07:19| WARNING: newer swaplog entry for
>>dirno 0, fileno 000039E8
>> 2005/11/02 10:07:19| Done reading /cache swaplog (215057
>>entries)
>> 2005/11/02 10:07:19| Finished rebuilding storage from disk.
>> 2005/11/02 10:07:19| 111709 Entries scanned
>> 2005/11/02 10:07:19| 0 Invalid entries.
>> 2005/11/02 10:07:19| 0 With invalid flags.
>> 2005/11/02 10:07:19| 35086 Objects loaded.
>> 2005/11/02 10:07:19| 0 Objects expired.
>> 2005/11/02 10:07:19| 6194 Objects cancelled.
>> 2005/11/02 10:07:19| 3443 Duplicate URLs purged.
>> 2005/11/02 10:07:19| 70406 Swapfile clashes avoided.
>> 2005/11/02 10:07:19| Took 14.5 seconds (2411.4 objects/sec).
>> 2005/11/02 10:07:19| Beginning Validation Procedure
>> 2005/11/02 10:07:19| Completed Validation Procedure
>> 2005/11/02 10:07:19| Validated 31666 Entries
>> 2005/11/02 10:07:19| store_swap_size = 400260k
>> 2005/11/02 10:07:20| WARNING: Disk space over limit:
>>399480 KB > 102400 KB
>> 2005/11/02 10:07:20| storeLateRelease: released 2 objects
>> 2005/11/02 10:07:31| WARNING: Disk space over limit:
>>384820 KB > 102400 KB
>> 2005/11/02 10:07:39| WARNING: 1 swapin MD5 mismatches
>> 2005/11/02 10:07:42| WARNING: Disk space over limit:
>>377240 KB > 102400 KB
>> 2005/11/02 10:07:53| WARNING: Disk space over limit:
>>369680 KB > 102400 KB
>> 2005/11/02 10:08:04| WARNING: Disk space over limit:
>>351148 KB > 102400 KB
>> 2005/11/02 10:08:15| WARNING: Disk space over limit:
>>340112 KB > 102400 KB
>> 2005/11/02 10:08:26| WARNING: Disk space over limit:
>>320184 KB > 102400 KB
>> 2005/11/02 10:08:37| WARNING: Disk space over limit:
>>309412 KB > 102400 KB
>> 2005/11/02 10:08:41| clientProcessHit: Vary object loop!
>> 2005/11/02 10:08:48| WARNING: Disk space over limit:
>>295500 KB > 102400 KB
>> 2005/11/02 10:08:59| WARNING: Disk space over limit:
>>287596 KB > 102400 KB
>> 2005/11/02 10:09:10| WARNING: Disk space over limit:
>>277460 KB > 102400 KB
>> 2005/11/02 10:09:11| WARNING: 10 swapin MD5 mismatches
>> 2005/11/02 10:09:21| WARNING: Disk space over limit:
>>267808 KB > 102400 KB
>> 2005/11/02 10:09:32| WARNING: Disk space over limit:
>>256848 KB > 102400 KB
>> ...
>>
>>
>>
>>I already tried to :
>>- Stop Squid, delete swap.state, restart squid
>>- Stop Squid, format my cache parition, squid -z, start squid
>>- change cache_dir ufs /cache 5000 16 256 to cache_dir ufs
>>/cache 100 16 256, squid -k restart.
>>- reboot completely the server
>>
>>But nothing worked.
>>
>>I realy need a help.
>>
>>
>>PS : I'm with squid/2.5.STABLE6
>>
>>Thanks.
>>L.G.
>>
>>
>>
>>PLEASE NOTE: THE ABOVE MESSAGE WAS RECEIVED FROM THE INTERNET.
>>
>>On entering the GSi, this email was scanned for viruses by
>>the Government Secure Intranet (GSi) virus scanning service
>>supplied exclusively by Energis in partnership with MessageLabs.
>>
>>Please see
>>http://www.gsi.gov.uk/main/notices/information/gsi-003-2002.pd
f for further details.

In case of problems, please call your organisational IT helpdesk

**********************************************************************
This email and any files transmitted with it are private and intended
solely for the use of the individual or entity to which they are
addressed. If you are not the intended recipient the E-mail and any files
have been transmitted to you in error and any copying, distribution or
other use of the information contained in them is strictly prohibited.

Nothing in this E-mail message amounts to a contractual or other legal
commitment on the part of the Government unless confirmed by a
communication signed on behalf of the Secretary of State.

The Department's computer systems may be monitored and communications
carried on them recorded, to secure the effective operation of the system
and for other lawful purposes.
************************************************************************
***********

The original of this email was scanned for viruses by the Government
Secure Intranet (GSi) virus scanning service supplied exclusively by
Energis in partnership with MessageLabs.

On leaving the GSi this email was certified virus-free
Received on Wed Nov 09 2005 - 08:44:48 MST