[squid-users] squid Version 2.6.STABLE16 crashing with url_rewriters

From: Goj, Dirk <Dirk.Goj@dont-contact.us>
Date: Fri, 1 Feb 2008 10:21:04 +0100

Hi there.

Yesterday my proxy started crashing with following error message:

2008/01/31 14:04:12| Starting Squid Cache version 2.6.STABLE16 for i386-debian-linux-gnu...
2008/01/31 14:04:12| Process ID 22919
2008/01/31 14:04:12| With 1024 file descriptors available
2008/01/31 14:04:12| Using epoll for the IO loop
2008/01/31 14:04:12| Performing DNS Tests...
2008/01/31 14:04:12| Successful DNS name lookup tests...
2008/01/31 14:04:12| DNS Socket created at 0.0.0.0, port 37010, FD 6
2008/01/31 14:04:12| Adding nameserver 62.206.1.4 from /etc/resolv.conf
2008/01/31 14:04:12| Adding nameserver 62.206.2.4 from /etc/resolv.conf
2008/01/31 14:04:12| helperOpenServers: Starting 5 'squidGuard' processes
2008/01/31 14:04:12| User-Agent logging is disabled.
2008/01/31 14:04:12| Referer logging is disabled.
2008/01/31 14:04:12| Unlinkd pipe opened on FD 16
2008/01/31 14:04:12| Swap maxSize 10240000 KB, estimated 787692 objects
2008/01/31 14:04:12| Target number of buckets: 39384
2008/01/31 14:04:12| Using 65536 Store buckets
2008/01/31 14:04:12| Max Mem size: 8192 KB
2008/01/31 14:04:12| Max Swap size: 10240000 KB
2008/01/31 14:04:12| Local cache digest enabled; rebuild/rewrite every 3600/3600 sec
2008/01/31 14:04:12| Rebuilding storage in /usr/local/squid/var/cache (CLEAN)
2008/01/31 14:04:12| Using Least Load store dir selection
2008/01/31 14:04:12| Current Directory is /
2008/01/31 14:04:12| Loaded Icons.
2008/01/31 14:04:12| Accepting proxy HTTP connections at 0.0.0.0, port 3128, FD18
2008/01/31 14:04:12| Accepting ICP messages at 0.0.0.0, port 3130, FD 19.
2008/01/31 14:04:12| Accepting HTCP messages on port 4827, FD 20.
2008/01/31 14:04:12| Accepting SNMP messages on port 3401, FD 21.
2008/01/31 14:04:12| WCCP Disabled.
2008/01/31 14:04:12| Ready to serve requests.
2008/01/31 14:04:12| Store rebuilding is 2.8% complete
2008/01/31 14:04:12| WARNING: url_rewriter #1 (FD 7) exited
2008/01/31 14:04:13| Done reading /usr/local/squid/var/cache swaplog (146478 entries)
2008/01/31 14:04:13| Finished rebuilding storage from disk.
2008/01/31 14:04:13|    146478 Entries scanned
2008/01/31 14:04:13|         0 Invalid entries.
2008/01/31 14:04:13|         0 With invalid flags.
2008/01/31 14:04:13|    146478 Objects loaded.
2008/01/31 14:04:13|         0 Objects expired.
2008/01/31 14:04:13|         0 Objects cancelled.
2008/01/31 14:04:13|         0 Duplicate URLs purged.
2008/01/31 14:04:13|         0 Swapfile clashes avoided.
2008/01/31 14:04:13|   Took 0.7 seconds (195566.6 objects/sec).
2008/01/31 14:04:13| Beginning Validation Procedure
2008/01/31 14:04:13|   Completed Validation Procedure
2008/01/31 14:04:13|   Validated 146478 Entries
2008/01/31 14:04:13|   store_swap_size = 2671964k
2008/01/31 14:04:13| WARNING: url_rewriter #2 (FD 8) exited
2008/01/31 14:04:13| storeLateRelease: released 0 objects
2008/01/31 14:04:14| WARNING: url_rewriter #3 (FD 9) exited
2008/01/31 14:04:14| Too few url_rewriter processes are running
2008/01/31 14:04:14| storeDirWriteCleanLogs: Starting...
2008/01/31 14:04:14| WARNING: Closing open FD 18
2008/01/31 14:04:14| commSetEvents: epoll_ctl(EPOLL_CTL_DEL): failed on fd=18: (1) Operation not permitted
2008/01/31 14:04:14|     65536 entries written so far.
2008/01/31 14:04:14|    131072 entries written so far.
2008/01/31 14:04:14|   Finished. Wrote 146478 entries.
2008/01/31 14:04:14|   Took 0.0 seconds (6418843.1 entries/sec).
FATAL: The url_rewriter helpers are crashing too rapidly, need help!

Squid Cache (Version 2.6.STABLE16): Terminated abnormally.
CPU Usage: 0.580 seconds = 0.260 user + 0.320 sys
Maximum Resident Size: 0 KB
Page faults with physical i/o: 0
Memory usage for squid via mallinfo():
        total space in arena: 16272 KB
        Ordinary blocks: 16186 KB 11 blks
        Small blocks: 0 KB 0 blks
        Holding blocks: 504 KB 2 blks
        Free Small blocks: 0 KB
        Free Ordinary blocks: 85 KB
        Total in use: 16690 KB 99%
        Total free: 85 KB 1%

When I restart squid from webmin or from ssh the same thing happens. Changed nothing at squid itself. Search the internet and found one thing that the helper (squidGuard) may have a to big logfile. But it's not the logfile. When I disable the helper squidGuard squid runs normally. It's the squidGuard which hasn't changed too... access rights to squidguard-db's are ok. Every folder and file same user like the squid is running under...

I'm out of ideas...

May anyone of you have ideas ?

Thx!

Dirk Goj

Mit freundlichen Grüßen

Udo Täubrich Betreuungs GmbH
i. A. Dirk Goj

Westpreussenstr. 38
47809 Krefeld
Tel: 02151-1570 1766
Fax: 02151-1570 1789
_____________________________________________________________________________

Geschäftsführer: Ralph Krahl, Roland Stübing
Registergericht: Amtsgericht Krefeld HRB 8906

Die in dieser E-Mail enthaltenen Informationen sind moeglicherweise vertraulich und koennen von rechtlicher Bedeutung sein. Diese Mail ist ausschliesslich für den Adressaten bestimmt und jeglicher Zugriff durch andere Personen ist nicht zulaessig. Falls Sie nicht der beabsichtigte Empfaenger sind, ist jegliche Veroeffentlichung, Vervielfaeltigung, Verteilung oder sonstige in diesem Zusammenhang stehende Handlung untersagt und unter Umstaenden ungesetzlich. Sollten Sie nicht der vorgesehene Empfaenger dieser E-Mail sein, informieren Sie bitte den Absender und loeschen Sie sie danach.

This message contains confidential information and is intended only for the individual named. If you are not the named addressee you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately by e-mail you have received this e-mail by mistake and delete this e-mail from your system.

As you know, messages sent by e-mail can be manipulated by third parties. For this reason our e-mail messages are generally not legally binding. This message (and any files transmitted with it) may contain confidential and/or privileged material. The information transmitted is intended only for the person or entity to which it is addressed.
If you have received this e-mail in error please notify the sender or the system manager immediately by reply e-mail and delete this message and any attachments. Any review, disclosure, copy, distribution or other use of contents of this message by persons or entities other than the intended recipient is prohibited.
Received on Fri Feb 01 2008 - 02:21:12 MST

This archive was generated by hypermail pre-2.1.9 : Sat Mar 01 2008 - 12:00:04 MST