RE: [squid-users] Big file http downloads crash...

I found that removing these lines in my squid.conf file fixes the problem
of my runaway squid RSS...

maximim_object_size 16384 KB
maximum_object_size_in_memory 64 KB

I tried it on FreeBSD-4.3, FreeBSD-current, and squid-2.4STABLE1,
Squid-2.4-HEAD
and Squid-2.5-HEAD... all giving the same results....

are those parameters not what they imply?
-Rob

-----Original Message-----
From: Rob Mallory [mailto:robm@ensemble.com]
Sent: Thursday, June 07, 2001 9:08 AM
To: 'Henrik Nordstrom'
Cc: 'squid-users@squid-cache.org'
Subject: RE: [squid-users] Big file http downloads crash...

goto:
http://www.sun.com/software/solaris/binaries/download.html

at the bottom, click on Solaris8 4/01 Download,
you must have/create a Sun Software account; then
download one or two of the CD's. Before trying it again this
morning, RSS of squid was 95MB, once it had downloaded 100MB of the CD,
RSS started growing in exact proportion to the size of the CD, and CPU
usage is now up to 15%, up from 0.5%, after downloading only 150MB.

truss -p shows a bunch of:
gettimeofday
msgsys....ERR#83'No message of desired type'
poll
read
gettimeofday
...

lsof gives no obvious hints, vmstat -m is not obvious,
systat -vmstat shows the cache disk is 30-50% busy, which
is 30-50% more busy than it usualy is... hmmm...
namei calls are up to around 12000/sec, but with 92% hits.
The Download speed of this file is around 90-100KB/sec.

killing the download from the client side brings all this
activity to a halt, but squid keeps the big RSS.
The machine is: P3-800 512MB of ram and a single cache disk
other than the system disk.

Is this happening to anyone else? (maybe it is specific to how
Sun round-robins and virtual-hosts its download sites...)
-Rob

-----Original Message-----
From: Henrik Nordstrom [mailto:hno@hem.passagen.se]
Sent: Wednesday, June 06, 2001 11:24 PM
To: Rob Mallory
Cc: 'squid-users@squid-cache.org'
Subject: Re: [squid-users] Big file http downloads crash...

Rob Mallory wrote:
>
> > I'm downloading big CD images through my squid caches, via a HTTP
get,
> > and am noticing that the RSS of the process grows as the download
> > procedes... the CPU usage goes up also as the download continues...
> >
> > I'm running FreeBSD, diskd, LFUDA, and have seen the same behavior on
2.4
> > and 2.5-devel branches...

It is not supposed to.

Do you have any URL where this happens?

--
Henrik Nordstrom
Squid Hacker