RE: [squid-users] Increasing File Descriptors - Fixed!!

I went ahead and updated /etc/sysctl.conf to allow for 1024-64000 ports open for connections.

That should help; I just wish I could test it before August......... :-(

steve

-----Original Message-----
From: Jose Ildefonso Camargo Tolosa [mailto:ildefonso.camargo_at_gmail.com]
Sent: Monday, May 10, 2010 5:39 PM
To: Bradley, Stephen W. Mr.
Cc: mnhassan_at_usa.net; Squid Users
Subject: Re: [squid-users] Increasing File Descriptors - Fixed!!

Hi!

On Mon, May 10, 2010 at 8:44 AM, Bradley, Stephen W. Mr.
<bradlesw_at_muohio.edu> wrote:
> Never thought of that, thanks.
>
> We use one IP address for each of the Squid servers and I gather from what you are saying that is also going to be a problem?

It depends on the amount of simultaneous outgoing connections on the
proxy, you need to evaluate that. I hit the limit once, it was on a
1000 computers network (used by college students, mainly), I had to
increase the port-range to allow 40k connections, and it went stable
on around 20k with peaks of ~35k :-S (that lasted a couple of minutes,
and occurred at least three times a day).

It was interesting.

>
> steve
>
> -----Original Message-----
> From: Jose Ildefonso Camargo Tolosa [mailto:ildefonso.camargo_at_gmail.com]
> Sent: Saturday, May 08, 2010 3:17 PM
> To: Bradley, Stephen W. Mr.
> Cc: mnhassan_at_usa.net; Squid Users
> Subject: Re: [squid-users] Increasing File Descriptors - Fixed!!
>
> Hi!
>
> Just one thought here:
>
> I believe there is a limit on the number of connections that can be
> originated from a single IP (IPv4), so, I guess that you have
> *several* external IPs and that you make squid use many of them, look
> that file on your system:
>
> cat /proc/sys/net/ipv4/ip_local_port_range
>
> in my PC it is: 32768 to 61000, thus giving me a max of 28232 outgoing
> connections per IP, that's usually "enough", but your case isn't a
> "usual" one.
>
> I hope this helps,
>
> Ildefonso Camargo
>
> On Fri, May 7, 2010 at 8:32 AM, Bradley, Stephen W. Mr.
> <bradlesw_at_muohio.edu> wrote:
>> Got it resolved!
>>
>> cat /proc/sys/fs/file-max showed that I could go as high as 3,138,830 FDs.
>>
>> I changed the compile options to --with-maxfd=128000 and recompiled and installed it.
>>
>> I changed the line in my /etc/init.d/squid script to ulimit -HSn 128000 and restarted.
>>
>> I thought I had tried all this before but evidently not.
>>
>> If it almost held the load at 32,768 then at 128,000 I should have enough head room to keep us safe, for now.
>>
>>
>> Thanks to all who responded.
>>
>> steve
>>
>>
>> -----Original Message-----
>> From: Nyamul Hassan [mailto:mnhassan_at_usa.net]
>> Sent: Thursday, May 06, 2010 4:15 PM
>> To: Squid Users
>> Subject: Re: [squid-users] Increasing File Descriptors
>>
>> He needs more FDs because this single box is handling 5000 users over
>> a 400mbps connection.  We run around 2,000 users on generic hardware,
>> and have seen FDs as high as 20k.
>>
>> We use CentOS 5 and the following guide is a good place to increase
>> the FD limit:
>> http://www.cyberciti.biz/faq/linux-increase-the-maximum-number-of-open-files/
>> The command "cat /proc/sys/fs/file-max" shows how many maximum FDs
>> your OS can handle.
>>
>> After you've made sure that your OS is doing your desired FD limit,
>> please re-run Squid.  Squid shows how many FDs it is configured for in
>> its "General Runtime Information" (mgr:info in cli) from the CacheMgr
>> interface.  If this still shows lower than the OS limit you just saw
>> earlier, then you might need to recompile Squid with the
>> '--with-maxfd=<your-desired-fdmax>' flag set during "./configure"
>>
>> As a side note, if you are using Squid as a forward proxy, you might
>> have better results with Squid 2.7x.
>>
>> Regards
>> HASSAN
>>
>>
>> On Fri, May 7, 2010 at 00:53, George Herbert <george.herbert_at_gmail.com> wrote:
>>>
>>> Do this:
>>>
>>> ulimit -Hn
>>>
>>> If the values is 32768 that's your current kernel/sys max value and
>>> you're stuck.
>>>
>>> If it's more than 32768 (and my RHEL 5.3 box says 65536) then you
>>> should be able to increase up to that value.  Unless there's an
>>> internal signed 16-bit int involved in FD tracking inside the Squid
>>> code then something curious is happening...
>>>
>>> However - I'm curious as to why you'd need that many.  I've had top
>>> end systems with Squid clusters running with compiles of 16k file
>>> descriptors and only ever really used 4-5k.  What are you doing that
>>> you need more than 32k?
>>>
>>>
>>> -george
>>>
>>> On Thu, May 6, 2010 at 10:32 AM, Bradley, Stephen W. Mr.
>>> <bradlesw_at_muohio.edu> wrote:
>>> > Unfortunately won't work for me above 32768.
>>> >
>>> > I have the ulimit in the startup script and that works okay but I need more the 32768.
>>> >
>>> > :-(
>>> >
>>> >
>>> >
>>> > -----Original Message-----
>>> > From: Ivan . [mailto:ivanhec_at_gmail.com]
>>> > Sent: Thursday, May 06, 2010 5:17 AM
>>> > To: Bradley, Stephen W. Mr.
>>> > Cc: squid-users_at_squid-cache.org
>>> > Subject: Re: [squid-users] Increasing File Descriptors
>>> >
>>> > worked for me
>>> >
>>> > http://paulgoscicki.com/archives/2007/01/squid-warning-your-cache-is-running-out-of-filedescriptors/
>>> >
>>> > no recompile necessary
>>> >
>>> >
>>> > On Thu, May 6, 2010 at 7:13 PM, Bradley, Stephen W. Mr.
>>> > <bradlesw_at_muohio.edu> wrote:
>>> >> I can't seem to get increase the number above 32768 no matter what I do.
>>> >>
>>> >> Ulimit during compile, sysctl.conf and everything else but no luck.
>>> >>
>>> >>
>>> >> I have about 5,000 users on a 400mbit connection.
>>> >>
>>> >> Steve
>>> >>
>>> >> RHEL5 64bit with Squid 3.1.1
>>> >
>>>
>>>
>>>
>>> --
>>> -george william herbert
>>> george.herbert_at_gmail.com
>>>
>>
>
Received on Wed May 12 2010 - 14:17:26 MDT