Re: [squid-users] What is a reasonable size for squid.conf?

Consider this a reply to Kinkie and Eliezer.

Yes, I expect my setup is unusual, but that's why I'm trying to get
advice from others who might have a similar setup.

I run the proxy as the main destination for a wildcard DNS. This is
our many tenants use URLs in the wildcard domain (lets call it
"*.wild.com") and the proxy connects them to the various backend
services based on the hostname such as:

acme-www.wild.com connects to the WWW server for Acme customer
beta-www.wild.com connects to a similar but different WWW server for
Beta customer.

For each customer there are 5-10 unique hostnames to keep the services
separate. We do this as it is much simpler than URL-rewriting (or at
least it seemed so to me at the beginning).

In addition, our proxy listens on about 8 different ports
(80/443/8080, etc) for different services. The different ports require
7 ACLs that excludes the other ports that are not for that one
service/port combination.

I can get more specific if anyone is interested.

I use make+M4 macros to generate the squid.conf file from a source
file and then separate all the customers into individual configuration
files based on a conf.d directory.

Zero caching is happening, it is all just forwarded traffic.

When I started with ~50 customers, squid cpu was <5% at all times. Now
with closer to 200 customers it sticks around 20%, so I'm just
thinking about the future. And if things keep going well, I can only
expect the number to rise.

Thanks for all the replies! And if anyone is wondering how I counted
lines I used something like this to eliminate comments and blank
lines:

egrep -vc '(^#|^$)' squid.conf

Owen

On Sat, Jun 28, 2014 at 3:50 PM, Kinkie <gkinkie_at_gmail.com> wrote:
> On Fri, Jun 27, 2014 at 9:51 PM, Owen Crow <owen.crow_at_gmail.com> wrote:
>> I am running a non-caching reverse proxy using version 3.3.10.
>>
>> My squid.conf is currently clocking in 60k lines (not including
>> comments or blank lines). Combined with the conf files in my conf.d
>> directory, I have a total of 89k lines in configuration.
>
> Hi Owen,
> I suspect you have embedded in your squid.conf some very long ACL,
> haven't you?
> If so, what type is it, and how many lines?
> As a general advice, you may want to consider moving these ACLs to
> external files and reference them from the config-file.
>
>> I have definitely noticed "-k reconfigure" calls taking on the order
>> of 20 seconds to run when it used to be less than a couple seconds.
>> (Same results with "-k test").
>
> 20 seconds is quite a bit. What has changed in the configuration file
> since then?
>
>> I've tried searching for anything related to max lines and similar,
>> but it usually talks about squid.conf configuration options and not
>> the file itself.
>> If this is not documented per se, are there any anecdotal examples
>> that have this many lines or more? I only see this growing over time.
>
> There is no hard limit to the configuration file that I know of. Are
> you experiencing any performance issues other than during
> reconfiguration?
>
> --
> Kinkie
Received on Sun Jun 29 2014 - 01:57:36 MDT