Re: [squid-users] Problem accessing a site

On 30/11/2012 5:04 p.m., Baird, Josh wrote:
> Top posting here as well (sorry).
>
> These proxies are actually squid 2.6 (RHEL5), sorry about that. So, because it is only 4.5k or so, you don't think the header size is an issue? I'm not sure how to debug this problem any further.

I think the URL length is the main issue. There may be a secondary one
in some particular header, but that is not visible when displaying it
via some header interpreter.

Your 2.6 has a 20KB default header limit. That is for the entire header
set, each line is still up to 64KB - so a request consisting of that
long URL and only a few short headers shodul still get through. However
in my experience long URL are usually accompanied by large Cookies and
other things that bloat the whole request out a lot.
http://www.squid-cache.org/Versions/v2/2.6/cfgman/request_header_max_size.html

You can try increasing that directives limit or an upgrade; 3.1+ should
work with 4-8K URLs fine. But this only resolves it for your Squid, most
other networks Squid will not have been tweaked or upgraded yet and will
generate the same error, as will non-Squid software with their own
usually smaller limits.

Amos

>
> Any suggestions?
>
> Thanks.
>
> -----Original Message-----
> From: Nishant Sharma [mailto:codemarauder_at_gmail.com]
> Sent: Thursday, November 29, 2012 10:32 PM
> To: squid-users_at_squid-cache.org
> Subject: Re: [squid-users] Problem accessing a site
>
> Sorry for top posting, my mobile device is crazy.
>
> I have seen SugarCRM also having these weird long URLs.
>
> But I also faintly remember a compile time option in a header file to increase this limit.
>
> -Nin 11/30/12, Amos Jeffries <squid3_at_treenet.co.nz> wrote:
>> On 30/11/2012 6:06 a.m., jeffrey j donovan wrote:
>>> On Nov 29, 2012, at 11:14 AM, "Baird, Josh" <jbaird_at_follett.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> Our Squid 2.7 proxies are failing on a specific request:
>>>> <snip>
>>>> The request header is:
>>>>
>>>> Key Value
>>>> Request GET
>>>> http://api.copiamobile.com/marketing-api/msQuiz/markFeaturedQuizzes?
>>>> callback=jQuery171017257169384743326_1354106706654&quizzes=%5B%7B%22
>>>> quizId%22%3A1%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22%3A2%2C%2
>>>> 2featured%22%3Afalse%7D%2C%7B%22quizId%22%3A3%2C%22featured%22%3Afal
>>>> se%7D%2C%7B%22quizId%22%3A4%2C%22featured%22%3Afalse%7D%2C%7B%22quiz
>>>> Id%22%3A5%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22%3A6%2C%22fea
>>>> tured%22%3Afalse%7D%2C%7B%22quizId%22%3A7%2C%22featured%22%3Afalse%7
>>>> D%2C%7B%22quizId%22%3A8%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%2
>>>> 2%3A9%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22%3A10%2C%22featur
>>>> ed%22%3Afalse%7D%2C%7B%22quizId%22%3A11%2C%22featured%22%3Afalse%7D%
>>>> 2C%7B%22quizId%22%3A12%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22
>>>> %3A13%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22%3A14%2C%22featur
>>>> ed%22%3Afalse%7D%2C%7B%22quizId%22%3A15%2C%22featured%22%3Afalse%7D%
>>>> 2C%7B%22quizId%22%3A16%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22
>>>> %3A17%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22%3A18%2C%22featur
>>>> ed%22%3Afalse%7D%2C%7B%22quizId%22%3A19%2C%22featured%22%3Afalse%7D%
>>>> 2C%7B%22quizId%22%3A20%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22
>>>> %3A21%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22%3A22%2C%22featur
>>>> ed%22%3Afalse%7D%2C%7B%22quizId%22%3A23%2C%22featured%22%3Afalse%7D%
>>>> 2C%7B%22quizId%22%3A24%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22
>>>> %3A25%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22%3A26%2C%22featur
>>>> ed%22%3Afalse%7D%2C%7B%22quizId%22%3A27%2C%22featured%22%3Afalse%7D%
>>>> 2C%7B%22quizId%22%3A28%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22
>>>> %3A29%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22%3A30%2C%22featur
>>>> ed%22%3Afalse%7D%2C%7B%22quizId%22%3A31%2C%22featured%22%3Afalse%7D%
>>>> 2C%7B%22quizId%22%3A32%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22
>>>> %3A33%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22%3A34%2C%22featur
>>>> ed%22%3Afalse%7D%2C%7B%22quizId%22%3A35%2C%22featured%22%3Afalse%7D%
>>>> 2C%7B%22quizId%22%3A36%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22
>>>> %3A37%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22%3A38%2C%22featur
>>>> ed%22%3Afalse%7D%2C%7B%22quizId%22%3A39%2C%22featured%22%3Afalse%7D%
>>>> 2C%7B%22quizId%22%3A45%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22
>>>> %3A46%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22%3A47%2C%22featur
>>>> ed%22%3Atrue%7D%2C%7B%22quizId%22%3A48%2C%22featured%22%3Afalse%7D%2
>>>> C%7B%22quizId%22%3A49%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22%
>>>> 3A50%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22%3A51%2C%22feature
>>>> d%22%3Afalse%7D%2C%7B%22quizId%22%3A52%2C%22featured%22%3Afalse%7D%2
>>>> C%7B%22quizId%22%3A53%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22%
>>>> 3A54%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22%3A55%2C%22feature
>>>> d%22%3Afalse%7D%2C%7B%22quizId%22%3A56%2C%22featured%22%3Afalse%7D%2
>>>> C%7B%22quizId%22%3A58%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22%
>>>> 3A59%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22%3A60%2C%22feature
>>>> d%22%3Afalse%7D%2C%7B%22quizId%22%3A61%2C%22featured%22%3Afalse%7D%2
>>>> C%7B%22quizId%22%3A62%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22%
>>>> 3A63%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22%3A64%2C%22feature
>>>> d%22%3Afalse%7D%2C%7B%22quizId%22%3A65%2C%22featured%22%3Afalse%7D%2
>>>> C%7B%22quizId%22%3A66%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22%
>>>> 3A67%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22%3A68%2C%22feature
>>>> d%22%3Afalse%7D%2C%7B%22quizId%22%3A69%2C%22featured%22%3Afalse%7D%2
>>>> C%7B%22quizId%22%3A71%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22%
>>>> 3A73%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22%3A74%2C%22feature
>>>> d%22%3Afalse%7D%2C%7B%22quizId%22%3A75%2C%22featured%22%3Afalse%7D%2
>>>> C%7B%22quizId%22%3A77%2C%22featured%22%3Atrue%7D%2C%7B%22quizId%22%3
>>>> A81%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22%3A85%2C%22featured
>>>> %22%3Afalse%7D%2C%7B%22quizId%22%3A87%2C%22featured%22%3Afalse%7D%2C
>>>> %7B%22quizId%22%3A88%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22%3
>>>> A90%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22%3A91%2C%22featured
>>>> %22%3Afalse%7D%2C%7B%22quizId%22%3A92%2C%22featured%22%3Afalse%7D%2C
>>>> %7B%22quizId%22%3A93%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22%3
>>>> A98%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22%3A99%2C%22featured
>>>> %22%3Afalse%7D%2C%7B%22quizId%22%3A100%2C%22featured%22%3Afalse%7D%2
>>>> C%7B%22quizId%22%3A102%2C%22featured%22%3Atrue%7D%2C%7B%22quizId%22%
>>>> 3A103%2C%22featured%22%3Atrue%7D%2C%7B%22quizId%22%3A104%2C%22featur
>>>> ed%22%3Atrue%7D%2C%7B%22quizId%22%3A105%2C%22featured%22%3Atrue%7D%2
>>>> C%7B%22quizId%22%3A106%2C%22featured%22%3Atrue%7D%2C%7B%22quizId%22%
>>>> 3A108%2C%22featured%22%3Afalse%7D%2C%7B%22quizId%22%3A109%2C%22featu
>>>> red%22%3Afalse%7D%2C%7B%22quizId%22%3A110%2C%22featured%22%3Atrue%7D
>>>> %5D&_=1354108049439
>>>> HTTP/1.1
>>> ,<snip>
>>>
>>>
>>> im sorry i have to chime in off topic but thats just crazy url abuse.
>>> is there some programmer on crack writing these things ? remember
>>> when a space in a url was just plain wrong >??
>> Still is.
>>
>>> that url go's to an HTTPS site. there may be something there. I am
>>> able to access it using squid 3.1 transparent and 3.1 proxy.
>> Squid is one of the more acceping softwrae out there. We have a 64KB
>> limit on any one HTTP line and on the total header size. Older Squid
>> are less accepting - note that Squid-2.7 came out when AJAX was just
>> growing up and jQuery was a nasty hack to make JS work.
>>
>> The HTTPbis WG is recommending no more than 4KB in one URL and
>> software supports at least 1KB URLs. These numbers are gained from
>> measurements of what common software in use will accept and/or generate.
>>
>> The above mentioend URL is (beyond looking like someone went crazy) ...
>> 4.5KB large.
>>
>> Amos
>>
>>
> --
> Sent from my mobile device
Received on Fri Nov 30 2012 - 04:27:15 MST