[squid-users] Failed download files larger that 2GB through proxy with ICAP.

Tested with squid3S18 and squid3.1.0.13. The same behavior.

-----Original Message-----
From: Juris Krumins <juris.krumins_at_ctco.lv>
Reply-to: juris.krumins_at_ctco.lv
To: squid-users_at_squid-cache.org
Subject: [squid-users] Failed download files larger that 2GB through
proxy with ICAP.
Date: Tue, 18 Aug 2009 17:03:26 +0300

Experiencing strange problem with squid+icap+clam.
Downloading files, larger than 2GB failed. Turning on squid debugging
figure out following:

2009/08/18 12:17:26.420| comm_calliocallback: 0
2009/08/18 12:17:26.420| comm_calliocallback: 0
2009/08/18 12:17:26.420| commio_call_callback: called for 16
2009/08/18 12:17:26.420| httpReadReply: FD 16: len 2046.
2009/08/18 12:17:26.420| BodyPipe.cc(240) added 2046 bytes
[2147525963<=2147530055<=4658399232 4092+61443 pipe0x9e20390
prod0x9e1bd8c cons0x9df6984]
2009/08/18 12:17:26.420| BodyPipe.cc(256) will call
BodyPipe::tellMoreBodyDataAvailable(0x9e20390)
2009/08/18 12:17:26.420| event.cc(315) schedule: Adding
'BodyPipe::tellMoreBodyDataAvailable', in 0.00 seconds
2009/08/18 12:17:26.420| persistentConnStatus: FD 16 eof=0
2009/08/18 12:17:26.420| persistentConnStatus: content_length=4658399232
2009/08/18 12:17:26.420| persistentConnStatus: flags.headers_parsed=1
2009/08/18 12:17:26.420| persistentConnStatus: clen=4658399232
2009/08/18 12:17:26.420| persistentConnStatus:
body_bytes_read=-2147437241 content_length=4658399232
2009/08/18 12:17:26.420| processReplyBody: INCOMPLETE_MSG
2009/08/18 12:17:26.420| commSetTimeout: FD 16 timeout 900
2009/08/18 12:17:26.420| comm_read, queueing read for FD 16
2009/08/18 12:17:26.420| commio_call_callback: called for 15
2009/08/18 12:17:26.420| ICAP/ICAPXaction.cc(59) 0x9df6928 read returned
0
2009/08/18 12:17:26.420| ICAPModXact::noteCommRead called [FD
15wr;Rrw(5)p(2)S(2)/P icapx6]
2009/08/18 12:17:26.420| ICAP/ICAPXaction.cc:334: exception: commStatus
== COMM_OK
2009/08/18 12:17:26.421| ICAPModXact::noteCommRead caught an exception:
commStatus == COMM_OK [FD 15w;Rrw(5)p(2)S(2)/P icapx6]
2009/08/18 12:17:26.421| ICAPModXact will stop, reason: exception
2009/08/18 12:17:26.421| ICAPModXact::noteCommRead ends job [FD
15w;Rrw(5)p(2)S(2)/P icapx6]
2009/08/18 12:17:26.421| ICAP/ICAPModXact.cc(1062) swan sings [FD
15w;Rrw(5)p(2)S(2)/P icapx6]
2009/08/18 12:17:26.421| ICAP/ICAPModXact.cc(423) will NOT wait for the
last write [FD 15w;Rrw(5)p(2)S(2)/P icapx6]
2009/08/18 12:17:26.421| ICAP/ICAPModXact.cc(434) will no longer write
[FD 15w;Rrw(5)p(2)S(2)/P icapx6]
2009/08/18 12:17:26.421| BodyPipe.cc(231) consumed 4092 bytes
[2147530055<=2147530055<=4658399232 0+65535 pipe0x9e20390 prod0x9e1bd8c
cons0x9df6984]
2009/08/18 12:17:26.421| BodyPipe.cc(233) will call
BodyPipe::tellMoreBodySpaceAvailable(0x9e20390)
2009/08/18 12:17:26.421| event.cc(315) schedule: Adding
'BodyPipe::tellMoreBodySpaceAvailable', in 0.00 seconds
2009/08/18 12:17:26.421| ICAP/ICAPModXact.cc(567) will stop consuming
[FD 15w;Rrp(2)S(2)/wP icapx6]
2009/08/18 12:17:26.421| BodyPipe.cc(20) 0x9df6984 will not consume from
0x9e20390*3
2009/08/18 12:17:26.421| BodyPipe.cc(153) clearing consumer
[2147530055<=2147530055<=4658399232 0+65535 pipe0x9e20390 prod0x9e1bd8c
cons0x9df6984]
2009/08/18 12:17:26.421| BodyPipe.cc(157) will call
BodyPipe::tellBodyConsumerAborted(0x9e20390)
2009/08/18 12:17:26.421| event.cc(315) schedule: Adding
'BodyPipe::tellBodyConsumerAborted', in 0.00 seconds
2009/08/18 12:17:26.421| ICAPModXact will no longer send [FD
15w;rp(2)S(2)/RwP icapx6]
2009/08/18 12:17:26.421| BodyPipe.cc(11) 0x9df6980 will not produce for
0x9e203ec*3; atEof: 0
2009/08/18 12:17:26.421| BodyPipe.cc(89) clearing BodyPipe producer
[2147483647<=2147483647<=? 0+65535 pipe0x9e203ec prod0x9df6980
cons0x9e1bd90]
2009/08/18 12:17:26.421| BodyPipe.cc(268) will call
BodyPipe::tellBodyProducerAborted(0x9e203ec)
2009/08/18 12:17:26.421| event.cc(315) schedule: Adding
'BodyPipe::tellBodyProducerAborted', in 0.00 seconds
2009/08/18 12:17:26.421| cleaning hdr: 0x9d9df98 owner: 3
2009/08/18 12:17:26.421| cleaning hdr: 0x9d9df98 owner: 3
2009/08/18 12:17:26.421| ICAP/ICAPXaction.cc(179) closing pconn [FD
15w;rp(2)/RwPS icapx6]
2009/08/18 12:17:26.421| comm_close: FD 15
2009/08/18 12:17:26.421| commSetTimeout: FD 15 timeout -1

As we ca see I'm having exception, which are handled by
ICAPModXact::noteCommRead method. Seems like this exception caught in
Must(commStatus == COMM_OK); (334: ICAPXaction.cc)

Does anybody have experienced something similar and know how to solve
this ?

Btw I'm using squid with following configuration options:

Squid Cache: Version 3.0.STABLE17
configure options: '--prefix=/opt/squid3S17p1' '--enable-icap-client'
'--enable-large-cache-files' '--enable-storeio=ufs aufs diskd'
'--enable-disk-io=Blocking AIO DiskDaemon DiskThreads' '--enable-snmp'
'--with-large-files' '--with-large-cache-files'
'--with-filedescriptors=16384'

Any ideas/comments would be appreciated.

Thank you.
Received on Wed Aug 19 2009 - 09:30:10 MDT