Re: [squid-users] looking for testers: google maps/earth/youtubecaching

On Thu, Nov 29, 2007, Gleidson Antonio Henriques wrote:
> Ok ! Problem went away...
> If you are interested, i have one problem here, sometimes squid cached the
> video and served it from cache.
> But in some cases like this. I watch the video but squid doesn?t have luck
> with save it on hard disk.
> I tried to watch the video again but it didn?t served it from cache.
> Could you please check if i?m wrong ?
> Below are my store.log and access.log

Nah, you're not wrong. I did say early on in my posts that Youtube is going
to be difficult.

I'll go and add logging the storeurl to the cache and access logs so we can see
whats going on.

Please grab wireshark or compile in the mime logging to get request/reply headers
so I can see whats going on.

Adrian

>
> Thanks in Advance,
>
> Gleidson Antonio Henriques
>
>
> STORE.LOG ------------->
>
> 1196352807.583 RELEASE -1 FFFFFFFF B8D82E006BB2CA0E4E55AF2619706514 200
> 1196238303 1195004696 1196241903 video/flv 3076601/3076601 GET
> http://74.125.1.34/get_video?video_id=cMN6enesgPA&origin=chi-v238.chi.youtube.com
>
> <----------------------------
>
> ACCESS.LOG ------------->
> 1196352807.583 31065 10.200.1.3 TCP_MISS/200 3076993 GET
> http://74.125.1.34/get_video?video_id=cMN6enesgPA&origin=chi-v238.chi.youtube.com -
> DIRECT/74.125.1.34 video/flv
> <-----------------------------
>
>
> ----- Original Message -----
> From: "Adrian Chadd" <adrian@creative.net.au>
> To: "Gleidson Antonio Henriques" <gleidson@predialnet.com.br>
> Cc: <squid-users@squid-cache.org>
> Sent: Thursday, November 29, 2007 10:17 AM
> Subject: Re: [squid-users] looking for testers: google
> maps/earth/youtubecaching
>
>
> >
> >I've just committed some changes to Squid-2.HEAD which should fix this
> >crash and also the URL mismatch errors in cache.log that Dave was
> >seeing.
> >
> >It'll show up in tomorrow's Squid-2.HEAD snapshot (ie, 20071130.)
> >
> >Please give it a whirl and let me know how it goes.
> >
> >
> >Adrian
> >
> >On Wed, Nov 28, 2007, Gleidson Antonio Henriques wrote:
> >>Ok,
> >>
> >>(gdb) bt
> >>#0 0x004ebd48 in strcmp () from /lib/libc.so.6
> >>#1 0x0806af62 in clientCacheHit (data=0x929a2e0, rep=0x929b2a0) at
> >>client_side.c:2192
> >>#2 0x080657e3 in storeClientCopyHeadersCB (data=0x929a2e0, buf=0x929b3a8
> >>"", size=312) at client_side.c:184
> >>#3 0x080c6dc6 in storeClientCallback (sc=0x929b368, sz=312) at
> >>store_client.c:146
> >>#4 0x080c7e78 in storeClientReadHeader (data=0x929b368, buf=0x929b3a8
> >>"",
> >>len=439) at store_client.c:489
> >>#5 0x080dd393 in storeAufsReadDone (fd=24, my_data=0x92431d0,
> >>buf=0x929c650 "\003\177", len=439, errflag=0) at aufs/store_io_aufs.c:400
> >>#6 0x080dfb3d in aioCheckCallbacks (SD=0x90249f8) at aufs/async_io.c:319
> >>#7 0x080c982e in storeDirCallback () at store_dir.c:511
> >>#8 0x0807618f in comm_select (msec=300) at comm_generic.c:377
> >>#9 0x080a81e5 in main (argc=2, argv=0xbfc0eec4) at main.c:856
> >>(gdb) frame 1
> >>#1 0x0806af62 in clientCacheHit (data=0x929a2e0, rep=0x929b2a0) at
> >>client_side.c:2192
> >>2192 } else if (r->store_url && strcmp(mem->store_url,
> >>r->store_url)
> >>!= 0) {
> >>(gdb) print mem->url
> >>$1 = 0x929b318 "http://www.youtube.com/css/base_all_yts1195074272.css"
> >>(gdb) print mem->store_url
> >>$2 = 0x0
> >>(gdb) r->store_url
> >>Undefined command: "r->store_url". Try "help".
> >>(gdb) r
> >>The program being debugged has been started already.
> >>Start it from the beginning? (y or n) n
> >>Program not restarted.
> >>(gdb) print r->store_url
> >>$3 = 0x929b1c0 "http://www.youtube.com/css/base_all_yts1195074272.css"
> >>
> >>is this ?
> >>
> >>Thanks,
> >>
> >>Gleidson Antonio Henriques
> >>
> >>----- Original Message -----
> >>From: "Adrian Chadd" <adrian@creative.net.au>
> >>To: "Gleidson Antonio Henriques" <gleidson@predialnet.com.br>
> >>Cc: "Adrian Chadd" <adrian@creative.net.au>;
> >><squid-users@squid-cache.org>
> >>Sent: Wednesday, November 28, 2007 5:23 PM
> >>Subject: Re: [squid-users] looking for testers: google
> >>maps/earth/youtubecaching
> >>
> >>
> >>>oh no
> >>>
> >>>frame 1
> >>>print mem->url
> >>>print mem->store_url
> >>>r->store_url
> >>>
> >>>
> >>>
> >>>Adrian
> >>>
> >>>On Wed, Nov 28, 2007, Gleidson Antonio Henriques wrote:
> >>>>Ok,
> >>>>
> >>>>But i didn?t understood what do you mean about print to strcmp...
> >>>>I put below the steps that i had done.
> >>>>
> >>>>------------------------------->
> >>>>(gdb) frame 1
> >>>>#1 0x0806aa6d in clientCacheHit (data=0x96453c8, rep=0x9646388) at
> >>>>client_side.c:2192
> >>>>2192 } else if (r->store_url && strcmp(mem->store_url,
> >>>>r->store_url)
> >>>>!= 0) {
> >>>>(gdb) print strcmp
> >>>>$3 = {<text variable, no debug info>} 0x4ebd40 <strcmp>
> >>>><------------------------------
> >>>>
> >>>>That?s all right for you or i?m wrong about the print command ?
> >>>>
> >>>>Thanks in Advance,
> >>>>
> >>>>Gleidson Antonio Henriques
> >>>>
> >>>>----- Original Message -----
> >>>>From: "Adrian Chadd" <adrian@creative.net.au>
> >>>>To: "Gleidson Antonio Henriques" <gleidson@predialnet.com.br>
> >>>>Cc: "Adrian Chadd" <adrian@creative.net.au>;
> >>>><squid-users@squid-cache.org>
> >>>>Sent: Wednesday, November 28, 2007 3:57 PM
> >>>>Subject: Re: [squid-users] looking for testers: google
> >>>>maps/earth/youtubecaching
> >>>>
> >>>>
> >>>>>Ok cool. Can you go frame 1, and then print the arguments to strcmp?
> >>>>>
> >>>>>Thanks,
> >>>>>
> >>>>>
> >>>>>Adrian
> >>>>>
> >>>>>On Wed, Nov 28, 2007, Gleidson Antonio Henriques wrote:
> >>>>>>Here we go,
> >>>>>>
> >>>>>>------------------------->
> >>>>>>
> >>>>>>(gdb) bt
> >>>>>>#0 0x004ebd48 in strcmp () from /lib/libc.so.6
> >>>>>>#1 0x0806aa6d in clientCacheHit (data=0x8840760, rep=0x8841720) at
> >>>>>>client_side.c:2192
> >>>>>>#2 0x080b3ec8 in storeClientCallback (sc=0x88417e8, sz=312) at
> >>>>>>store_client.c:146
> >>>>>>#3 0x080b482e in storeClientReadHeader (data=0x88417e8,
> >>>>>>buf=0x8841828
> >>>>>>"",
> >>>>>>len=439) at store_client.c:489
> >>>>>>#4 0x080c70f6 in storeAufsReadDone (fd=25, my_data=0x87e8608,
> >>>>>>buf=0x8842ae0 "\003\177", len=439, errflag=0) at
> >>>>>>aufs/store_io_aufs.c:400
> >>>>>>#5 0x080c94a1 in aioCheckCallbacks (SD=0x85ca9f8) at
> >>>>>>aufs/async_io.c:319
> >>>>>>#6 0x080b56bf in storeDirCallback () at store_dir.c:511
> >>>>>>#7 0x0806f357 in comm_select (msec=379) at comm_generic.c:377
> >>>>>>#8 0x0809a618 in main (argc=2, argv=0xbfae3da4) at main.c:856
> >>>>>>
> >>>>>><-----------------------------
> >>>>>>
> >>>>>>Best Regards,
> >>>>>>
> >>>>>>Gleidson Antonio Henriques
> >>>>>>
> >>>>>>----- Original Message -----
> >>>>>>From: "Adrian Chadd" <adrian@creative.net.au>
> >>>>>>To: "Gleidson Antonio Henriques" <gleidson@predialnet.com.br>
> >>>>>>Cc: "Adrian Chadd" <adrian@creative.net.au>;
> >>>>>><squid-users@squid-cache.org>
> >>>>>>Sent: Wednesday, November 28, 2007 3:03 PM
> >>>>>>Subject: Re: [squid-users] looking for testers: google
> >>>>>>maps/earth/youtubecaching
> >>>>>>
> >>>>>>
> >>>>>>>Hm, can you get a stack trace at all?
> >>>>>>>
> >>>>>>>Its not hard in gdb, just put this in ~/.gdbinit
> >>>>>>>
> >>>>>>>handle all nostop noprint
> >>>>>>>handle SIGSEGV stop
> >>>>>>>break xassert
> >>>>>>>break fatal
> >>>>>>>
> >>>>>>>then gdb squid
> >>>>>>>run -ND
> >>>>>>>.. wait.
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>>Adrian
> >>>>>>>
> >>>>>>>On Wed, Nov 28, 2007, Gleidson Antonio Henriques wrote:
> >>>>>>>>Adrian,
> >>>>>>>>
> >>>>>>>> With Latest snapshot SQUID-2.HEAD, i?ve got a Segmentation fault
> >>>>>>>> in
> >>>>>>>>Squid
> >>>>>>>>when try to access youtube.
> >>>>>>>> If i try other URL that isn?t in store_rewrite_list, it worked
> >>>>>>>> well.
> >>>>>>>> Do you need some more information about it ? I tried gdb but squid
> >>>>>>>>running
> >>>>>>>>in threads is so difficult to trace.
> >>>>>>>> I used same ./configure options that had used in
> >>>>>>>> squid-2.HEAD-20071126.
> >>>>>>>>
> >>>>>>>> Best regards,
> >>>>>>>>
> >>>>>>>>Gleidson Antonio Henriques
> >>>>>>>>
> >>>>>>>>----- Original Message -----
> >>>>>>>>From: "Adrian Chadd" <adrian@creative.net.au>
> >>>>>>>>To: "Gleidson Antonio Henriques" <gleidson@predialnet.com.br>
> >>>>>>>>Cc: <squid-users@squid-cache.org>
> >>>>>>>>Sent: Wednesday, November 28, 2007 1:47 PM
> >>>>>>>>Subject: Re: [squid-users] looking for testers: google
> >>>>>>>>maps/earth/youtubecaching
> >>>>>>>>
> >>>>>>>>
> >>>>>>>>>On Wed, Nov 28, 2007, Gleidson Antonio Henriques wrote:
> >>>>>>>>>>Hey Adrian,
> >>>>>>>>>>
> >>>>>>>>>> For me google maps and google earth are working like a charm !
> >>>>>>>>>> So
> >>>>>>>>>> many
> >>>>>>>>>>HITS and SWAPOUTS !
> >>>>>>>>>
> >>>>>>>>>Thats great news! Thats two users who have reported success with
> >>>>>>>>>this work. Fantastic.
> >>>>>>>>>
> >>>>>>>>>Who else is game to give it a go?
> >>>>>>>>>
> >>>>>>>>>> I know that Youtube part is incomplete for now, but for me it
> >>>>>>>>>> works
> >>>>>>>>>>sometimes.
> >>>>>>>>>> Sometimes my squid screen shows this message and when this
> >>>>>>>>>> message
> >>>>>>>>>>occurrs the content
> >>>>>>>>>> is served from youtube source even if a have the video in
> >>>>>>>>>> cache.
> >>>>>>>>>> For
> >>>>>>>>>>your knowledge i put the line below.
> >>>>>>>>>>
> >>>>>>>>>> 2007/11/28 11:18:45| storeClientReadHeader: URL mismatch
> >>>>>>>>>>2007/11/28 11:18:45|
> >>>>>>>>>>{http://74.125.1.37/get_video?video_id=ZQkHAytCmFY&origin=dal-v26.dal.youtube.com}
> >>>>>>>>>>!=
> >>>>>>>>>>{http://74.125.1.101/get_video?video_id=ZQkHAytCmFY&origin=dal-v26.dal.youtube.com}
> >>>>>>>>>
> >>>>>>>>>Try upgrading to the latest Squid-2.HEAD snapshot; I think I've
> >>>>>>>>>fixed
> >>>>>>>>>this.
> >>>>>>>>>Let me know if not and I'll take another look at it.
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>
> >>>>>>>>>Adrian
> >>>>>>>>>
> >>>>>>>>>--
> >>>>>>>>>- Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial
> >>>>>>>>>Squid
> >>>>>>>>>Support -
> >>>>>>>
> >>>>>>>--
> >>>>>>>- Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial
> >>>>>>>Squid
> >>>>>>>Support -
> >>>>>>>- $25/pm entry-level VPSes w/ capped bandwidth charges available in
> >>>>>>>WA -
> >>>>>
> >>>>>--
> >>>>>- Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid
> >>>>>Support -
> >>>>>- $25/pm entry-level VPSes w/ capped bandwidth charges available in
> >>>>>WA -
> >>>
> >>>--
> >>>- Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid
> >>>Support -
> >>>- $25/pm entry-level VPSes w/ capped bandwidth charges available in WA -
> >
> >--
> >- Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid
> >Support -
> >- $25/pm entry-level VPSes w/ capped bandwidth charges available in WA -

-- 
- Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid Support -
- $25/pm entry-level VPSes w/ capped bandwidth charges available in WA -