Re: [squid-users] mime-type based delay pools

From: Adrian Chadd <adrian@dont-contact.us>
Date: Wed, 23 Jan 2008 09:24:48 +0900

Which version of squid is this?

adrian

On Tue, Jan 22, 2008, Amitava Bhattacharyya wrote:
> I am using simple file extension based delay pools. This is what the
> config looks like:
>
> acl big-files url_regex -i .flv .avi .wmv .mpg .mpeg .mpe .divx .mov
> .qt .mp3 .wav .ram .rm .rar .zip .gz .bz2 .iso .exe .rpm .deb .raw
> delay_pools 2
> delay_class 1 3
> delay_access 1 Allow big-files lan
> delay_access 1 Deny all
> delay_parameters 1 524288/524288 -1/-1 16384/4194304
> delay_class 2 1
> delay_access 2 Allow lan
> delay_access 2 Deny big-files
> delay_access 2 Deny all
> delay_parameters 2 -1/-1
>
> The "downloads" delay pool is rarely, if ever, less than 90% utilized,
> according to squidclient (the "current" reading). That would mean ~4
> Mbps + normal browsing bandwidth. But the server in traffic, at the
> same time, is ~120 kBps. Shouldn't it be much higher?
>
> On Jan 21, 2008 12:11 PM, Adrian Chadd <adrian@creative.net.au> wrote:
> > On Mon, Jan 21, 2008, Amitava Bhattacharyya wrote:
> > > I followed this discussion: "[squid-users] Re: Re: Cache Streaming
> > > Video?" (http://www.squid-cache.org/mail-archive/squid-users/200701/0154.html).
> > > Seems that making the maximum_object_size higher has an effect, so I
> > > have set it to 50 MB. Calamaris says youtube.com is getting a hit of
> > > 40%.
> > > But the problem is not just youtube. People do download 100 MB+ files.
> > > I want to test whether separating text/* mimetypes from the others and
> > > putting the other mimetypes on a separate, bandwidth limited stream
> > > would help.
> >
> > I thought squid-3 had some "class 4 delay pool" stuff to make this a possibility
> > right now.
> >
> > You can fake it though, with tcp_outgoing_tos based ACLs. You set the TOS
> > (or select another IP!) for certain mime types, and then rate limit that
> > IP address.
> >
> > (I've done the latter quite successfully. ;)
> >
> >
> >
> > Adrian
> >
> >
> > >
> > > On Jan 20, 2008 9:44 PM, Adrian Chadd <adrian@creative.net.au> wrote:
> > > > The first thing I'd do before looking at delay pools is to grab
> > > > a few days of logfiles, pass them through calamaris or something
> > > > similar and generate some traffic reports.
> > > >
> > > > If youtube is a big bandwidth hog then you may benefit from some
> > > > of my work to make Squid cache youtube.
> > > >
> > > >
> > > >
> > > >
> > > > Adrian
> > > >
> > > >
> > > > On Sun, Jan 20, 2008, Amitava Bhattacharyya wrote:
> > > > > Hi!
> > > > >
> > > > > I am a member of the Student Network Club at our institute. We are
> > > > > facing problems related to slow access speeds, even though the
> > > > > bandwidth is not so less (12 Mbps for students). We decided to set up
> > > > > our own proxy server (since getting authorization to access/modify the
> > > > > institute servers would take quite some time) to monitor utilization.
> > > > > As part of this exercise, we would also like to implement delay pool
> > > > > based bandwidth management. Since it is very likely that big downloads
> > > > > and youtube are eating up the bandwidth, will a mime type based delay
> > > > > pool work in this case? And how exactly do I set it up?
> > > > > For example, if i define two delay pools, one based on based on hostel
> > > > > IPs and the other on mime-types (question: would this be a class 1
> > > > > delay pool?), and say give limit of 16 kBps / 4 MB for the downloads
> > > > > stream, how will this be enforced? Will this mean that _every_
> > > > > download less than 4 MB goes un-delayed, and beyond that it fills up
> > > > > at 16 kBps?
> > > > >
> > > > > --
> > > > > Best regards,
> > > > >
> > > > > Amitava Bhattacharyya
> > > > > PGP Class of 2008, Indian Institute of Management Bangalore
> > > > > J-310, Hostel Blocks, IIM Bangalore
> > > > > Bangalore, Karnataka 560076 INDIA
> > > > > +919986695721
> > > >
> > > > --
> > > > - Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid Support -
> > > > - $25/pm entry-level VPSes w/ capped bandwidth charges available in WA -
> > > >
> > >
> > >
> > >
> > > --
> > > Best regards,
> > >
> > > Amitava Bhattacharyya
> > > PGP Class of 2008, Indian Institute of Management Bangalore
> > > J-310, Hostel Blocks, IIM Bangalore
> > > Bangalore, Karnataka 560076 INDIA
> > > +919986695721
> >
> > --
> >
> > - Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid Support -
> > - $25/pm entry-level VPSes w/ capped bandwidth charges available in WA -
> >
>
>
>
> --
> Best regards,
>
> Amitava Bhattacharyya
> PGP Class of 2008, Indian Institute of Management Bangalore
> J-310, Hostel Blocks, IIM Bangalore
> Bangalore, Karnataka 560076 INDIA
> +919986695721

-- 
- Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid Support -
- $25/pm entry-level VPSes w/ capped bandwidth charges available in WA -
Received on Tue Jan 22 2008 - 17:14:27 MST

This archive was generated by hypermail pre-2.1.9 : Fri Feb 01 2008 - 12:00:05 MST