Re: [squid-users] mime-type based delay pools

2.6.STABLE18, locally compiled, running on FC4 x86_64 (kernel 2.6.11)

On Jan 23, 2008 5:54 AM, Adrian Chadd <adrian@creative.net.au> wrote:
> Which version of squid is this?
>
>
>
> adrian
>
>
> On Tue, Jan 22, 2008, Amitava Bhattacharyya wrote:
> > I am using simple file extension based delay pools. This is what the
> > config looks like:
> >
> > acl big-files url_regex -i .flv .avi .wmv .mpg .mpeg .mpe .divx .mov
> > .qt .mp3 .wav .ram .rm .rar .zip .gz .bz2 .iso .exe .rpm .deb .raw
> > delay_pools 2
> > delay_class 1 3
> > delay_access 1 Allow big-files lan
> > delay_access 1 Deny all
> > delay_parameters 1 524288/524288 -1/-1 16384/4194304
> > delay_class 2 1
> > delay_access 2 Allow lan
> > delay_access 2 Deny big-files
> > delay_access 2 Deny all
> > delay_parameters 2 -1/-1
> >
> > The "downloads" delay pool is rarely, if ever, less than 90% utilized,
> > according to squidclient (the "current" reading). That would mean ~4
> > Mbps + normal browsing bandwidth. But the server in traffic, at the
> > same time, is ~120 kBps. Shouldn't it be much higher?
> >
> > On Jan 21, 2008 12:11 PM, Adrian Chadd <adrian@creative.net.au> wrote:
> > > On Mon, Jan 21, 2008, Amitava Bhattacharyya wrote:
> > > > I followed this discussion: "[squid-users] Re: Re: Cache Streaming
> > > > Video?" (http://www.squid-cache.org/mail-archive/squid-users/200701/0154.html).
> > > > Seems that making the maximum_object_size higher has an effect, so I
> > > > have set it to 50 MB. Calamaris says youtube.com is getting a hit of
> > > > 40%.
> > > > But the problem is not just youtube. People do download 100 MB+ files.
> > > > I want to test whether separating text/* mimetypes from the others and
> > > > putting the other mimetypes on a separate, bandwidth limited stream
> > > > would help.
> > >
> > > I thought squid-3 had some "class 4 delay pool" stuff to make this a possibility
> > > right now.
> > >
> > > You can fake it though, with tcp_outgoing_tos based ACLs. You set the TOS
> > > (or select another IP!) for certain mime types, and then rate limit that
> > > IP address.
> > >
> > > (I've done the latter quite successfully. ;)
> > >
> > >
> > >
> > > Adrian
> > >
> > >
> > > >
> > > > On Jan 20, 2008 9:44 PM, Adrian Chadd <adrian@creative.net.au> wrote:
> > > > > The first thing I'd do before looking at delay pools is to grab
> > > > > a few days of logfiles, pass them through calamaris or something
> > > > > similar and generate some traffic reports.
> > > > >
> > > > > If youtube is a big bandwidth hog then you may benefit from some
> > > > > of my work to make Squid cache youtube.
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > Adrian
> > > > >
> > > > >
> > > > > On Sun, Jan 20, 2008, Amitava Bhattacharyya wrote:
> > > > > > Hi!
> > > > > >
> > > > > > I am a member of the Student Network Club at our institute. We are
> > > > > > facing problems related to slow access speeds, even though the
> > > > > > bandwidth is not so less (12 Mbps for students). We decided to set up
> > > > > > our own proxy server (since getting authorization to access/modify the
> > > > > > institute servers would take quite some time) to monitor utilization.
> > > > > > As part of this exercise, we would also like to implement delay pool
> > > > > > based bandwidth management. Since it is very likely that big downloads
> > > > > > and youtube are eating up the bandwidth, will a mime type based delay
> > > > > > pool work in this case? And how exactly do I set it up?
> > > > > > For example, if i define two delay pools, one based on based on hostel
> > > > > > IPs and the other on mime-types (question: would this be a class 1
> > > > > > delay pool?), and say give limit of 16 kBps / 4 MB for the downloads
> > > > > > stream, how will this be enforced? Will this mean that _every_
> > > > > > download less than 4 MB goes un-delayed, and beyond that it fills up
> > > > > > at 16 kBps?
> > > > > >
> > > > > > --
> > > > > > Best regards,
> > > > > >
> > > > > > Amitava Bhattacharyya
> > > > > > PGP Class of 2008, Indian Institute of Management Bangalore
> > > > > > J-310, Hostel Blocks, IIM Bangalore
> > > > > > Bangalore, Karnataka 560076 INDIA
> > > > > > +919986695721
> > > > >
> > > > > --
> > > > > - Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid Support -
> > > > > - $25/pm entry-level VPSes w/ capped bandwidth charges available in WA -
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Best regards,
> > > >
> > > > Amitava Bhattacharyya
> > > > PGP Class of 2008, Indian Institute of Management Bangalore
> > > > J-310, Hostel Blocks, IIM Bangalore
> > > > Bangalore, Karnataka 560076 INDIA
> > > > +919986695721
> > >
> > > --
> > >
> > > - Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid Support -
> > > - $25/pm entry-level VPSes w/ capped bandwidth charges available in WA -
> > >
> >
> >
> >
> > --
> > Best regards,
> >
> > Amitava Bhattacharyya
> > PGP Class of 2008, Indian Institute of Management Bangalore
> > J-310, Hostel Blocks, IIM Bangalore
> > Bangalore, Karnataka 560076 INDIA
> > +919986695721
>
> --
>
> - Xenion - http://www.xenion.com.au/ - VPS Hosting - Commercial Squid Support -
> - $25/pm entry-level VPSes w/ capped bandwidth charges available in WA -
>

-- 
Best regards,
Amitava Bhattacharyya
PGP Class of 2008, Indian Institute of Management Bangalore
J-310, Hostel Blocks, IIM Bangalore
Bangalore, Karnataka 560076 INDIA
+919986695721