[squid-users] Squid Slow Downloads problem--large files

From: adam.cheng <adam.cheng@dont-contact.us>
Date: Thu, 20 Jul 2006 18:10:23 +0800

Help ! Anyone got ideas ?

Best Regards,
Adam

->-----邮件原件-----
->发件人: adam.cheng [mailto:adam.cheng@chinacache.com]
->发送时间: 2006年7月18日 11:54
->收件人: squid-users@squid-cache.org
->主题: [squid-users] Squid Slow Downloads problem--large files
->
->Hi, squid-user
->
->In my test , Apache is much more faster than squid when there are about
->30Mbps load.
->
->brief result:
->
->-->large file download testing (10M and 40M)
->-->Current load: 15Mbps (squid service)
->-->IOwait: 6%
->-->test result: (same box, same environment)
-> Apache: 60~70Mbytes/s
-> Squid: 700~900Kbytes/s (HIT from squid cache)
->
->Detail information listed below.
->
->--------------------------------------------------------------------------

--
->--------------------
->->Hi, squid-users:
->->
->->I have met a slow download problem of squid , would anybody like to tell
->me what’s
->->the matter with my squid  Or is there any way to resolve this problem ?
->->
->->Squid info:
->->
->->[root@CHN-SH-3-341 ~]# squid -v
->->Squid Cache: Version 2.5.STABLE12
->->configure options:  --prefix=/usr/local/squid --enable-epoll
->--disable-ident-lookups
->->--enable-async-io=160 --enable-storeio=ufs,aufs,diskd --enable-snmp
->->--enable-cache-digests --enable-useragent-log --enable-referer-log
->->--enable-kill-parent-hack --enable--internal-dns
->->----------------------------------------------
->->
->->
->->squid.conf:
->->
->->http_port 80
->->icp_port 0
->->acl httpmp3 url_regex -i ^http://.*\.mp3$
->->no_cache deny httpmp3
->->acl httpwmv url_regex -i ^http://.*\.wmv$
->->no_cache deny httpwmv
->->acl httprm url_regex -i ^http://.*\.rm$
->->no_cache deny httprm
->-> cache_mem 1768 MB
->-> cache_swap_low 70
->-> cache_swap_high 80
->->maximum_object_size 204800 KB
->->minimum_object_size 0 KB
->->maximum_object_size_in_memory 102400 KB
->-> cache_replacement_policy lru
->-> memory_replacement_policy lru
->->cache_dir diskd /data/cache1 28000 16 256
->->cache_dir diskd /data/cache2 28000 16 256
->->logformat squid_custom_log %ts.%03tu %6tr %>a %Ss/%03Hs %<st %rm
->%ru
->->%un %Sh/%<A %mt "%{Referer}>h" "%{User-Agent}>h" "%{Cookie}>h"
->->cache_access_log /data/proclog/log/squid/access.log squid_custom_log
->->cache_log /data/proclog/log/squid/cache.log
->->cache_store_log none
->->pid_filename /var/run/squid.pid
->-> hosts_file /etc/hosts
->-> diskd_program /usr/local/squid/libexec/diskd
->-> unlinkd_program /usr/local/squid/libexec/unlinkd
->->
->->
->->refresh_pattern -i  ^http://player.toodou.com.*    2073600   100%
->2073600
->->ignore-reload
->->refresh_pattern -i  ^http://www.blogcn.com.*    1440   50%  1440
->->refresh_pattern -i  ^http://images.blogcn.com.*    1440   50%  1440
->->refresh_pattern -i  ^http://female.blogcn.com.*    1440   50%  1440
->->refresh_pattern -i  ^http://img.365ren.com.*   720   100%  720
->->refresh_pattern -i  ^http://cfs1.365ren.com.*    720   100%  720
->->refresh_pattern -i  ^http://cafe-img.365ren.com.*    720   100%  720
->->refresh_pattern -i  ^http://cafe-cfs1.365ren.com.*    720   100%  720
->->refresh_pattern -i  ^http    60   0%  60   ignore-reload
->->collapsed_forwarding on
->->refresh_stale_hit 0 minute
->->request_timeout 30 seconds
->-> persistent_request_timeout 3 seconds
->-> pconn_timeout 60 seconds
->->acl all src 0.0.0.0/0.0.0.0
->->acl manager proto cache_object
->->acl localhost src 127.0.0.1/255.255.255.255
->->acl to_localhost dst 127.0.0.0/8
->->acl SSL_ports port 443 563
->->acl Safe_ports port 80          # http
->->acl Safe_ports port 21          # ftp
->->acl Safe_ports port 443 563     # https, snews
->->acl Safe_ports port 70          # gopher
->->acl Safe_ports port 210         # wais
->->acl Safe_ports port 1025-65535  # unregistered ports
->->acl Safe_ports port 280         # http-mgmt
->->acl Safe_ports port 488         # gss-http
->->acl Safe_ports port 591         # filemaker
->->acl Safe_ports port 777         # multiling http
->->acl CONNECT method CONNECT
->->acl monitor src 192.168.1.0/255.255.255.0
->->http_access allow manager
->->http_access allow manager monitor
->->http_access deny manager
->->acl PURGE method PURGE
->->http_access allow PURGE localhost
->->http_access deny purge
->->acl snmppublic snmp_community public
->->snmp_access allow snmppublic localhost
->->http_access deny !Safe_ports
->->http_access deny CONNECT !SSL_ports
->->http_access allow all
->->http_reply_access allow all
->-> cache_mgr squid@chinacache.com
->-> cache_effective_user squid
->-> cache_effective_group squid
->->visible_hostname CHN-SH-3-341
->->httpd_accel_host virtual
->->httpd_accel_port 80
->->httpd_accel_single_host off
->->httpd_accel_with_proxy off
->->httpd_accel_uses_host_header on
->->dns_testnames original1.chinacache.com original2.chinacache.com
->->  logfile_rotate 0
->->
->->cachemgr_passwd test4squid config
->-> store_avg_object_size 20 KB
->->client_db off
->->header_access X-Cache-Lookup deny all
->->snmp_port 3401
->->acl snmppublic snmp_community public
->-> client_persistent_connections off
->-> server_persistent_connections off
->->vary_ignore_expire on
->->strip_query_terms off
->->negative_ttl 0 minute
->->dns_retransmit_interval 10 seconds
->->store_dir_select_algorithm round-robin
->->dns_timeout 2 minute
->->negative_dns_ttl 1 minute
->->connect_timeout 30 seconds
->->read_timeout 15 minutes
->->
->->------------------------------------------------------------------------
--
->-
->->
->->Test information:  (all test was done to the same box, )
->->
->->Squid with 80 port:
->->
->->[root@CHN-SH-3-571 ~]# wget -SO test
->->http://player.toodou.com/flv/001/126/216/1126216.flv
->->--18:56:54--  http://player.toodou.com/flv/001/126/216/1126216.flv
->->           => `test'
->->Resolving player.toodou.com... 192.168.1.131
->->Connecting to player.toodou.com|192.168.1.131|:80... connected.
->->HTTP request sent, awaiting response...
->->  HTTP/1.0 200 OK
->->  Date: Fri, 14 Jul 2006 05:45:42 GMT
->->  Content-Length: 42254194
->->  Content-Type: application/octet-stream
->->  ETag: "-1897917552"
->->  Last-Modified: Wed, 12 Jul 2006 11:34:09 GMT
->->  Server: Microsoft-IIS/6.0
->->  X-Cache: HIT from origin-player.toodou.com
->->  Via: 1.0 CHN-SH-4-912 (NetCache NetApp/5.5R5D8), 1.1 CHN-SH-3-911
->->(NetCache NetApp/6.0.3)
->->  Age: 39548
->->  X-Cache: HIT from CHN-SH-3-341
->->  Connection: close
->->Length: 42,254,194 (40M) [application/octet-stream]
->->
->->100%[============================================
->==
->->=====================>] 42,254,194     1.19M/s    ETA 00:00
->->
->->18:57:09 (2.76 MB/s) - `test' saved [42254194/42254194]
->->
->->
->->Squid with 8081 port:
->->
->->[root@CHN-SH-3-571 ~]# wget -SO test
->->http://player.toodou.com:8081/flv/001/126/216/1126216.flv
->->--19:07:56--  http://player.toodou.com:8081/flv/001/126/216/1126216.flv
->->           => `test'
->->Resolving player.toodou.com... 192.168.1.131
->->Connecting to player.toodou.com|192.168.1.131|:8081... connected.
->->HTTP request sent, awaiting response...
->->  HTTP/1.0 200 OK
->->  Date: Fri, 14 Jul 2006 05:45:42 GMT
->->  Content-Length: 42254194
->->  Content-Type: application/octet-stream
->->  ETag: "-1897917552"
->->  Last-Modified: Wed, 12 Jul 2006 11:34:09 GMT
->->  Server: Microsoft-IIS/6.0
->->  X-Cache: HIT from origin-player.toodou.com
->->  Via: 1.0 CHN-SH-4-912 (NetCache NetApp/5.5R5D8), 1.1 CHN-SH-3-911
->->(NetCache NetApp/6.0.3)
->->  Age: 40210
->->  X-Cache: HIT from CHN-SH-3-341
->->  Connection: close
->->Length: 42,254,194 (40M) [application/octet-stream]
->->
->->100%[============================================
->==
->->=====================>] 42,254,194     1.26M/s    ETA 00:00
->->
->->19:08:10 (2.85 MB/s) - `test' saved [42254194/42254194]
->->
->->
->->Apache with 8080 port:
->->
->->
->->[root@CHN-SH-3-571 ~]# wget -SO test
->->http://player.toodou.com:8080/1126216.flv
->->--19:25:45--  http://player.toodou.com:8080/1126216.flv
->->           => `test'
->->Resolving player.toodou.com... 192.168.1.131
->->Connecting to player.toodou.com|192.168.1.131|:8080... connected.
->->HTTP request sent, awaiting response...
->->  HTTP/1.1 200 OK
->->  Date: Sun, 16 Jul 2006 11:25:45 GMT
->->  Server: Apache/2.0.52 (Red Hat)
->->  Last-Modified: Sun, 16 Jul 2006 10:33:34 GMT
->->  ETag: "2bd0f-284bf72-7212fb80"
->->  Accept-Ranges: bytes
->->  Content-Length: 42254194
->->  Connection: close
->->  Content-Type: text/plain; charset=UTF-8
->->Length: 42,254,194 (40M) [text/plain]
->->
->->100%[============================================
->==
->->=====================>] 42,254,194    57.04M/s
->->
->->19:25:46 (57.01 MB/s) - `test' saved [42254194/42254194]
->->
->->
->->Best Regards,
->->Adam
->->
->->
->->
->->
->->
->->  程冬   Adam Cheng
->->  网络运行维护部/Network Support & Maintenance
->->  Tel: (86-10) 64373399-802
->->  Fax: (86-10) 64374251
->->  Email: adam.cheng@chinacache.com
->->  http://www.chinacache.com
->->=====================================
->-> 北京蓝汛通信技术有限责任公司
->-> 北京市朝阳区酒仙桥中路10号星科大厦A座6层
->-> 邮编:100016
->-> 6th Floor, Tower A, Galaxy Building,
->-> No.10 Jiuxianqiao Zhonglu, Chaoyang District,
->-> Beijing 100016 P.R China
->->=====================================
->->
->->
->->
->
->
->
Received on Thu Jul 20 2006 - 04:10:53 MDT

This archive was generated by hypermail pre-2.1.9 : Tue Aug 01 2006 - 12:00:01 MDT