I thik that this is something to do it with many requests, because
half of images are loaded imiedietly (with hits MISS) , and rest are
loaded after few seconds (also MISSED) - missed because i have erased
cache. and is page is cached - it works fine. Only NEW requests are
working slowly
(Read below full problem)
here is more info:
--------------------------
sky-link squid # squidclient -h 192.168.0.1 -p 8123 mgr:info
HTTP/1.0 200 OK
Server: squid/3.0.STABLE20
Mime-Version: 1.0
Date: Tue, 01 Jun 2010 21:47:50 GMT
Content-Type: text/plain
Expires: Tue, 01 Jun 2010 21:47:50 GMT
Last-Modified: Tue, 01 Jun 2010 21:47:50 GMT
X-Cache: MISS from sky-link.net
X-Cache-Lookup: MISS from sky-link.net:8123
Via: 1.0 sky-link.net (squid/3.0.STABLE20)
Proxy-Connection: close
Squid Object Cache: Version 3.0.STABLE20
Start Time: Tue, 01 Jun 2010 21:47:46 GMT
Current Time: Tue, 01 Jun 2010 21:47:50 GMT
Connection information for squid:
Number of clients accessing cache: 1
Number of HTTP requests received: 0
Number of ICP messages received: 0
Number of ICP messages sent: 0
Number of queued ICP replies: 0
Number of HTCP messages received: 0
Number of HTCP messages sent: 0
Request failure ratio: 0.00
Average HTTP requests per minute since start: 0.0
Average ICP messages per minute since start: 0.0
Select loop called: 2945 times, 1.105 ms avg
Cache information for squid:
Hits as % of all requests: 5min: 0.0%, 60min: 0.0%
Hits as % of bytes sent: 5min: -0.0%, 60min: -0.0%
Memory hits as % of hit requests: 5min: 0.0%, 60min: 0.0%
Disk hits as % of hit requests: 5min: 0.0%, 60min: 0.0%
Storage Swap size: 12692 KB
Storage Swap capacity: 0.0% used, 100.0% free
Storage Mem size: 108 KB
Storage Mem capacity: 0.0% used, 100.0% free
Mean Object Size: 6.36 KB
Requests given to unlinkd: 0
Median Service Times (seconds) 5 min 60 min:
HTTP Requests (All): 0.00000 0.00000
Cache Misses: 0.00000 0.00000
Cache Hits: 0.00000 0.00000
Near Hits: 0.00000 0.00000
Not-Modified Replies: 0.00000 0.00000
DNS Lookups: 0.00000 0.00000
ICP Queries: 0.00000 0.00000
Resource usage for squid:
UP Time: 3.255 seconds
CPU Time: 0.040 seconds
CPU Usage: 1.23%
CPU Usage, 5 minute avg: 0.00%
CPU Usage, 60 minute avg: 0.00%
Process Data Segment Size via sbrk(): 4244 KB
Maximum Resident Size: 54512 KB
Page faults with physical i/o: 0
Memory usage for squid via mallinfo():
Total space in arena: 4520 KB
Ordinary blocks: 4514 KB 2 blks
Small blocks: 0 KB 0 blks
Holding blocks: 5916 KB 10 blks
Free Small blocks: 0 KB
Free Ordinary blocks: 5 KB
Total in use: 10430 KB 100%
Total free: 5 KB 0%
Total size: 10436 KB
Memory accounted for:
Total accounted: 1969 KB 19%
memPool accounted: 1969 KB 19%
memPool unaccounted: 8466 KB 81%
memPoolAlloc calls: 9684
memPoolFree calls: 4422
File descriptor usage for squid:
Maximum number of file descriptors: 1024
Largest file desc currently in use: 15
Number of file desc currently in use: 9
Files queued for open: 0
Available number of file descriptors: 1015
Reserved number of file descriptors: 100
Store Disk files open: 0
Internal Data Structures:
2024 StoreEntries
27 StoreEntries with MemObjects
26 Hot Object Cache Items
1997 on-disk objects
---------------------------
2010/6/1 Tytus Rogalewski <tytanick_at_gmail.com>:
> Hi guys, i have problem with slow performance in my squid
> When i enter the page WITHOUT squid, pages are loaded in ~1 sec,
> but when i turn on SQUID - page load in 70% in 1 sec, and then few
> images are loading very slowly
>
> I made flash movie - you can see how this slow connevting VIA squid works
> http://sky-link.net/temp/squid/squid_performance.html (10 MB - i have
> slow connection so you need to wait few mins :)
>
> ----------------------------
> Server Hardware:
> Core2Duo E4600 3.0 Ghz
> 4 GB ramu
> Dysk Szajsung 640GB (w fstabie dopisany noatime 0 0)
>
> Server Soft:
> Linux Gentoo
> squid-3.0.19 or 3.0.20 is the same thing
>
>
> ============================
> Squid, access.log
> You can see in second collumn when did image loaded fully. (1000 = 1 sec)
> Look at 3 last rows, 3 sec,m 6 sec ened even 12 sec ? wtf ?
>
> 1275413778.282 401 192.168.0.2 TCP_MISS/200 20538 GET
> http://allegro.pl/76700_dodatki_i_ozdoby.html? - DIRECT/193.23.48.134
> text/html
> 1275413778.417 41 192.168.0.2 TCP_MISS/200 2845 GET
> http://img16.allegroimg.pl/photos/64x48/10/52/33/52/1052335222 -
> DIRECT/194.0.251.215 image/jpeg
> 1275413778.426 48 192.168.0.2 TCP_MISS/200 1955 GET
> http://img10.allegroimg.pl/photos/64x48/10/47/74/82/1047748223 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.436 53 192.168.0.2 TCP_MISS/200 2124 GET
> http://img14.allegroimg.pl/photos/64x48/10/47/88/44/1047884413 -
> DIRECT/194.0.251.215 image/jpeg
> 1275413778.447 61 192.168.0.2 TCP_MISS/200 2564 GET
> http://img04.allegroimg.pl/photos/64x48/10/60/13/27/1060132706 -
> DIRECT/194.0.251.213 image/jpeg
> 1275413778.461 70 192.168.0.2 TCP_MISS/200 1880 GET
> http://img17.allegroimg.pl/photos/64x48/10/48/29/44/1048294443 -
> DIRECT/194.0.251.215 image/jpeg
> 1275413778.473 82 192.168.0.2 TCP_MISS/200 1811 GET
> http://img17.allegroimg.pl/photos/64x48/10/48/29/45/1048294559 -
> DIRECT/194.0.251.215 image/jpeg
> 1275413778.487 95 192.168.0.2 TCP_MISS/200 1906 GET
> http://img17.allegroimg.pl/photos/64x48/10/48/29/46/1048294688 -
> DIRECT/194.0.251.215 image/jpeg
> 1275413778.503 73 192.168.0.2 TCP_MISS/200 2226 GET
> http://img10.allegroimg.pl/photos/64x48/10/47/74/92/1047749248 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.511 124 192.168.0.2 TCP_MISS/200 2012 GET
> http://img11.allegroimg.pl/photos/64x48/10/48/20/58/1048205827 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.526 137 192.168.0.2 TCP_MISS/200 2475 GET
> http://img11.allegroimg.pl/photos/64x48/10/48/21/13/1048211380 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.541 0 192.168.0.2 TCP_DENIED/403 353 GET
> http://allegro.hit.gemius.pl/_1275413783164/rexdot.gif? - NONE/-
> text/html
> 1275413778.549 41 192.168.0.2 TCP_MISS/200 2422 GET
> http://img10.allegroimg.pl/photos/64x48/10/47/74/92/1047749229 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.600 47 192.168.0.2 TCP_MISS/200 480 GET
> http://www.google-analytics.com/__utm.gif? - DIRECT/209.85.129.101
> image/gif
> 1275413778.615 55 192.168.0.2 TCP_MISS/200 2692 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/11/40/1048114081 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.659 42 192.168.0.2 TCP_MISS/200 2754 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/11/40/1048114095 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.669 289 192.168.0.2 TCP_MISS/200 2488 GET
> http://img10.allegroimg.pl/photos/64x48/10/47/74/92/1047749270 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.678 298 192.168.0.2 TCP_MISS/200 2274 GET
> http://img10.allegroimg.pl/photos/64x48/10/47/74/92/1047749255 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.688 305 192.168.0.2 TCP_MISS/200 2747 GET
> http://img11.allegroimg.pl/photos/64x48/10/52/72/84/1052728463 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.697 318 192.168.0.2 TCP_MISS/200 1962 GET
> http://img10.allegroimg.pl/photos/64x48/10/47/74/82/1047748228 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.711 334 192.168.0.2 TCP_MISS/200 2148 GET
> http://img14.allegroimg.pl/photos/64x48/10/47/74/07/1047740767 -
> DIRECT/194.0.251.215 image/jpeg
> 1275413778.724 62 192.168.0.2 TCP_MISS/200 2298 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/11/41/1048114124 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.736 359 192.168.0.2 TCP_MISS/200 2206 GET
> http://img06.allegroimg.pl/photos/64x48/10/47/47/49/1047474911 -
> DIRECT/194.0.251.213 image/jpeg
> 1275413778.749 79 192.168.0.2 TCP_MISS/200 2562 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/11/41/1048114135 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.762 83 192.168.0.2 TCP_MISS/200 2429 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/12/11/1048121165 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.773 395 192.168.0.2 TCP_MISS/200 2564 GET
> http://img04.allegroimg.pl/photos/64x48/10/59/76/37/1059763730 -
> DIRECT/194.0.251.213 image/jpeg
> 1275413778.785 72 192.168.0.2 TCP_MISS/200 2130 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/25/20/1048252001 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.796 71 192.168.0.2 TCP_MISS/200 2152 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/25/24/1048252448 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.806 55 192.168.0.2 TCP_MISS/200 2470 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/25/49/1048254966 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.819 46 192.168.0.2 TCP_MISS/200 2635 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/30/20/1048302014 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.833 42 192.168.0.2 TCP_MISS/200 2120 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/36/39/1048363990 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413778.843 43 192.168.0.2 TCP_MISS/200 2219 GET
> http://img10.allegroimg.pl/photos/64x48/10/48/36/40/1048364001 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413781.456 3073 192.168.0.2 TCP_MISS/200 2332 GET
> http://img11.allegroimg.pl/photos/64x48/10/52/73/36/1052733644 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413784.420 6042 192.168.0.2 TCP_MISS/200 2431 GET
> http://img10.allegroimg.pl/photos/64x48/10/47/74/82/1047748244 -
> DIRECT/194.0.251.214 image/jpeg
> 1275413790.419 12041 192.168.0.2 TCP_MISS/200 2131 GET
> http://img10.allegroimg.pl/photos/64x48/10/47/74/82/1047748241 -
> DIRECT/194.0.251.214 image/jpeg
>
>
> ===========================
> SQUID SETTINGS
>
> http_port 8123 transparent
> cache_mgr tytan..._at_gmail.com
> visible_hostname sky-link.net
> error_directory /usr/share/squid/errors/Polish_clean
>
> cache_mem 1500 MB # ilosc ramu
> memory_pools on
> memory_pools_limit 100 MB
> cache_swap_low 94
> cache_swap_high 98
> fqdncache_size 51200
> ipcache_size 51200
> ipcache_low 90
> ipcache_high 95
> pipeline_prefetch on
> minimum_object_size 0 KB
> maximum_object_size 50000 KB
> maximum_object_size_in_memory 512 KB
> half_closed_clients on
> shutdown_lifetime 2 seconds
> #ident_timeout 1 seconds
> cache_replacement_policy heap LFUDA
> memory_replacement_policy heap lru
> #cache_dir aufs /mnt/dysk/squid 100000 256 256
> cache_dir aufs /mnt/dysk/squid 20000 32 256
> #quick_abort_min 200 KB
> #quick_abort_max 200 KB
> quick_abort_min 0 KB
> quick_abort_max 0 KB
>
> ### OPCJE ###
> icp_port 0
> htcp_port 0
> icp_access deny all
> htcp_access deny all
> snmp_port 0
> snmp_access deny all
>
> ### LOGI ###
> access_log /var/log/squid/access.log
> cache_log /var/log/squid/cache.log
> cache_store_log /var/log/squid/store.log
> log_fqdn on # pelne nazwy domen w logach
> #debug_options ALL,1
>
> ie_refresh on
> cache_effective_user squid
> cache_effective_group squid
> negative_ttl 1 minutes
> positive_dns_ttl 24 hours
> negative_dns_ttl 1 minutes
>
> ## ACL
> acl manager proto cache_object
> acl localhost src 127.0.0.1/255.255.255.255
> acl sky-link src 192.168.0.0/255.255.255.0 #Nasza LAN
> acl SSL_ports port 443 563
> acl Safe_ports port 21 80 442 563 70 210 280 488 591 777 1025-65535
> acl CONNECT method CONNECT
> #acl MCONN maxconn 300
> # Youtube ACL
> acl youtube_domains
> dstdomain .youtube.com .googlevideo.com .ytimg.com .wrzuta.pl
>
> ### ADL Blokada Reklam ###
> acl allowlist_urlregex url_regex "/etc/squid/acl/
> allowlist_urlregex.acl"
> acl allowlist_dstdomain dstdomain "/etc/squid/acl/
> allowlist_dstdomain.acl"
> acl denylist_urlregex url_regex "/etc/squid/acl/denylist_urlregex.acl"
> acl denylist_dstdomain dstdomain "/etc/squid/acl/
> denylist_dstdomain.acl"
>
> ## HTTP ACCESS
> http_access allow allowlist_dstdomain
> http_access allow allowlist_urlregex
> http_access deny denylist_urlregex
> http_access deny denylist_dstdomain
> http_access allow sky-link
> http_access allow manager localhost
> http_access deny manager
> http_access deny CONNECT !SSL_ports
> http_access deny !Safe_ports
> http_access deny youtube_domains
>
> #tcp_outgoing_address 79.190.121.50
> #zph_tos_local 8
> #zph_tos_peer 0
> #zph_tos_parent off
>
> #vary_ignore_expire on
> #relaxed_header_parser on
> #server_persistent_connections off
>
> request_header_max_size 100 KB
> refresh_pattern -i \.(gif|png|jpg|jpeg|ico|bmp)$ 10080 90% 43200
> refresh-ims
> refresh_pattern -i \.(iso|avi|wav|ogg|mp3|mp4|mpg|mpeg|swf|flv|x-flv)$
> 10080 90% 43200 refresh-ims
> refresh_pattern -i \.(deb|rpm|exe|zip|tar|gz|bz2|tgz|ram|rar|bin|ppt|
> doc|tiff)$ 10080 90% 43200 refresh-ims
> refresh_pattern windowsupdate.com/.*\.(cab|exe|dll) 10080
> 90% 43200 refresh-ims
> refresh_pattern download.microsoft.com/.*\.(cab|exe|dll) 10080
> 90% 43200 refresh-ims
> refresh_pattern au.download.windowsupdate.com/.*\.(cab|exe|dll) 10080
> 90% 43200 refresh-ims
> refresh_pattern symantecliveupdate.com/.*\.(zip|exe) 10080
> 90% 43200 refresh-ims
> refresh_pattern windowsupdate.com/.*\.(cab|exe) 10080
> 90% 43200 refresh-ims
> refresh_pattern download.microsoft.com/.*\.(cab|exe) 10080
> 90% 43200 refresh-ims
> refresh_pattern avast.com/.*\.(vpu|vpaa) 10080
> 90% 43200 refresh-ims
> refresh_pattern . 0
> 90% 43200 refresh-ims
>
>
> --
> Z pozdrowieniami
> Tytus Rogalewski
> mail: tytanick{monkey}gmail.com
> www.sky-link.net
> gg: 210533
> skype: tytanick
>
--
Z pozdrowieniami
Tytus Rogalewski
mail: tytanick{monkey}gmail.com
www.sky-link.net
gg: 210533
skype: tytanick
Received on Tue Jun 01 2010 - 21:51:01 MDT
This archive was generated by hypermail 2.2.0 : Wed Jun 02 2010 - 12:00:03 MDT