Re: [squid-users] Server Load

From: Luis Daniel Lucio Quiroz <luis.daniel.lucio_at_gmail.com>
Date: Thu, 30 Sep 2010 10:41:13 -0500

Le jeudi 30 septembre 2010 04:27:13, Mr. Issa(*) a écrit :
> Dear All,
> Iam facing a server load of 2.0 almost all the time and a whole of
> 32GB of rams are consumed on the server used for squid production
> My question is Why the 32GB of rams are consumed and why the server is
> LOADING all the time
> The squid is used in transparent mode, and cache_replacement_policy heap
> LFUDA memory_replacement_policy heap GDSF
>
>
> Below are some information might help you in guiding me
>
> Thank you in advance
>
> Cordially,
> Bill
>
>
> Server Specs:
>
> Processor information: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz, 8 cores
> Kernel and CPU: Linux 2.6.26-2-amd64 on x86_64
>
> Memory:
> total used free shared buffers cached
> Mem: 32242 32077 164 0 1647 3805
> -/+ buffers/cache: 26624 5618
> Swap: 1898 949 949
>
> System HD's:
>
> /dev/sdc1 931G 304G 627G 33% /cache1
> /dev/sdd1 931G 304G 628G 33% /cache2
> /dev/sde1 931G 304G 628G 33% /cache3
>
> Used in squid.conf :
> cache_dir aufs /cache1 761856 16 256
> cache_dir aufs /cache2 761856 16 256
> cache_dir aufs /cache3 761856 16 256
>
>
>
> Squid Object Cache: Version 2.7.STABLE9
> Start Time: Sun, 26 Sep 2010 20:20:32 GMT
> Current Time: Thu, 30 Sep 2010 10:22:57 GMT
> Connection information for squid:
> Number of clients accessing cache: 0
> Number of HTTP requests received: 29432081
> Number of ICP messages received: 0
> Number of ICP messages sent: 0
> Number of queued ICP replies: 0
> Request failure ratio: 0.00
> Average HTTP requests per minute since start: 5701.2
> Average ICP messages per minute since start: 0.0
> Select loop called: 344028563 times, 0.900 ms avg
> Cache information for squid:
> Request Hit Ratios: 5min: 46.2%, 60min: 44.7%
> Byte Hit Ratios: 5min: 36.4%, 60min: 33.8%
> Request Memory Hit Ratios: 5min: 30.2%, 60min: 31.0%
> Request Disk Hit Ratios: 5min: 38.1%, 60min: 37.1%
> Storage Swap size: 971763728 KB
> Storage Mem size: 15728492 KB
> Mean Object Size: 23.37 KB
> Requests given to unlinkd: 0
> Median Service Times (seconds) 5 min 60 min:
> HTTP Requests (All): 0.39928 0.39928
> Cache Misses: 0.85130 0.85130
> Cache Hits: 0.00091 0.00000
> Near Hits: 0.44492 0.42149
> Not-Modified Replies: 0.00000 0.00000
> DNS Lookups: 0.31806 0.31806
> ICP Queries: 0.00000 0.00000
> Resource usage for squid:
> UP Time: 309744.817 seconds
> CPU Time: 21262.145 seconds
> CPU Usage: 6.86%
> CPU Usage, 5 minute avg: 7.10%
> CPU Usage, 60 minute avg: 6.98%
> Process Data Segment Size via sbrk(): 1035968 KB
> Maximum Resident Size: 0 KB
> Page faults with physical i/o: 48253
> Memory usage for squid via mallinfo():
> Total space in arena: 275192 KB
> Ordinary blocks: 270230 KB 1410 blks
> Small blocks: 0 KB 0 blks
> Holding blocks: 287664 KB 6 blks
> Free Small blocks: 0 KB
> Free Ordinary blocks: 4961 KB
> Total in use: 557894 KB 99%
> Total free: 4961 KB 1%
> Total size: 562856 KB
> Memory accounted for:
> Total accounted: 23071656 KB
> memPoolAlloc calls: 4165629174
> memPoolFree calls: 3999994225
> File descriptor usage for squid:
> Maximum number of file descriptors: 8192
> Largest file desc currently in use: 4007
> Number of file desc currently in use: 3229
> Files queued for open: 0
> Available number of file descriptors: 4963
> Reserved number of file descriptors: 100
> Store Disk files open: 59
> IO loop method: epoll
> Internal Data Structures:
> 41658744 StoreEntries
> 1667360 StoreEntries with MemObjects
> 1665571 Hot Object Cache Items
> 41574469 on-disk objects
>
> Cache Utilisation:
>
> Last 5 minutes:
> sample_start_time = 1285841897.37157 (Thu, 30 Sep 2010 10:18:17 GMT)
> sample_end_time = 1285842197.40316 (Thu, 30 Sep 2010 10:23:17 GMT)
> client_http.requests = 101.512264/sec
> client_http.hits = 45.562854/sec
> client_http.errors = 0.000000/sec
> client_http.kbytes_in = 96.078988/sec
> client_http.kbytes_out = 1296.996343/sec
> client_http.all_median_svc_time = 0.399283 seconds
> client_http.miss_median_svc_time = 0.851301 seconds
> client_http.nm_median_svc_time = 0.000000 seconds
> client_http.nh_median_svc_time = 0.444919 seconds
> client_http.hit_median_svc_time = 0.000911 seconds
> server.all.requests = 60.796026/sec
> server.all.errors = 0.000000/sec
> server.all.kbytes_in = 855.940987/sec
> server.all.kbytes_out = 77.859180/sec
> server.http.requests = 60.796026/sec
> server.http.errors = 0.000000/sec
> server.http.kbytes_in = 855.944320/sec
> server.http.kbytes_out = 77.859180/sec
> server.ftp.requests = 0.000000/sec
> server.ftp.errors = 0.000000/sec
> server.ftp.kbytes_in = 0.000000/sec
> server.ftp.kbytes_out = 0.000000/sec
> server.other.requests = 0.000000/sec
> server.other.errors = 0.000000/sec
> server.other.kbytes_in = 0.000000/sec
> server.other.kbytes_out = 0.000000/sec
> icp.pkts_sent = 0.000000/sec
> icp.pkts_recv = 0.000000/sec
> icp.queries_sent = 0.000000/sec
> icp.replies_sent = 0.000000/sec
> icp.queries_recv = 0.000000/sec
> icp.replies_recv = 0.000000/sec
> icp.replies_queued = 0.000000/sec
> icp.query_timeouts = 0.000000/sec
> icp.kbytes_sent = 0.000000/sec
> icp.kbytes_recv = 0.000000/sec
> icp.q_kbytes_sent = 0.000000/sec
> icp.r_kbytes_sent = 0.000000/sec
> icp.q_kbytes_recv = 0.000000/sec
> icp.r_kbytes_recv = 0.000000/sec
> icp.query_median_svc_time = 0.000000 seconds
> icp.reply_median_svc_time = 0.000000 seconds
> dns.median_svc_time = 0.318055 seconds
> unlink.requests = 0.000000/sec
> page_faults = 0.159998/sec
> select_loops = 1257.813422/sec
> select_fds = 1336.672592/sec
> average_select_fd_period = 0.000748/fd
> median_select_fds = 0.000000
> swap.outs = 21.003112/sec
> swap.ins = 49.239482/sec
> swap.files_cleaned = 0.000000/sec
> aborted_requests = 2.573306/sec
> syscalls.polls = 1257.813422/sec
> syscalls.disk.opens = 52.222783/sec
> syscalls.disk.closes = 104.378901/sec
> syscalls.disk.reads = 116.352108/sec
> syscalls.disk.writes = 192.267975/sec
> syscalls.disk.seeks = 0.000000/sec
> syscalls.disk.unlinks = 10.159893/sec
> syscalls.sock.accepts = 80.629151/sec
> syscalls.sock.sockets = 27.196380/sec
> syscalls.sock.connects = 27.129714/sec
> syscalls.sock.binds = 27.196380/sec
> syscalls.sock.closes = 67.942618/sec
> syscalls.sock.reads = 604.276970/sec
> syscalls.sock.writes = 673.569574/sec
> syscalls.sock.recvfroms = 9.006572/sec
> syscalls.sock.sendtos = 4.603285/sec
> cpu_time = 22.461403 seconds
> wall_time = 300.003159 seconds
> cpu_usage = 7.487055%
>
> Last 15 minutes:
> sample_start_time = 1285841296.767451 (Thu, 30 Sep 2010 10:08:16 GMT)
> sample_end_time = 1285842197.40316 (Thu, 30 Sep 2010 10:23:17 GMT)
> client_http.requests = 103.752988/sec
> client_http.hits = 47.249008/sec
> client_http.errors = 0.000000/sec
> client_http.kbytes_in = 101.692502/sec
> client_http.kbytes_out = 1282.156827/sec
> client_http.all_median_svc_time = 0.421485 seconds
> client_http.miss_median_svc_time = 0.898576 seconds
> client_http.nm_median_svc_time = 0.000000 seconds
> client_http.nh_median_svc_time = 0.444919 seconds
> client_http.hit_median_svc_time = 0.000000 seconds
> server.all.requests = 61.955661/sec
> server.all.errors = 0.000000/sec
> server.all.kbytes_in = 858.460840/sec
> server.all.kbytes_out = 83.472470/sec
> server.http.requests = 61.955661/sec
> server.http.errors = 0.000000/sec
> server.http.kbytes_in = 858.460840/sec
> server.http.kbytes_out = 83.472470/sec
> server.ftp.requests = 0.000000/sec
> server.ftp.errors = 0.000000/sec
> server.ftp.kbytes_in = 0.000000/sec
> server.ftp.kbytes_out = 0.000000/sec
> server.other.requests = 0.000000/sec
> server.other.errors = 0.000000/sec
> server.other.kbytes_in = 0.000000/sec
> server.other.kbytes_out = 0.000000/sec
> icp.pkts_sent = 0.000000/sec
> icp.pkts_recv = 0.000000/sec
> icp.queries_sent = 0.000000/sec
> icp.replies_sent = 0.000000/sec
> icp.queries_recv = 0.000000/sec
> icp.replies_recv = 0.000000/sec
> icp.replies_queued = 0.000000/sec
> icp.query_timeouts = 0.000000/sec
> icp.kbytes_sent = 0.000000/sec
> icp.kbytes_recv = 0.000000/sec
> icp.q_kbytes_sent = 0.000000/sec
> icp.r_kbytes_sent = 0.000000/sec
> icp.q_kbytes_recv = 0.000000/sec
> icp.r_kbytes_recv = 0.000000/sec
> icp.query_median_svc_time = 0.000000 seconds
> icp.reply_median_svc_time = 0.000000 seconds
> dns.median_svc_time = 0.332523 seconds
> unlink.requests = 0.000000/sec
> page_faults = 0.283247/sec
> select_loops = 1210.495220/sec
> select_fds = 1305.790773/sec
> average_select_fd_period = 0.000766/fd
> median_select_fds = 0.000000
> swap.outs = 22.723111/sec
> swap.ins = 51.594357/sec
> swap.files_cleaned = 0.000000/sec
> aborted_requests = 2.557003/sec
> syscalls.polls = 1210.495220/sec
> syscalls.disk.opens = 55.269910/sec
> syscalls.disk.closes = 110.417634/sec
> syscalls.disk.reads = 123.492559/sec
> syscalls.disk.writes = 208.668957/sec
> syscalls.disk.seeks = 0.000000/sec
> syscalls.disk.unlinks = 10.945570/sec
> syscalls.sock.accepts = 78.552851/sec
> syscalls.sock.sockets = 27.352818/sec
> syscalls.sock.connects = 27.287283/sec
> syscalls.sock.binds = 27.352818/sec
> syscalls.sock.closes = 68.498121/sec
> syscalls.sock.reads = 587.927306/sec
> syscalls.sock.writes = 659.728870/sec
> syscalls.sock.recvfroms = 9.038371/sec
> syscalls.sock.sendtos = 4.636372/sec
> cpu_time = 67.964247 seconds
> wall_time = 900.272865 seconds
> cpu_usage = 7.549294%
Are you Khem?
Received on Thu Sep 30 2010 - 15:41:04 MDT

This archive was generated by hypermail 2.2.0 : Thu Sep 30 2010 - 12:00:04 MDT