Re: [squid-users] Squid performance with high load

On 31/03/2013 9:07 a.m., Hasanen AL-Bana wrote:
> The above config for cache_dirs is not working probably.

You are top-posting.
. Why?
.. There is no "above config".

> I can see the aufs dir growing rapidly while the Rock directory has
> been created but it is empty !
>
> -------------------------------------------------------------------------------
> Store Directory Statistics:
> Store Entries : 1166040
> Maximum Swap Size : 1740800000 KB
> Current Store Swap Size: 85456552.00 KB
> Current Capacity : 4.91% used, 95.09% free
>
> Store Directory #0 (rock): /mnt/ssd/cache/
> FS Block Size 1024 Bytes
>
> Maximum Size: 307200000 KB
> Current Size: 760592.00 KB 0.25%
> Maximum entries: 2399999
> Current entries: 5942 0.25%
> Pending operations: 137 out of 0
> Flags:
>
> Store Directory #1 (aufs): /mnt/sas1/cache/store1
> FS Block Size 4096 Bytes
> First level subdirectories: 32
> Second level subdirectories: 512
> Maximum Size: 1433600000 KB
> Current Size: 84695960.00 KB
> Percent Used: 5.91%
> Filemap bits in use: 1159378 of 2097152 (55%)
> Filesystem Space in use: 121538556/-1957361748 KB (-5%)
> Filesystem Inodes in use: 1176103/146243584 (1%)
> Flags:
> Removal policy: lru
> LRU reference age: 0.17 days
>
> On Sat, Mar 30, 2013 at 5:10 PM, Hasanen AL-Bana <hasanen_at_gmail.com> wrote:
>> Thank you Amos for clarifying these issues.
>> I will skip SMP and use single worker since Rock limit my max object
>> size to 32kb when used in shared environments.
>> My new cache_dir configuration looks like this now :
>>
>> cache_dir rock /mnt/ssd/cache/ 300000 max-size=131072
>> cache_dir aufs /mnt/sas1/cache/store1 1400000 32 512

NP: Rock is a 'slot'-based database format and does not support objects
larger than 32KB, unless you are using the experimental large-rock code.
max-size will be capped down to max-size=32767. You should have seen a
warning about that when starting or reconfiguring Squid.

To prevent the AUFS dir filling wil small objects that can best be
served from Rock, you will also need min-size= parameter on the AUFS.
Otherwise Squid will base selection on capacity loading and will
determine that the 1.4TB dir has more free space than the 300GB Rock one.

>> I have enabled store.log to be used with some other software
>> collecting data from it
>>
>> my disks are now mounted with
>> noatime,barrier=0,journal_async_commit,noauto_da_alloc,nobh,data=writeback,commit=10
>>
>> I will keep the list posted with my results.
>> Thanks.

Amos
Received on Sun Mar 31 2013 - 00:20:43 MDT