Re: Introducing myself

Marcello Romani wrote:
> Amos Jeffries ha scritto:
>> Marcello Romani wrote:
>>> Amos Jeffries ha scritto:
>>>> Marcello Romani wrote:
>>>>> Hallo,
>>>>> I have been using squid for about 3 years now for normal web
>>>>> caching and url filtering in our company.
>>>>> I have written a small perl script to be used as a logfile daemon,
>>>>> which stores the access log entries in a mysql database.
>>>>> I'm currently using it in our company and I've also received
>>>>> requests from a few people that were looking for a mysql access log
>>>>> solution for squid.
>>>>>
>>>>> So far the script is working well, but mine is a low traffic
>>>>> scenario (15 clients), so I'd like to see it tested in more
>>>>> demanding environments to find out bugs or performance bottlenecks.
>>>>>
>>>>> Also, some of the views contained in the DDL script accompaining
>>>>> the daemon were written as an excercise, while some other provided
>>>>> useful information for my own requirements. The list of views could
>>>>> be expanded or modified based on other people's requests.
>>>>>
>>>>> The last line on my TODO list is how to deal with database growth.
>>>>> Currently there is no consolidation routine, so the database has to
>>>>> be cleaned by hand.
>>>>>
>>>>> I have some experience in mysql and postgresql, so I'm planning to
>>>>> write a version of the script for postgresql also.
>>>>>
>>>>
>>>> Welcome.
>>>>
>>>> I'm working on the port of LogDaemon into 3.2. I look forward to
>>>> working with you and it as the first LD helper. MySQL is precisely
>>>> one of the tools I'm looking at testing the port with.
>>>>
>>>> Back at the beginning of LogDaemon in 2.7 there was a MySQL helper
>>>> as well. I have not heard much since. Presumably is happily working
>>>> in places, If that was not you we'd best check up and see about
>>>> merging the script concepts rather than adding new one.
>>>
>>> I'll have to look closely but I belive what you are mentioning is not
>>> my script.
>>
>>
>> Turns out it was you on March 2008. I grabbed a copy of your early
>> script and was playing around with it.
>> http://www.mail-archive.com/squid-users@squid-cache.org/msg53342.html
>
> Ouch! You're right.
> The fact is, I've also seen a LD helper written in C somewhere...

The only other MySQL stuff I've seen was Arthur Tumanyan's shaga patch
in 2007, which was for integrated MySQL support before LD came along.
Might be interesting to compare the SQL tables etc, but the code is not
relevant to this.

Adrian wrote the initial access.log output into LD form using the
original C from inside Squid.

I'm not aware of any other LD around yet.

>>>>
>>>> If you are intending and able to stick around and support the script
>>>> I believe mysql logging is one of the helpers we could find great
>>>> use for bundling.
>>>
>>> I have developed the perl script in my spare time, so I might not be
>>> as timely as I should, but I'm willing to support and expand it.
>>> I'm not a C or C++ expert, but if you feel that it's better to have a
>>> LD helper written in C or C++ rather than perl, I might also look
>>> into that.
>>>
>>
>> The only issues we have with coding language are that it must be
>> widely usable/useful, and someone is able to keep up with bug fixes.
>> Perl passes on both.
>>
>> Amos
>
> Ok, perfect.
>
> I have registered the project on sourceforge, but I've not yet commited
> anything there.
> Is it the right way to host the script and its future developements ?
>
> The project is here:
>
> http://sourceforge.net/projects/squid-mysql-log/
>

Up to you. Thats how the squid_kerb_auth did it.
The binary name if we bundle with Squid will end up being
log_mysql_daemon.pl though.

Amos

-- 
Please be using
   Current Stable Squid 2.7.STABLE6 or 3.0.STABLE13
   Current Beta Squid 3.1.0.6