Re: Introducing myself

Amos Jeffries ha scritto:
> Marcello Romani wrote:
>> Amos Jeffries ha scritto:
>>> Marcello Romani wrote:
>>>> Amos Jeffries ha scritto:
>>>>> Marcello Romani wrote:
>>>>>> Hallo,
>>>>>> I have been using squid for about 3 years now for normal web
>>>>>> caching and url filtering in our company.
>>>>>> I have written a small perl script to be used as a logfile daemon,
>>>>>> which stores the access log entries in a mysql database.
>>>>>> I'm currently using it in our company and I've also received
>>>>>> requests from a few people that were looking for a mysql access
>>>>>> log solution for squid.
>>>>>>
>>>>>> So far the script is working well, but mine is a low traffic
>>>>>> scenario (15 clients), so I'd like to see it tested in more
>>>>>> demanding environments to find out bugs or performance bottlenecks.
>>>>>>
>>>>>> Also, some of the views contained in the DDL script accompaining
>>>>>> the daemon were written as an excercise, while some other provided
>>>>>> useful information for my own requirements. The list of views
>>>>>> could be expanded or modified based on other people's requests.
>>>>>>
>>>>>> The last line on my TODO list is how to deal with database growth.
>>>>>> Currently there is no consolidation routine, so the database has
>>>>>> to be cleaned by hand.
>>>>>>
>>>>>> I have some experience in mysql and postgresql, so I'm planning to
>>>>>> write a version of the script for postgresql also.
>>>>>>
>>>>>
>>>>> Welcome.
>>>>>
>>>>> I'm working on the port of LogDaemon into 3.2. I look forward to
>>>>> working with you and it as the first LD helper. MySQL is precisely
>>>>> one of the tools I'm looking at testing the port with.
>>>>>
>>>>> Back at the beginning of LogDaemon in 2.7 there was a MySQL helper
>>>>> as well. I have not heard much since. Presumably is happily working
>>>>> in places, If that was not you we'd best check up and see about
>>>>> merging the script concepts rather than adding new one.
>>>>
>>>> I'll have to look closely but I belive what you are mentioning is
>>>> not my script.
>>>
>>>
>>> Turns out it was you on March 2008. I grabbed a copy of your early
>>> script and was playing around with it.
>>> http://www.mail-archive.com/squid-users@squid-cache.org/msg53342.html
>>
>> Ouch! You're right.
>> The fact is, I've also seen a LD helper written in C somewhere...
>
> The only other MySQL stuff I've seen was Arthur Tumanyan's shaga patch
> in 2007, which was for integrated MySQL support before LD came along.
> Might be interesting to compare the SQL tables etc, but the code is not
> relevant to this.
>
> Adrian wrote the initial access.log output into LD form using the
> original C from inside Squid.
>
> I'm not aware of any other LD around yet.
>
>>>>>
>>>>> If you are intending and able to stick around and support the
>>>>> script I believe mysql logging is one of the helpers we could find
>>>>> great use for bundling.
>>>>
>>>> I have developed the perl script in my spare time, so I might not be
>>>> as timely as I should, but I'm willing to support and expand it.
>>>> I'm not a C or C++ expert, but if you feel that it's better to have
>>>> a LD helper written in C or C++ rather than perl, I might also look
>>>> into that.
>>>>
>>>
>>> The only issues we have with coding language are that it must be
>>> widely usable/useful, and someone is able to keep up with bug fixes.
>>> Perl passes on both.
>>>
>>> Amos
>>
>> Ok, perfect.
>>
>> I have registered the project on sourceforge, but I've not yet
>> commited anything there.
>> Is it the right way to host the script and its future developements ?
>>
>> The project is here:
>>
>> http://sourceforge.net/projects/squid-mysql-log/
>>
>
> Up to you. Thats how the squid_kerb_auth did it.
> The binary name if we bundle with Squid will end up being
> log_mysql_daemon.pl though.
>
> Amos

I have registered a new project on sourceforce based on the name you
suggested.

http://sourceforge.net/projects/logmysqldaemon/

I also have submitted some code through svn. Please browse trunk/
starting at:

http://logmysqldaemon.svn.sourceforge.net/viewvc/logmysqldaemon/

-- 
Marcello Romani