Re: Using Squid to "Strip" a web site - Is it possible?

Dave wrote:
>
> Is there a way to make Squid "strip" a web site of all available files?
> I guess I would be looking for a way to "mirror" a web site, and use that
> "mirror" for off-line browsing.
> I am not worried about disk space or network bandwidth.
>
> If not Squid, is there a shareware/freeware program that I could use to
> access a web site, and pull everything available off of it in an unattended
> fashion?
> Dave
> dburwell@telecom.com
We use wget. If we want to go through squid to precache we just set the
environment variable http_proxy="proxy.com:3128" and invoke wget with
something like wget -m -l0 http://squid.nlanr.net and go have a cup of
coffee.

provecho

ed

P.D. ftp://prep.ai.mit.edu/pub/gnu/wget-1.4.5.tar.gz or something very
close :-)
Received on Wed Jan 14 1998 - 15:47:53 MST