Re: https web crawler

From: Nick Besant (lists@hwf.cc)
Date: Tue Sep 19 2006 - 10:23:09 EDT


On Sat, September 16, 2006 12:28 am, Leece, Doug wrote:
> Hello,
>
> I have used Sam Spade quite a few times to find little nuggets in the
> html code. Does anyone know of a better tool like that or one that does
> something similar for https sites? Strictly to do foot printing at this
> point not actually faking out form values or anything like that.
>
> Thanks in advance,
>
>
>
> ------------------------------------------------------------------------
> This List Sponsored by: Cenzic
>
> Need to secure your web apps?
> Cenzic Hailstorm finds vulnerabilities fast.
> Click the link to buy it, try it or download Hailstorm for FREE.
> http://www.cenzic.com/products_services/download_hailstorm.php
> ------------------------------------------------------------------------
>
>

HTTrack[1] should work fine. It will spider the site, and you can refresh
your local copy quite easily. Supports SSL, and code is provided for
Linux and Windows.

[1] http://www.httrack.com/

-- 
Nick Besant (lists@hwf.cc)
------------------------------------------------------------------------
This List Sponsored by: Cenzic
Need to secure your web apps?
Cenzic Hailstorm finds vulnerabilities fast.
Click the link to buy it, try it or download Hailstorm for FREE.
http://www.cenzic.com/products_services/download_hailstorm.php
------------------------------------------------------------------------


This archive was generated by hypermail 2.1.7 : Sat Apr 12 2008 - 10:56:58 EDT