Tool 139: Web spider on command line

Description:

  This tool spiders a HTTP or FTP url. 'Spidering' an url means to
  download the url, read the new urls it contains, download them, and so
  on recursively.
  It stops when all url have been downloaded. So it is not suitable for
  web sites with outgoing web branches (use tool 138 instead).
   

Synonyms:

  curl, wget

Usage:

  netwox 139 -u uri [-r dir]

Parameters:

parameter description example
-u|--url uri url to download http://server/
-r|--rootdir dir local root directory ./spider

Examples:

  netwox 139 -u "http://server/"

  netwox 139 --url "http://server/"