Tool 138: Web spider

Description:

  This tool spiders a HTTP or FTP url. 'Spidering' an url means to
  download the url, read the new urls it contains, download them, and so
  on recursively.
  It needs a configuration file created with tool 137.
  It decides which url to download base on rules in configuration file.
   

Synonyms:

  curl, wget

Usage:

  netwox 138 -f file

Parameters:

parameter description example
-f|--conffile file configuration file srcfile.txt

Examples:

  netwox 138 -f "srcfile.txt"

  netwox 138 --conffile "srcfile.txt"