The bin/crawl script gives more command during a crawl. Instead of using org.apache.nutch.crawl.Crawl class, it uses individual steps (inject->generate->fetch->parse->updatedb) during a crawl. It is recommended to use this instead of using the bin/nutch crawl command.

Please message us in the user-mailing list if you find any issues

bin/crawl (last edited 2013-03-20 18:31:40 by kiranchitturi)