Differences between revisions 237 and 238
Revision 237 as of 2011-11-27 12:21:40
Size: 4845
Comment:
Revision 238 as of 2011-11-27 12:30:25
Size: 4855
Comment:
Deletions are marked like this. Additions are marked like this.
Line 12: Line 12:
 * NutchTutorial - How to configure Nutch 1.3 to crawl in local mode and post to Apache Solr for search/index.  * NutchTutorial - How to configure Nutch to crawl in local mode and post to Apache Solr for search/index.
Line 15: Line 15:
 * RunNutchInEclipse - How to configure, build, crawl and debug Nutch 1.3 within Eclipse
 * [[IntranetDocumentSearch|Intranet Document Search]] - Index and search Microsoft Office, PDF etc documentsin a file system hierachy with a Solr backend.
 * RunNutchInEclipse - How to configure, build, crawl and debug Nutch within Eclipse
 * [[IntranetDocumentSearch|Intranet Document Search]] - Index and search Microsoft Office, PDF etc. documents in a file system hierarchy with a Solr backend.
Line 19: Line 19:
 * OverviewDeploymentConfigs /!\ :This full page requires a complete update to reflect Nutch 1.3 release: /!\  * OverviewDeploymentConfigs /!\ :This full page requires a complete update to reflect recent Nutch releases: /!\
Line 22: Line 22:
 * NonDefaultIntranetCrawlingOptions - Desirable options to add to your Nutch 1.3 intranet crawling configuration.
 * OptimizingCrawls - How to optimize your crawling/fetching speed with Nutch.
 * ErrorMessages -- What they mean and suggestions for getting rid of them. /!\ :This requires extensive updating to reflect Nutch 1.3. In addition the legacy indexing and searching material should be archived. /!\
 * NonDefaultIntranetCrawlingOptions - Desirable options to add to your Nutch intranet crawling configuration.
 * OptimizingCrawls - How to optimise your crawling/fetching speed with Nutch.
 * ErrorMessages -- What they mean and suggestions for getting rid of them. /!\ :This requires extensive updating to reflect recent Nutch releases. In addition the legacy indexing and searching material should be archived. /!\
Line 30: Line 30:
 * [[Features]] /!\ :TODO:This needs to be completely overhauled to reflect Nutch 1.3 features. /!\  * [[Features]] /!\ :TODO:This needs to be completely overhauled to reflect recent Nutch features. /!\

Welcome to the Apache Nutch Wiki

http://www.interadvertising.co.uk/files/nutch_logo_medium.gif

Please contribute your knowledge about Nutch here!

Nutch Version Administration

Tutorials

  • NutchTutorial - How to configure Nutch to crawl in local mode and post to Apache Solr for search/index.

  • Hadoop Tutorial Nutch being based Hadoop, it helps to have a better understanding of Hadoop.

  • Nutch Hadoop Tutorial - How to setup and run Nutch in deploy mode over a Hadoop cluster. /!\ :This tutorial is in development: /!\

  • RunNutchInEclipse - How to configure, build, crawl and debug Nutch within Eclipse

  • Intranet Document Search - Index and search Microsoft Office, PDF etc. documents in a file system hierarchy with a Solr backend.

Configuration

General Information

Nutch Development

Nutch 2.0

Pre Nutch 1.3 and Archive

How to edit this Wiki

This Wiki is a collaborative site, anyone can contribute and share:

  • Create an account by clicking the "Login" link at the top of any page, and picking a username and password.
  • Edit any page by pressing Edit at the top or the bottom of the page

There are some conventions used on the Nutch wiki:

  • /!\ :TODO: /!\ (/!\ :TODO: /!\ ) is used to denote sections that definitely need to be cleaned up.

Some general info on using this Wiki Software:

FrontPage (last edited 2018-09-27 15:44:39 by RoannelFernandez)