Welcome to the Apache Nutch Wiki

nutch_logo_medium.gif

Please contribute your knowledge about Nutch here!

If you would like to update any content, would like to add your own content or would like to see something added then please browse the Documentation issues and open a Jira ticket (tagging it with the Documentation label).

What is Apache Nutch?

Apache Nutch is a highly extensible and scalable open source web crawler software project. Stemming from Apache Lucene, the project has diversified and now comprises two codebases, namely:

Being pluggable and modular of course has it's benefits, Nutch provides extensible interfaces such as Parse, Index and ScoringFilter's for custom implementations e.g. Apache Tika for parsing. Additionally, pluggable indexing exists for Apache Solr, Elastic Search, etc.

Nutch can run on a single machine, but gains a lot of its strength from running in a Hadoop cluster

You can download Nutch here.

For more information about Apache Nutch, please see the Nutch wiki.

Nutch is a project of the Apache Software Foundation and is part of the larger Apache community of developers and users.

Nutch Version Administration

Tutorials

Nutch 1.X tutorial(s)

Nutch 2.X tutorial(s)

Other Tutorial(s)

Configuration

General Information

Nutch Development

Nutch 2.x

Pre Nutch 1.3 and Archive

How to edit this Wiki

This Wiki is a collaborative site, anyone can contribute and share:

There are some conventions used on the Nutch wiki:

Some general info on using this Wiki Software:

FrontPage (last edited 2014-11-26 00:48:24 by LewisJohnMcgibbney)