Differences between revisions 2 and 3
Revision 2 as of 2005-04-19 14:38:26
Size: 1102
Editor: ByronMiller
Comment: fix so URI looks better & navigation is cleaner
Revision 3 as of 2009-09-20 23:09:48
Size: 1104
Editor: localhost
Comment: converted to 1.6 markup
Deletions are marked like this. Additions are marked like this.
Line 12: Line 12:
[http://www.mozdex.com mozdex.com search engine] [[http://www.mozdex.com|mozdex.com search engine]]

Mozdex.com

Mozdex.com is a project to build a whole internet search engine around Nutch technologies.

Goals

Mozdex.com aims to re-establish a 100million page index through the summer of 2005 and reach 1 billion pages by next year.

Availability

mozdex.com search engine

Features

We have enabled Clustering, Ontology, PDF/WORD/XML and other features of Nutch.

Hardware

Web Servers (two)

  • Athlon64 3000
  • 1 Gig ram
  • 2x40 gig disk
  • Java 1.4.2
  • Resin Application Server

Database Servers (four)

  • Athlon64 3000
  • 2 Gigs Ram
  • 2x300 Gig Drives
  • Java 1.4.2

Query Servers (four)

  • Athlon64 3000
  • 2 Gigs ram
  • 2x40 gig disks
  • Java 1.4.2

All servers are interconnected on GigE (over copy). We utilize a varient of CFS for global storange across the servers.

Performance

Query response is increadibly fast. We will be scripting some performance benchmarks under load and making this information available here in the near future.

mozDex (last edited 2009-09-20 23:09:48 by localhost)