Mozdex.com is a project to build a whole internet search engine around Nutch technologies.
Mozdex.com aims to re-establish a 100million page index through the summer of 2005 and reach 1 billion pages by next year.
We have enabled Clustering, Ontology, PDF/WORD/XML and other features of Nutch.
Web Servers (two)
Database Servers (four)
Query Servers (four)
All servers are interconnected on GigE (over copy). We utilize a varient of CFS for global storange across the servers.
Query response is increadibly fast. We will be scripting some performance benchmarks under load and making this information available here in the near future.