You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 12 Next »

Applications and organizations using ZooKeeper include (alphabetically):

  • company w/ link if available
    use

Free Software Projects

  • AdroitLogic UltraESB - Uses ZooKeeper to implement node coordination, in clustering support. This allows the management of the complete cluster, or any specific node - from any other node connected via JMX. A Cluster wide command framework developed on top of the ZooKeeper coordination allows commands that fail on some nodes to be retried etc. We also support the automated graceful round-robin-restart of a complete cluster of nodes using the same framework. More information on how we use ZooKeeper can be found at the clustering concepts and clustered control operations articles.
  • Eclipse Communication Framework - The Eclipse ECF project provides an implementation of its Abstract Discovery services using Zookeeper. ECF itself is used in many projects providing base functionallity for communication, all based on OSGi.
  • Katta - Katta serves distributed Lucene indexes in a grid environment. Zookeeper is used for node, master and index management in the grid.
  • KeptCollections - KeptCollections is a library of drop-in replacements for the data structures in the Java Collections framework. KeptCollections uses Apache ZooKeeper as a backing store, thus making its data structures distributed and scalable.
  • Mesos Mesos is a cluster management platform that provides resource sharing and isolation across distributed applications, or frameworks. For example, Hadoop MapReduce, MPI, Hypertable, and Spark
  • Neo4j - Neo4j is a Graph Database. It's a disk based, ACID compliant transactional storage engine for big graphs and fast graph traversals, using external indicies like Lucene/Solr for global searches.
    We use ZooKeeper in the Neo4j High Availability components for write-master election, read slave coordination and other cool stuff. ZooKeeper is a great and focused project - we like!
  • Norbert Partitioned routing and cluster management.
  • Talend ESB - Talend ESB is a versatile and flexible, enterprise service bus. It uses ZooKeeper as endpoint repository of both REST and SOAP Web services. By using ZooKeeper Talend ESB is able to provide failover and load balancing capabilities in a very light-weight manner. .
Apache Projects
  • Apache BookKeeper (ZooKeeper subproject) distributed logging service
  • Apache CXF DOSGi The Distributed OSGi implementation at Apache CXF uses ZooKeeper for its Discovery functionality. See here for more information: http://cxf.apache.org/dosgi-discovery-demo-page.html
  • planning: Apache Flume Service for efficiently collecting, aggregating, and moving large amounts of log data. The next major version is planned to use ZooKeeper: Jira issue
  • Apache HBase - HBase is the Hadoop database. Its an open-source, distributed, column-oriented store modeled after the Google paper, Bigtable: A Distributed Storage System for Structured Data by Chang et al.
    We use ZooKeeper for master election, server lease management, bootstrapping, and coordination between servers.
  • Apache Hedwig Hedwig is a publish-subscribe system designed to carry large amounts of data across the internet in a guaranteed-delivery fashion from those who produce it (publishers) to those who are interested in it (subscribers).
  • Apache Kafka (incubating) Kafka is a distributed publish/subscribe messaging system
  • Apache S4 (incubating) S4 is a general-purpose, distributed, scalable, partially fault-tolerant, pluggable platform that allows programmers to easily develop applications for processing continuous unbounded streams of data.
  • Apache Solr - In the "Cloud" edition (v1.5) of enterprise search engine Apache Solr, ZooKeeper is used for configuration, leader election and more.

Companies

  • 101tec - we do consulting in the area of enterprise distributed systems.
    We use zookeeper to manage a system build out of hadoop, katta, oracle batch jobs and a web component.
  • Benipal Technologies - ZooKeeper is used for internal application development with Solr and Hadoop with Hbase.
  • Deepdyve - We do search for research and provide access to high quality content using advanced search technologies Zookeeper is used to manage server state, control index deployment and a myriad other tasks.
  • Idium Portal - Idium Portal is a hosted web-publishing system delivered by Norwegian company, Idium AS.
    ZooKeeper is used for cluster messaging, service bootstrapping, and service coordination.
  • Makara
    • Using ZooKeeper on 2-node cluster on VMware workstation, Amazon EC2, Zen
    • Using zkpython
    • Looking into expanding into 100 node cluster
  • Rackspace - The Email & Apps team uses ZooKeeper to coordinate sharding and responsibility changes in a distributed e-mail client that pulls and indexes data for search. ZooKeeper also provides distributed locking for connections to prevent a cluster from overwhelming servers.
  • Yahoo! - ZooKeeper is used for a myriad of services inside Yahoo! for doing leader election, configuration management, sharding, locking, group membership etc.

Others

  • No labels