Differences between revisions 56 and 57
Revision 56 as of 2013-08-15 19:35:44
Size: 24186
Comment: Normalize formatting.
Revision 57 as of 2013-08-15 22:44:51
Size: 24299
Comment: Mark report as final.
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
----
/!\ '''FINAL''' /!\

This report has been submitted to the Board. Please do not edit further.
----


/!\ FINAL /!\

This report has been submitted to the Board. Please do not edit further.


Incubator PMC report for Aug 2013

The Apache Incubator is the entry path into the ASF for projects and codebases
wishing to become part of the Foundation's efforts.

By Incubator standards, it's been a quiet month.  At 193 emails for July,
traffic on general@incubator was as light as it's been since May 2011, the
month before the Open Office proposal arrived.

* Community

  There were no changes to the IPMC roster.

* New Podlings

  Two new podlings entered the Incubator:

    Samza
    Sentry

* Graduations

  (None)

* Releases

  The following releases were made since the last Incubator report:

    Jul 24 Apache Ambari 1.2.4-incubating
    Aug 08 Apache Curator 2.2.0-incubating

  It took 3-6 days for the third IPMC vote to arrive.

    Release                             RC VOTE start  Third IMPC +1   Days
    -----------------------------------------------------------------------
    Apache Ambari 1.2.4-incubating      Jul 17         Jun 23          6
    Apache Curator 2.2.0-incubating     Jul 31         Aug 02          3

* Miscellaneous

  o Discussions about a potential Incubator Ombud continued.

  o Discussions about a "welcoming committee" or other ways to facilitate
    orientation of new podlings, spun off from the WhatToExpect wiki page and
    the Ombud discussion, progressed but have not been put into action.


-------------------- Summary of podling reports --------------------

* Still getting started at the Incubator

  o Olingo
  o Samza
  o Spark

* Not yet ready to graduate

  o Blur (no release)
  o Droids (activity)
  o Falcon (community growth)
  o Hadoop Development Tools (no release)
  o Knox (community growth)
  o MetaModel (plan around compatibility breaks from move to Apache)
  o Open Climate Workbench (community growth)
  o Tez (no release)

* Ready to graduate

  o Ambari

* Did not report

  o NPanday
  o Tashi (second missed report)

----------------------------------------------------------------------
                       Table of Contents
Ambari
Blur
Droids
Falcon
Hadoop Development Tools
Knox
MetaModel
NPanday
Olingo
Open Climate Workbench
Samza
Spark
Tashi
Tez

---------------------------------------------------------------------- 

--------------------
Ambari

Ambari is a monitoring, administration and lifecycle management project for
Apache Hadoop clusters.

Ambari has been incubating since 2011-08-30.

  * Release 1.2.2, 1.2.3, 1.2.4 was done.
  * Preparing for 1.2.5 release expected to be in the next week or so.
  * New committers have been added:
    Oleksandr Diachenko,Xi Wang,Oleg Nechiporenko,Dmitry Lysnichenko, Chad
    Roberts, Andrii Tkach
  * New PPMC members added:
    Sumit Mohantly, Srimanth Gunturi, Nate Cole, Tom Beerbower, Siddharth
    Wagle, Jaimin Jetly
  
  * Meetup was held on June 25th at Hadoop Summit with good attendance:
    http://www.meetup.com/Apache-Ambari-User-Group/events/119184782/
  
  * Increased participation from others in the community outside of Hortonworks.

Three most important issues to address in the move towards graduation:

  None. 

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

  None

How has the community developed since the last report?

  Users have been active on the lists and contributions from folks outside
  of Hortonworks has accelerated.  
  
  users@ - 156
  dev@ - 113

How has the project developed since the last report?

  A lot of new features have been added to newer Ambari Releases.

Date of last release: 

  July 2nd, 2013: Ambari 1.2.4-incubating

Signed-off-by: 

  [X](ambari) Owen O'Malley
  [X](ambari) Arun Murthy

Shepherd notes:

  mfranklin: The podling's activity looks great and they are constantly adding
  new committers.  I would like to see more discussion around graduation on
  the dev list.

--------------------
Blur

Blur is a search platform capable of searching massive amounts of data
in a cloud computing environment.

Blur has been incubating since 2012-07-24.

Three most important issues to address in the move towards graduation:

  1. Licensing/Notice files
  2. Release
  3. Release

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

  No.

How has the community developed since the last report?

  We continue to be small but active.
  - Subscriptions: user@ - 38[+3]; dev@ - 46[+8]

How has the project developed since the last report?

  The majority of effort has been around tightening things up for an upcoming
  release.

Date of last release:

  XXXX-XX-XX

Signed-off-by: 

  [X](blur) Doug Cutting
  [x](blur) Patrick Hunt
  [X](blur) Tim Williams

Shepherd notes:

  mfranklin: Podling activity appears to be solid.  It would be good to see
  the community rally around producing a release. 

--------------------
Droids

Droids aims to be an intelligent standalone robot framework that allows to
create and extend existing droids (robots).

Droids has been incubating since 2008-10-09.

Three most important issues to address in the move towards graduation:

  1. Activity

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

None

How has the community developed since the last report?

There has been no change in the community. The summer months have been
very quiet. There are enough active people for a viable PMC.

How has the project developed since the last report?

Quiet quarter.

Date of last release: 

  2012-10-15

Signed-off-by: 

  [ ](droids) Thorsten Scherler
  [x](droids) Richard Frovarp

Shepherd notes:


--------------------
Falcon

Falcon is a data processing and management solution for Hadoop designed for
data motion, coordination of data pipelines, lifecycle management, and data
discovery. Falcon enables end consumers to quickly onboard their data and its
associated processing and management tasks on Hadoop clusters.

Falcon has been incubating since 2013-03-27.

Three most important issues to address in the move towards graduation:

  1. Add new and diverse committers
  2. Build and grow community
  3. Releases at frequent and regular intervals

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of?

  - No

How has the community developed since the last report?

  * More users have joined the falcon users group and mailing lists
  * 1 new contributor has joined the project

How has the project developed since the last report?

  33 new JIRAs were created since the last report and 15 JIRAs have been
  resolved. The first release post incubation is now up for VOTE within the
  dev community of falcon. Post passin g the vote, vote would be called in
  incubator-general for the release.

Signed-off-by:

  [ ](falcon) Arun Murthy
  [x](falcon) Chris Douglas
  [ ](falcon) Owen O'Malley
  [ ](falcon) Devaraj Das
  [ ](falcon) Alan Gates

Shepherd notes:

  (marvin: No shepherd assigned, since the podling reported out of cycle.)

--------------------
Hadoop Development Tools

Eclipse based tools for developing applications on the Hadoop platform

Hadoop Development Tools has been incubating since 2012-11-09.

Three most important issues to address in the move towards graduation:

  1. Release
  2. Support multiple versions of Hadoop in a single IDE instance.
  3. Build Community

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

  - None

How has the community developed since the last report?

  - Srimanth Gunturi contributed Hadoop Eclipse project[HDT-32]
  - Mirko Kaempf & Rahul Sharma added as commiters
  - Few JIRAs have also been filed during this period
  - hdt-dev has seen 105 mails during this period

How has the project developed since the last report?

  - The code has received a big contribution from Srimanth Gunturi which would
    enable interactions with HDFS and Zookeeper.
  - Discussion on the mailing lists while bringing up HDT with hadoop-eclipse
    and work in is progress to add MR side of things on the same.
  - Wizards for Mapper/Reducers higrated to new MR API[HDT-21] Three most
    important issues to address in the move towards graduation:

Date of last release: 

  No releases yet

Signed-off-by: 

  [X](hadoopdevelopmenttools) Suresh Marru
  [X](hadoopdevelopmenttools) Chris Mattmann
  [X](hadoopdevelopmenttools) Roman Shaposhnik

Shepherd notes:



--------------------
Knox

Knox Gateway is a system that provides a single point of secure access for
Apache Hadoop clusters.

Knox has been incubating since 2013-02-22.

Three most important issues to address in the move towards graduation:

  1. Expand community to include more diverse committers.
  2. Align technically with security work going in in Hadoop.
  3. Clear the project name with legal and pick a new name if required.

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware
of?

  1. None

How has the community developed since the last report?

  1. Vote passed to invite a new committer to the project.
  2. Engaging several interested parties in contributing plugins.

How has the project developed since the last report?

  1. Continue to add and improve support for secure Hadoop clusters.
  2. Driving secure cluster fixes of other Hadoop components.
  3. Finalizing adding Knox to Apache Bigtop.
  4. Closing down remaining 8 issues in preparation for an 0.3.0 release.
  5. Resolved 30(+4) of 92(+10) total issues currently in JIRA.

Date of last release:

  0.2.0 04/22/2031

Signed-off-by: 

  [ ](knox) Owen O'Malley
  [X](knox) Chris Douglas
  [X](knox) Alan Gates
  [ ](knox) Mahadev Konar
  [ ](knox) Devaraj Das
  [X](knox) Chris Mattmann
  [ ](knox) Tom White

Shepherd notes:

  acabrera: Nice active podling.  It's already done a release.  I'm not sure why
  they haven't started discussing graduation but I would support such a move.

  There seems to be a few security oriented software named Knox.  There may be
  a naming problem here, unless the product was consistently named Knox
  Gateway and not Knox; just my opinion.

--------------------
MetaModel

MetaModel is a data access framework, providing a common interface for
exploration and querying of different types of datastores.

MetaModel has been incubating since 2013-06-12.

Three most important issues to address in the move towards graduation:

  1. Roadmapping of our first Apache MetaModel release. Since the namespace
     change is going to break backwards compatibility of the project anyway, a
     couple of "old but breaking ideas" needs to be accepted or rejected.
  2. Bring more diverse committers and contributors to the project.
  3. We will probably be having several third party modules for MetaModel,
     because of (L)GPL dependencies. We want to figure out a good way to make
     this understandable for users (through website or similar means).

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

  No

How has the community developed since the last report?

  The pending INFRA work was finished in end-july, and we are starting to take
  it into use.

  We've decided to go for a Review-Then-Commit policy. We will allow lazy
  concensus after 3 days and a minimum of one +1 vote.

  There are currently no concrete plans for a release. We have some
  discussions and proposals of features on the mailing list which we want to
  settle on first.

  Since incubation we have not made any new appointments for either committer
  or PMC member.

How has the project developed since the last report?

  The code has been moved from eobjects.org to Apache's Git server
  (https://git-wip-us.apache.org/repos/asf/incubator-metamodel.git). 5
  bugfixes from the base release 3.4.4 was applied to our codebase as well.

  The namespace of the project has been changed to org.apache.metamodel
  (previously org.eobjects.metamodel). To aid migration, we've also
  implemented a helping facility for deserializing objects of the old
  namespace into the new.

  A performance optimization for the CSV module has been proposed and applied.

  The project now has a website (http://metamodel.incubator.apache.org/). The
  website is meant mostly as an 'appetizer', and we're planning to put
  lengthier pieces of information onto our wiki
  (http://wiki.apache.org/metamodel/), and if needed link to those from the
  website. Some initial content has been put on the wiki as well.

  The project contains a Microsoft Access module, which depends on the LGPL
  licensed Jackcess library. We are looking for a replacement dependency or to
  remove the module from the project.

Date of last release:

  None

Signed-off-by:

  [x](metamodel) Henry Saputra
  [x](metamodel) Arvind Prabhakar
  [x](metamodel) Matt Franklin
  [ ](metamodel) Noah Slater

Shepherd notes:

  The podling is off to a good start (Dave Fisher - wave@)

--------------------
NPanday

NPanday allows projects using the .NET framework to be built with Apache
Maven.

NPanday has been incubating since 2010-08-13.

Three most important issues to address in the move towards graduation:

  1. 
  2. 
  3. 

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?



How has the community developed since the last report?



How has the project developed since the last report?



Date of last release: 

  XXXX-XX-XX

Signed-off-by: 

  [ ](npanday) Dennis Lundberg

Shepherd notes:

  acabrera: Not a lot of activity.  Most of the mail is comes from the Jenkins
  server.  :)  Still, the lone developer seems to be reasonably active.  I
  think it's telling that there is no report filed. 

--------------------
Olingo

Apache Olingo provides libraries which enable developers to implement
OData producers and OData consumers. While starting with an initial
code base implementing OData version 2.0 it is also a clear goal to
start implementing a library for OData 4.0 once the OData standard is
published at OASIS. The focus within the community is currently on the
Java technology but it is up to the community to discuss if other
environments find interest.

Olingo has been incubating since 2013-07-08.

Three most important issues to address in the move towards graduation:

  1. Grow the community
  2. Make a first release

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

  - No

How has the community developed since the last report?

  - All initial committers have signed the ICLA
  - Initial committers are all on board and started using the mailing
    list to coordinate project activities.
  - Committers started actively working on the code base
  - The code base was contributed by SAP AG via Software Grant


How has the project developed since the last report?

  - Infrastructure setup
    -- Git Repository (for OData V2.0)
    -- Issue Tracker (Jira)
    -- Mailing Lists 
  - Check in of OData Library V2.0 as initial code base
  - The code base is prepared and enhanced to be able to
    produce the first release
    -- Package name changes
    -- License Headers added
    -- Code Cleanup + Bugfixes
  - Initial Web Site created with Project Overview,
    Documentation and Support section


Date of last release: 

  - No release so far

Signed-off-by: 

  [X](olingo) Alan Cabrera
  [X](olingo) Dave Fisher
  [X](olingo) Florian Müller

Shepherd notes:

  rgardler: The project is still in the initial setup phase so not much to
  report. Mentors are engaged where they need to be.

--------------------
Open Climate Workbench

Apache Open Climate Workbench (Incubating) is an effort to develop software
that performs climate model evaluation using model outputs from a variety of
different sources (the Earth System Grid Federation, the Coordinated Regional
Downscaling Experiment, the U.S. National Climate Assessment and the North
American Regional Climate Change Assessment Program) and temporal/spatial
scales with remote sensing data from NASA, NOAA and other agencies. The
toolkit includes capabilities for regridding, metrics computation and
visualization. 

Open Climate Workbench has been incubating since 2013-02-15.

Three most important issues to address in the move towards graduation:

  1. Develop an Apache community for Open Climate Workbench and connect to
     other relevant Apache efforts (Tika, Hadoop, SIS, OODT)
  2. Identify a Champion/VP candidate.
  3. Add new contributors to the project.

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of?

  None at this time.

How has the community developed since the last report?

  No new committers or PPMC members added since the last report.

How has the project developed since the last report?

  * Cameron Goodale made the 0.1-incubating release after 5 release candidates
    on July 29, 2013. 
  * Mike Joyce has a VOTE up for the 0.2-incubating release.
  * The UI and backend are now able to fully replicate the climate analysis
    performed by Kim et al., J. Climate 2013.
  * Maziyar Boustani and Mike Joyce both made screencasts demonstrating the UI,
    and linked them on the wiki.
  * A discussion of binding VOTEs by the IPMC on releases occurred, and the PPMC
    worked through the issues and were better informed of Incubator processes.
  * Kyo Lee and Alex Goodman continued to improve the metrics and viz for the toolkit.
  * Shakeh Khudikyan is working on a History page for displaying previous runs.

Date of last release: 29-JUL-2013

Signed-off-by:

  [X](openclimateworkbench) Chris Mattmann
  [X](openclimateworkbench) Suresh Marru
  [X](openclimateworkbench) Chris Douglas
  [ ](openclimateworkbench) Nick Kew

Shepherd notes:

  rvs: Open Climate Workbench looks like a pretty healthy
  community with a strong potential for graduation.

--------------------
Samza

Samza is a stream processing system for running continuous computation on
infinite streams of data.

Samza has been incubating since 2013-07-30.

Three most important issues to address in the move towards graduation:

  1. Getting codebase imported
  2. Generating Apache community
  3. Imparting ASF way to new PMC

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

  None.

How has the community developed since the last report?

  First report. 

How has the project developed since the last report?

  First report. Incubating for one week.  Bootstrapping project.  Have JIRA,
  website and git repo up and running.  Dev discussion moving to list and
  JIRA.

Date of last release: 

  None yet.

Signed-off-by: 

  [X](samza) Chris Douglas
  [X](samza) Roman Shaposhnik
  [ ](samza) Arun Murthy

Shepherd notes:



--------------------
Spark

Spark is an open source system for fast and flexible large-scale data
analysis. Spark provides a general purpose runtime that supports low-latency
execution in several forms.

Spark has been incubating since 2013-06-19.

Three most important issues to address in the move towards graduation:

  1. Finish bringing up Apache infrastructure (the only system missing
     is JIRA, but we also still need to move out website to Apache)
  2. Switch development to work directly against Apache repo
  3. Make a Spark 0.8 release through the Apache process

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

  Nothing major. We've gotten a lot of help setting up infrastructure and the
  last piece missing is importing issues from our old JIRA, which we're
  working with INFRA on (https://issues.apache.org/jira/browse/INFRA-6419).

How has the community developed since the last report?

  We've continued to get and accept a number of external contributions,
  including metrics infrastructure, improved web UI, several optimizations and
  bug fixes.  We held a meetup on machine learning on Spark in San Francisco
  that got around 200 attendees. Finally, we've set up Apache mailing lists
  and warned users of the migration, which will complete at the beginning of
  September.

How has the project developed since the last report?

  We are finishing some bug fixes and merges to do a first Apache release of
  Spark later this month. During this release we'll go through the process of
  checking that the right license headers are in place, NOTICE file is
  present, etc, and we'll complete a website on Apache.

Date of last release: 

  None yet.

Signed-off-by: 

  [X](spark) Chris Mattmann
  [ ](spark) Paul Ramirez
  [ ](spark) Andrew Hart
  [ ](spark) Thomas Dudziak
  [X](spark) Suresh Marru
  [X](spark) Henry Saputra
  [X](spark) Roman Shaposhnik

Shepherd notes:



--------------------
Tashi

An infrastructure for cloud computing on big data.

Tashi has been incubating since 2008-09-04.

Three most important issues to address in the move towards graduation:

  1.
  2.
  3.

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?


How has the community developed since the last report?



How has the project developed since the last report?



Date of last release:

  XXXX-XX-XX

Signed-off-by:

  [ ](tashi) Matthieu Riou
  [ ](tashi) Craig Russell

Shepherd notes:

  rvs: Tashi looks completely dormant at this point. Despite my repeated
  on-list and off-list emails it appears that I couldn't find anybody to
  compile a report. The only discussion that resulted from my attempts is
  captured over here: http://markmail.org/thread/mveeuubf2fcdmgcw

  Personally I think we need to figure out a path to *some* kind of a
  resolution here. I don't think Tashi benefits from being an incubator
  project and we need to figure out how to get it to a different trajectory.

--------------------
Tez

Tez is an effort to develop a generic application framework which can be used
to process arbitrarily complex data-processing tasks and also a re-usable set
of data-processing primitives which can be used by other projects.

Tez has been incubating since 2013-02-24.

Three most important issues to address in the move towards graduation:

  1. Develop collaborations with other Apache projects, including Hadoop, YARN
  2. Make an initial Tez release.
  3. Grow the Apache Tez community.

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

  None at this time.

How has the community developed since the last report?

  No new PPMC members or committers added since the last report. We need to
  work to do a better job of identifying new contributors, but there is great
  activity so I don't think this will be a big issue.

How has the project developed since the last report?

  1. 170 jiras filed and 120 odd jiras resolved since the first week of June
     2013.
  2. The first Tez meetup was held at the Hortonworks office on July 31st and
     had an attendance of around 30+ users/developers from across the Hadoop
     ecosystem community.
  3. Seeing more adoption from the Hive community as well as some initial
     prototyping work being done in Pig.
  4. Looking to make a release in the next couple of months after the release
     of hadoop-2.1.0-beta ( which Tez depends on ).

  We are to looking to increase both the user base as well as get more
  contributors by having more meetups and also expect a release to drive more
  adoption of Tez.

Signed-off-by: 

  [X](tez) Alan Gates
  [X](tez) Arun Murthy
  [X](tez) Chris Douglas
  [X](tez) Jakob Homan
  [X](tez) Chris Mattmann
  [ ](tez) Owen O'Malley

Shepherd notes:

August2013 (last edited 2013-08-15 22:44:51 by MarvinHumphrey)