Incubator PMC report for October 2014

The Apache Incubator is the entry path into the ASF for projects and codebases
wishing to become part of the Foundation's efforts.

There are 32 podlings under incubation this month. No projects are
currently voting on graduation. The incubator added Ignite as a new
incubating project. DeviceMap, Drill, Falcon, Flink, Johnzon, Usergrid
all had releases since the last report. DeviceMap is ready to graduate.

* Community

  New IPMC members:

   No additions

  People who left the IPMC:

    (none)


* New Podlings

  Ignite

* Graduations

  The board has motions for the following:

    (none)

* Releases

  The following releases were made since the last Incubator report:

  Apache DeviceMap Data 1.0.1 incubating
  Apache Drill 0.5.0-incubating
  Apache Falcon 0.5-incubating
  Apache Flink 0.6.1-incubating
  Apache Johnzon 0.1-incubating
  Apache Usergrid 1.0


* IP Clearance

    FlatSpark for Apache Flex

* Legal / Trademarks

    None

* Infrastructure

    Nothing to report

* Miscellaneous

  Apache Optiq becomes Apache Calcite

-------------------- Summary of podling reports --------------------

* Still getting started at the Incubator

   REEF

* Not yet ready to graduate

  No release:

    Argus
    DataFu
    Parquet
    Streams

  Community growth:

    Aurora
    MetaModel
    Optiq
    Samza
    Usergrid

* Ready to graduate

    DeviceMap

* Did not report, expected next month

  ODF Toolkit
  Ripple

----------------------------------------------------------------------
                       Table of Contents
Argus
Aurora
DataFu
DeviceMap
MetaModel
ODF Toolkit
Optiq
Parquet
REEF
Ripple
Samza
Streams
Usergrid

----------------------------------------------------------------------

--------------------
Argus

The Argus project is a framework to enable, monitor and manage comprehensive
data security across the Hadoop platform.

Argus has been incubating since 2014-07-24.

Three most important issues to address in the move towards graduation:

  * Get approval for name of Argus (PODLINGNAMESEARCH-54)
       * Requested a name change to “Apache Ranger”
  * Make a release
  * Add new committers

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

  *  None

How has the community developed since the last report?

  * Added few more contributors

How has the project developed since the last report?

  * Create a project website
  * Working towards first incubator release (version 0.4.0)
  * 54 jiras resolved this month

Date of last release:

  none yet

When were the last committers or PMC members elected?

  none yet

Signed-off-by:

  [X](argus) Alan Gates
  [ ](argus) Daniel Gruno
  [ ](argus) Devaraj Das
  [ ](argus) Jakob Homan
  [ ](argus) Owen O'Malley

--------------------
Aurora

Aurora is a service scheduler used to schedule jobs onto Apache Mesos.

Aurora has been incubating since 2013-10-01.

Three most important issues to address in the move towards graduation:

  1. Second release, progress being tracked in ticket AURORA-711
  2. Establish a consistent development process and release rhythm.
  3. Expanding the community and continuing to add new committers.

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

  - None at this time.

How has the community developed since the last report?

  Latest Additions:

  * PMC addition:           David McLaughlin, 2014-08-20
  * Contributor addition:   David McLaughlin, 2014-08-20

  Issue backlog status since last report:

  * Created:   176
  * Resolved:  151

  Mailing list activity since last report:

  * @dev      340 messages
  * @issues   774 messages
  * @reviews  1402 messages

How has the project developed since the last report?

  - IRC weekly meetings, digests sent to dev@ list
  - Automated release workflows
  - Fixing issues brought up in our first release

Date of last release:

  - Apache Aurora 0.5.0 (incubating) - 2014-08-01


Signed-off-by:

  [X](aurora) Jake Farrell
  [ ](aurora) Benjamin Hindman
  [ ](aurora) Chris Mattmann
  [X](aurora) Henry Saputra

--------------------
DataFu

DataFu provides a collection of Hadoop MapReduce jobs and functions in higher
level languages based on it to perform data analysis. It provides functions
for common statistics tasks (e.g. quantiles, sampling), PageRank, stream
sessionization, and set and bag operations. DataFu also provides Hadoop jobs
for incremental data processing in MapReduce.

DataFu has been incubating since 2014-01-05.

Three most important issues to address in the move towards graduation:

  1. Building an ASF-based community.
  2. Release.
  3. Adding support for Hadoop 2.x

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

  None.

How has the community developed since the last report?

  Three new users have contributed code since the last report.

How has the project developed since the last report?

  A couple more UDFs have been committed.  One bug fix was committed.  All JARs have been removed from the repo (a blocker for source release).
  A build task has been added for creating a source release.  No open blockers for release left at this point.
  Several more UDFs have been contributed but are still under review.

Date of last release:

  No release yet.

When were the last committers or PMC members elected?

  2014-02-22

Signed-off-by:

  [ ](datafu) Ashutosh Chauhan
  [X](datafu) Roman Shaposhnik
  [ ](datafu) Ted Dunning

Shepherd/Mentor notes:

(jmclean): Did not report on time. Low level mentor activity but no obvious issues other than missing release. (Release mentioned in last report and DATAFU-53 blocking release has been resolved).


--------------------
DeviceMap

Apache DeviceMap is a data repository containing device information, images
and other relevant information for all sorts of mobile devices, e.g.
smartphones and tablets. While the focus is initially on that data, APIs will
also be created to use and manage it.

DeviceMap has been incubating since 2012-01-03.

The mentors feel DeviceMap is ready to graduate, the new PMC's roster has been discussed and
the graduation resolution is being prepared.

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

None

How has the community developed since the last report?

No change. The DeviceMap community will probably remain small, graduating with 5 initial PMC members.

How has the project developed since the last report?

The project has started its incremental device data release with its recent 1.0.1 release.
The project also is planning to release its new 1.1 clients (Java and .NET). Long term plans
have been made to overhaul the device data in the 2.0 release.

Date of last release:

  2014-09-29

When were the last committers or PMC members elected?

May 17th, 2013

Signed-off-by:

  [X](devicemap) Bertrand Delacretaz
  [X](devicemap) Kevan Miller
  [ ](devicemap) Andrew Savory

--------------------
MetaModel

MetaModel is a data access framework, providing a common interface for
exploration and querying of different types of datastores.

MetaModel has been incubating since 2013-06-12.

Three most important issues to address in the move towards graduation:

  1. More contributors and committers to increase diversity of the community
  2. More releases under ASF
  3. Connect with other projects from Apache's ecosystem such as Apache Gora, Apache Flink

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be aware of?

  None

How has the community developed since the last report?

  A few new people have started to work actively on the mailing list
  and contributing patches and new features.

  One of the new contributors, Alberto Rodriguez, had added new module to
  connect to ElasticSearch.

  Updated ASF incubator page to reflect current state.

  Updated MetaModel website to contain link on how to contribute.

How has the project developed since the last report?

  Apache MetaModel 4.2.0-incubating was released on July 28, 2014.

  We are near of proposing to have new committer.

  Mailing list activity since last report:

    @dev via http://mail-archives.apache.org/mod_mbox/incubator-metamodel-dev/
      September 137 messages
      August 28 messages
      July 109 messages

      51 members

    @commits via http://mail-archives.apache.org/mod_mbox/incubator-metamodel-commits
      September 26 messages
      August 2014Thread 3 messages
      July 2014Thread 47 messages

Date of last release:

  July 28, 2014

When were the last committers or PMC members elected?

  June 30, 2014


Signed-off-by:

  [X](metamodel) Henry Saputra
  [X](metamodel) Arvind Prabhakar
  [ ](metamodel) Matt Franklin
  [X](metamodel) Noah Slater

--------------------
Optiq (currently renaming to Calcite)

Optiq/Calcite is a highly customizable engine for parsing and planning queries
on data in a wide variety of formats. It allows database-like access, and in
particular a SQL interface and advanced query optimization, for data not
residing in a traditional database.

Optiq/Calcite has been incubating since 2014-05-19.

Three most important issues to address in the move towards graduation:

  1. Complete renaming to Calcite.

  2. Re-organize code into org.apache.calcite namespace

  3. Create a product worthy of a "1.0" label.

  4. Improve web site

  5. Build an ASF community

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

  None.

How has the community developed since the last report?

  We held our first meetup, a hackathon hosted by MapR. It was well-attended,
  and we attracted a number of new contributors at various skill levels,
  who produced a number of contributions that have since been committed.

  Julian Hyde spoke to over 200 attendees at the Seattle Scalability meetup
  on how Apache Hive uses Apache Optiq to do its cost-based optimization.

  In September, there were 72 messages on dev@, 38 commits, 36 issues created,
  30 issues resolved.

How has the project developed since the last report?

  We completed https://issues.apache.org/jira/browse/PODLINGNAMESEARCH-51
  and concluded that Optiq was not a viable name.
  We agreed (via PPMC vote and consensus on dev) that Calcite was suitable new
  name, and logged https://issues.apache.org/jira/browse/PODLINGNAMESEARCH-56,
  which has been approved by legal. Now we are part way through renaming;
  see https://issues.apache.org/jira/browse/INFRA-8413

  We expect to have a release candidate for apache-calcite-0.9.1-incubating
  to go to a PPMC vote this week.

Date of last release:

  2014-08-25

When were the last committers or PMC members elected?

  2014-07-15

Signed-off-by:

  [ ](optiq) Ted Dunning
  [X](optiq) Alan Gates
  [X](optiq) Steven Noels

--------------------
Parquet

Parquet is a columnar storage format for Hadoop.

Parquet has been incubating since 2014-05-20 .

Three most important issues

  - Expanding the community and adding new committers
  - 1st releases
  - Identifying how to ensure timely code reviews by committers

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

  - None at this time

Latest Additions:

  * PMC addition:          N/A
  * Contributor addition:  N/A

Issue backlog status since last report:

  * Created:   27
  * Resolved:  19

Mailing list activity since last report:

  * dev      144 messages

How has the project developed since the last report?

  - Attempted parquet-format release twice, next RC in early October.
  - Assembled tasks to complete for a parquet-mr release
  - New push-down filter API and task-side block metadata reading

Date of last release:

  - No releases as of yet.

Signed-off-by:

  [ ](parquet) Todd Lipcon
  [X](parquet) Jake Farrell
  [ ](parquet) Chris Mattmann
  [X](parquet) Roman Shaposhnik
  [X](parquet) Tom White


--------------------
REEF

REEF (Retainable Evaluator Execution Framework) is a scale-out computing
fabric that eases the development of Big Data applications on top of resource
managers such as Apache YARN and Mesos.

REEF has been incubating since 2014-08-12.

Three most important issues to address in the move towards graduation:

  1. Get the code transferred from a Microsoft-owned GitHub account to Apache infra.
  2. Line up the Microsoft internal process and approvals for (2)
  3. Update the existing project web site and figure out how to transfer it to the ASF infrastructure.

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?



How has the community developed since the last report?

  * All committers have setup @apache.org aliases and JIRA accounts.
  * Replaced the Google Groups based mailing list with an ASF hosted list for all dev communications


How has the project developed since the last report?

  * Issue tracking is beginning to move from GitHub to JIRA.
  * The name `Apache REEF` has been approved (PODLINGNAMESEARCH-55)
  * Microsoft-Internal approval for the code transfer and donation are there


Date of last release:

  None yet.

When were the last committers or PMC members elected?

  None Yet

Signed-off-by:

  [X](reef) Chris Douglas
  [ ](reef) Chris Mattmann
  [ ](reef) Ross Gardler
  [ ](reef) Owen O'Malley

--------------------
Samza

Samza is a stream processing system for running continuous computation on
infinite streams of data.

Samza has been incubating since 2013-07-30.

Three most important issues to address in the move towards graduation:

  1. Finish outstanding 0.8 bugs, so we can do our second incubator release.
  2.
  3.

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

No.

How has the community developed since the last report?

Very well. Numerous presentations at conferences. Several instances of meetups/presentations by people outside the committer community. Mailing list traffic has been slow but steady.

How has the project developed since the last report?

Very well. We've closed off all of our major issues for our 0.8 release, save one. Once the last issue is finished (in progress now), we're going to do a release, and then begin the incubation graduation process.

Date of last release:

  2014-06-27

When were the last committers or PMC members elected?

  2014-08-13

Signed-off-by:

  [X](samza) Chris Douglas
  [ ](samza) Arun Murthy
  [X](samza) Roman Shaposhnik

--------------------
Streams

Apache Streams is a lightweight server for ActivityStreams.

Streams has been incubating since 2012-11-20.

Three most important issues to address in the move towards graduation:

  1. Community Growth
  2. PPMC picks up the duties required of it, rather than rely on the mentors or let them languish
  3. Generate Documentation

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?

N/A

How has the community developed since the last report?

The community engagement has been strong for this period. The list serve has had multiple discussions around project standards and generating documentation.  Also the number of community members comment on pull requests has increased.

How has the project developed since the last report?

20 pull requests have been open in Sept.
15 pull requests have been merged in Sept.
55 comments have been made on those pull requests
6 community members have opened pull requests in Sept.

Date of last release:

  2013-01-09

When were the last committers or PMC members elected?

2014-01-14 (Carol Hansen)

Signed-off-by:

  [x](streams) Matt Franklin
  [x](streams) Ate Douma
  [ ](streams) Craig McClanahan

--------------------
Usergrid

Usergrid is Backend-as-a-Service (BaaS) composed of an integrated database
(Cassandra), application layer and client tier with SDKs for developers.

Usergrid has been incubating since 2013-10-03.

Three most important issues to address in the move towards graduation:

  1. Make another incubating release (most likely 1.1)
  2. Continue to grow the Usergrid community
  3. Document and streamline the Usergrid release process

Any issues that the Incubator PMC (IPMC) or ASF Board wish/need to be
aware of?
None


How has the community developed since the last report?
The community continues to develop in a positive fashion.
Usergrid was represented (indirectly) at this years CassandraSummit in San Francisco.
Various mentions of UG at that event, amongst the other community events which the UG
PPMC put together are building the user base.
The #usergrid IRC channel continues to see people come and go with people being directed
to the mailing lists whenever issues cannot be addressed in a more direct/instant manner.

user@ Traffic
Sep 2014 --> 7
Aug 2014 --> 13
Jul 2014 --> 9

dev@
Oct 2014 --> 5
Sep 2014 --> 127
Aug 2014 --> 288
Jul 2014 --> 144

commits@
Oct 2014 --> 101
Sep 2014 --> 443
Aug 2014 --> 764
Jul 2014 --> 136

How has the project developed since the last report?
The project has come on leaps and bounds post release of Usergrid 1.0 (incubating).
The development (PPMC) team worked very well together, and with the IPMC to ensure that
the 1.0 release went smoothly. The release procedure was slightly longer than we would have
liked however lessons have been learned and positives have been taken from the process as a whole.
Procedural nuances have been ironed out and we look forward to a 1.1 release in the near future.
In addition we have been documenting material on the Usergrid Incubation status page.
http://incubator.apache.org/projects/usergrid.html
Final note, KUDOS to Rod and Dave from the Usergrid PPMC who acted as release managers.

Date of last release:

  2014-09-10

When were the last committers or PMC members elected?

2014-07-17 New committer: George Reyes

Signed-off-by:

  [ ](usergrid) Dave Johnson
  [X](usergrid) Jake Farrell
  [ ](usergrid) Jim Jagielski
  [X](usergrid) Lewis John Mcgibbney
  [ ](usergrid) Luciano Resende