DDRAFT DRAFT DRAFT

NOTE that the content for this month report is in markdown format- please do not remove any formatting characters when adding your reports.

If your report is missing please use the clutch2report.py script to generate your report.

It also best to:

  • Do not change existing formatting. Especially do not change the formatting of the sign-off area.
  • Keep all lines under 76 characters long.

  • All content under the ### headings should be indented by two spaces. Do not use tabs.

  • Please don't change the text in the headings or add new ones.
  • Include one space after a bullet point or full stop on a numbered list.
  • Use [X] (X and no spaces) to sign off reports.
  • Do not include long URLs and use the apache URL shortener https://s.apache.org.
  • Please note that some lines have two spaces at the end. Do not remove these spaces.

Please make sure you use the current report and don't copy an old one, the headings do change from time to time.

A script will be run on this report before it is submitted to the board. If your lines are too long it may insert line breaks in unexpected places.

Reflow
fold -w 76 -s $1 | cat -s


Timeline

Wed November 01

Podling reports due by end of day

Sun November 05

Shepherd reviews due by end of day

Sun November 05

Summary due by end of day

Tue November 07

Mentor signoff due by end of day

Wed November 08

Report submitted to Board

Wed November 15

Board meeting


Shepherd Assignments

Calvin KirsNLPCraft
Dave FisherDevLake
Drew FarrisSDAP
Drew FarrisStreamPark
Justin McleanToree
P. Taylor GoetzCeleborn
PJ FanningOpenDAL
Timothy ChenLiminal
Timothy ChenTraining
Willem JiangPaimon

Incubator PMC report for November 2023

The Apache Incubator is the entry path into the ASF for projects and codebases wishing to become part of the Foundation's efforts.

TODO add narrative

Community

New IPMC members:

People who left the IPMC:

New Podlings

Podlings that failed to report, expected next month

  • Livy
  • Ponymail
  • Teaclave

Graduations

  • list podling here

The board has motions for the following:

  • Your podling here?

Releases

The following releases entered distribution during the month of October:

IP Clearance

Infrastructure

Miscellaneous

Credits

Table of Contents

Answer
Celeborn
DevLake
Livy
NLPCraft
OpenDAL
Paimon
[Pony Mail](#pony mail)
SDAP
StreamPark
Teaclave
Toree
Training


Answer

A Q-and-A platform software for teams at any scales.

Answer has been incubating since 2023-10-09.

Three most important unfinished issues to address before graduating:

  1. Produce our first Apache release and keep the releases going regularly.
  2. Build and grow a diverse community, attracting more committers and PPMC members.

Are there any issues that the IPMC or ASF Board need to be aware of?

Currently no  

How has the community developed since the last report?

This is our first report, and all the initial committers got on board and started learning everything. Meanwhile, there were 4 new contributors joining the community, and we have 42 contributors in total at the moment.  

How has the project developed since the last report?

  • Fix the "Apache Podling Website Checks" on the official website.
  • Fix issues about building ASF-compliant releases.
  • 3 new features, 9 bug fixes, 5 improvements.

How would you assess the podling's maturity?

Please feel free to add your own commentary.

  •  Initial setup
  •  Working towards first release
  •  Community building
  •  Nearing graduation
  •  Other:

Date of last release:  

No ASF-compliant release yet. We are still working on our first release after entering Apache Incubator.

When were the last committers or PPMC members elected?

It was in October since Apache Answer was accepted into the Apache Incubator.

Have your mentors been helpful and responsive?

Yes, all the mentors are helpful and responsive.

Is the PPMC managing the podling's brand / trademarks?

There are no known brand and naming issues.

Signed-off-by:

  •  (answer) Willem Ning Jiang
    Comments: The project settings are completed, and we are now preparing the first release.
  •  (answer) tison
    Comments:
  •  (answer) Justin Mclean
    Comments:
  •  (answer) Christofer Dutz
    Comments:

IPMC/Shepherd notes:


Celeborn

Celeborn is an intermediate data service for big data computing engines to boost performance, stability, and flexibility.

Celeborn has been incubating since 2022-10-18.

Three most important unfinished issues to address before graduating:

  1. Grow the community.
  2. Release more versions

Are there any issues that the IPMC or ASF Board need to be aware of?

None

How has the community developed since the last report?

  1. One new committer joined the community.

How has the project developed since the last report?

  1. One new release was published.

How would you assess the podling's maturity?

Please feel free to add your own commentary.

  •  Initial setup
  •  Working towards first release
  •  Community building
  •  Nearing graduation
  •  Other:

Date of last release:

2023-10-13, 0.3.1-incubating was released.

When were the last committers or PPMC members elected?

2023-07-01, Jiashu Xiong was elected as our new PPMC member.

Have your mentors been helpful and responsive?

Our mentors have been very helpful and responsive.

Is the PPMC managing the podling's brand / trademarks?

The VP, Brand has approved the project name.

Signed-off-by:

  •  (celeborn) Becket Qin
    Comments:
  •  (celeborn) Lidong Dai
    Comments:
  •  (celeborn) Willem Ning Jiang
    Comments:
  •  (celeborn) Duo Zhang
    Comments:
  •  (celeborn) Yu Li
    Comments: The community grows in a good shape with new contributors joining and new releases produced with high quality

IPMC/Shepherd notes:


DevLake

DevLake is a development data platform, providing the data infrastructure for developer teams to analyze and improve their engineering productivity.  

DevLake has been incubating since 2022-04-29.

Three most important unfinished issues to address before graduating:

  1. Grow the community and attract more users.
  2.  Add more committers and PPMC members.
  3. Grow the project, support more data sources and use cases, and improve the user experience.

Are there any issues that the IPMC or ASF Board needs to be aware of?

No issues at the moment.

How has the community developed since the last report?

  1. 9 new contributors have joined the community (118 contributors in total)
  2. 102 new community members in Slack (858 in total)
  3. 3 new committers were elected, and 1 PPMC was elected. 1 committer is under the PPMC voting process.
  4. Hosted a total of 1 community meetups.

How has the project developed since the last report?

  1. Made one new major release v0.18 with no compliance issues, and v0.19 is at the beta testing stage.
  2. Supported new data sources such as Bamboo and Zentao, etc.
  3. Polished the user experience of the Config UI in terms of managing data scope
  4. Added the cicd_deployments entity to the existing data schema to store GitHub/GitLab’s deployments

How would you assess the podling's maturity?

Please feel free to add your own commentary.

  •  Initial setup
  •  Working towards first release
  •  Community building
  •  Nearing graduation
  •  Other:

Date of last release:

2023-09-15

When were the last committers or PPMC members elected?

2023-09-06

Have your mentors been helpful and responsive?

Yes, the mentors helped tremendously throughout version releases and community governance.

Is the PPMC managing the podling's brand / trademarks?

There are no known brand and naming issues.

Signed-off-by:

  •  (devlake) Felix Cheung
    Comments:
  •  (devlake) Liang Zhang
    Comments:
  •  (devlake) Lidong Dai
    Comments:
  •  (devlake) Sijie Guo
    Comments:
  •  (devlake) Jean-Baptiste Onofré
    Comments:
  •  (devlake) Willem Ning Jiang
    Comments: It's good to see DevLake is in a good shape of graduation.

IPMC/Shepherd notes:


Livy

Livy is web service that exposes a REST interface for managing long running Apache Spark contexts in your cluster. With Livy, new applications can be built on top of Apache Spark that require fine grained interaction with many Spark contexts.

Livy has been incubating since 2017-06-05.

Three most important unfinished issues to address before graduating:

Are there any issues that the IPMC or ASF Board need to be aware of?

How has the community developed since the last report?

How has the project developed since the last report?

How would you assess the podling's maturity?

Please feel free to add your own commentary.

  •  Initial setup
  •  Working towards first release
  •  Community building
  •  Nearing graduation
  •  Other:

Date of last release:

XXXX-XX-XX

When were the last committers or PPMC members elected?

Have your mentors been helpful and responsive?

Are things falling through the cracks? If so, please list any open issues that need to be addressed.

Is the PPMC managing the podling's brand / trademarks?

Are 3rd parties respecting and correctly using the podlings name and brand? If not what actions has the PPMC taken to correct this? Has the VP, Brand approved the project name?

Signed-off-by:

  •  (livy) Bikas Saha
    Comments:
  •  (livy) Luciano Resende
    Comments:
  •  (livy) Jean-Baptiste Onofré
    Comments:
  •  (livy) Madhawa Kasun Gunasekara
    Comments:

IPMC/Shepherd notes:


NLPCraft

A Scala API for NLU applications

NLPCraft has been incubating since 2020-02-13.

Three most important unfinished issues to address before graduating:

  1. Community growth.

Are there any issues that the IPMC or ASF Board need to be aware of?

None.

How has the community developed since the last report?

We have communicated with Python developers, also the current project members are also honing their skills as Python developers to ensure the successful advancement of the project.

How has the project developed since the last report?

  •  We have been reviewing and testing the latest Python stack tools and libraries related to LLM model usage. We are attempting to identify the project development direction in the current state of the AI market.
  • Site updated, dependencies updated etc.

How would you assess the podling's maturity?

Please feel free to add your own commentary.

  •  Initial setup
  •  Working towards first release
  •  Community building
  •  Nearing graduation
  •  Other:

Date of last release:

2023-02-30

When were the last committers or PPMC members elected?

August of 2021.

Have your mentors been helpful and responsive?

No issues with mentors to report.

Is the PPMC managing the podling's brand / trademarks?

No issues with mentors to report.

Signed-off-by:

  •  (nlpcraft) Roman Shaposhnik
    Comments:
  •  (nlpcraft) Furkan Kamaci
    Comments:
  •  (nlpcraft) Evans Ye
    Comments:
  •  (nlpcraft) Paul King
    Comments:
  •  (nlpcraft) Konstantin I Boudnik
    Comments:
  •  (nlpcraft) Dave Fisher
    Comments:

 ### IPMC/Shepherd notes:


OpenDAL

Open Data Access Layer: Access data freely, painlessly, and efficiently.

OpenDAL has been incubating since 2023-02-27.

Three most important unfinished issues to address before graduating:

  1. Set up the boundaries for the release  
  2. Finalize the project management culture
  3. Versionize the documents for every bindings  

Are there any issues that the IPMC or ASF Board need to be aware of?

None

How has the community developed since the last report?

Incomplete GitHub statistics show that OpenDAL currently has 143 contributors and is utilized by 238 projects. Compared to last report, we have gain 29 new contributors and 33 new users (by repo).

We discuss on our dev mailing list to formalize our community decision-making process. For instance, determining when to initiate a release, how to propose an RFC, and so forth.

How has the project developed since the last report?

Since the last report, OpenDAL has made three releases. We've enhanced the consistency of our API for Rust core, improved the usability of Java binding, and added support for many new services such as PostgreSQL and SQLite.

How would you assess the podling's maturity?

Please feel free to add your own commentary.

  •  Initial setup
  •  Working towards first release
  •  Community building
  •  Nearing graduation
  •  Other:

Date of last release:    

At 2023-10-16, we released opendal v0.41

When were the last committers or PPMC members elected?

2023-09-28, we elected Xiangdong as our new committer

Have your mentors been helpful and responsive?

Yes.

Is the PPMC managing the podling's brand / trademarks?

Yes.

Signed-off-by:

  •  (opendal) tison
    Comments:
  •  (opendal) Willem Ning Jiang
    Comments: The poddling is in a good way to the graduation.
  •  (opendal) Sheng Wu
    Comments:
  •  (opendal) Ted Liu
    Comments:
  •  (opendal) Xiaoqiao He
    Comments:

IPMC/Shepherd notes:


Paimon

Paimon is a unified lake storage to build dynamic tables for both stream and batch processing with big data compute engines, supporting high-speed data ingestion and real-time data query.

Paimon has been incubating since 2023-03-12.

Three most important unfinished issues to address before graduating:

  1. Release 0.6.0-incubating

Are there any issues that the IPMC or ASF Board need to be aware of?

  • N/A

How has the community developed since the last report?

  1. Website: Add release note pages, who's using page

How has the project developed since the last report?

  1. Paimon CDC data ingestion has matured
  2. Paimon Spark write and read has been finished
  3. Paimon Append Table has matured

How would you assess the podling's maturity?

Please feel free to add your own commentary.

  •  Initial setup
  •  Working towards first release
  •  Community building
  •  Nearing graduation
  •  Other:

Date of last release:

2023-09-06

When were the last committers or PPMC members elected?

  • 2023-08-10 Ming Li was added as a new committer
  • 2023-10-16 Junhao Ye was added as a new committer

Have your mentors been helpful and responsive?

  • our mentors have been very helpful and responsive

Is the PPMC managing the podling's brand / trademarks?

  • The VP, Brand has approved the project name

Signed-off-by:

  •  (paimon) Becket Qin
    Comments:
  •  (paimon) Robert Metzger
    Comments:
  •  (paimon) Stephan Ewen
    Comments: Good to see a steady rate of committers added, and that the project is becoming orthogonal to multiple Apache projects (Flink & Spark)
  •  (paimon) Yu Li
    Comments: The diversity and ecology of the community keeps growing, which indicates a good trend towards graduation.

IPMC/Shepherd notes:

We may consider to invited committer to the PPMC if they show the willing to participate the project governace.

Pony Mail

Pony Mail is a mail-archiving, archive viewing, and interaction service, that can be integrated with many email platforms.

Pony Mail has been incubating since 2016-05-27.

Three most important unfinished issues to address before graduating:

Are there any issues that the IPMC or ASF Board need to be aware of?

How has the community developed since the last report?

How has the project developed since the last report?

How would you assess the podling's maturity?

Please feel free to add your own commentary.

  •  Initial setup
  •  Working towards first release
  •  Community building
  •  Nearing graduation
  •  Other:

Date of last release:

XXXX-XX-XX

When were the last committers or PPMC members elected?

Have your mentors been helpful and responsive?

Are things falling through the cracks? If so, please list any open issues that need to be addressed.

Is the PPMC managing the podling's brand / trademarks?

Are 3rd parties respecting and correctly using the podlings name and brand? If not what actions has the PPMC taken to correct this? Has the VP, Brand approved the project name?

Signed-off-by:

  •  (ponymail) John D. Ament
    Comments:

IPMC/Shepherd notes:


SDAP

SDAP is an integrated data analytics center for Big Earth Science problems.

SDAP has been incubating since 2017-10-22.

Three most important unfinished issues to address before graduating:

  1. Restart dev discussion thread on graduating
  2. Adopt official SDAP Logo (last outstanding item on https://whimsy.apache.org/pods/project/sdap)

Are there any issues that the IPMC or ASF Board need to be aware of?

None

How has the community developed since the last report?

Discussion and development is active.

Release candidates for SDAP 1.2.0 in review.

How has the project developed since the last report?

13 issue closed, 16 issues new/updated, 22 PRs merged.  

How would you assess the podling's maturity?

Please feel free to add your own commentary.

  •  Initial setup
  •  Working towards first release
  •  Community building
  •  Nearing graduation
  •  Other:

Date of last release:

2023-05-16 (Version 1.1.0)

When were the last committers or PPMC members elected?

Jason Kang was added as a committer on 2023-05-22

Have your mentors been helpful and responsive?

Yes. Our mentor, Julian Hyde, is active on our discussion threads and continues to provide guidance in SDAP releases and graduation.

Is the PPMC managing the podling's brand / trademarks?

PPMC is not aware of any issues.

Signed-off-by:

  •  (sdap) Julian Hyde
    Comments: Can't wait for SDAP to graduate!
  •  (sdap) Jörn Rottmann
    Comments:

IPMC/Shepherd notes:


StreamPark

StreamPark is a streaming application development platform.

StreamPark has been incubating since 2022-09-01.

Three most important unfinished issues to address before graduating:

  1. Release more apache versions.
  2. Develop more active contributors.  
  3. Improve documentation and provide docs for multiple versions

Are there any issues that the IPMC or ASF Board need to be aware of?

None

How has the community developed since the last report?

Since the last report, 18 new developers have joined the community, bringing the total number of developers to 122. More and more users are starting to use StreamPark. Currently, based on our collection, there are 50 + users(issue/163) using it in production. However, in reality, this number is even larger.

How has the project developed since the last report?

Since the last report, the community has finalized the release plan for version 2.1.2. It is currently undergoing voting in the incubator, The official website has been redesigned to make it more visually appealing. Documentation has been supplemented, and the blog module on the website has been rewritten. Multiple new blog posts have been added as well.

 

How would you assess the podling's maturity?

Please feel free to add your own commentary.

  •  Initial setup
  •  Working towards first release
  •  Community building
  •  Nearing graduation
  •  Other:

Date of last release:

2023-06-30

When were the last committers or PPMC members elected?

2023-06-27, Muchunjin and Sizhu Wang was elected as our new PPMC member.

Have your mentors been helpful and responsive?

Our mentors have been very helpful and responsive

Is the PPMC managing the podling's brand / trademarks?

Yes, The VP, Brand has approved the project name.

Signed-off-by:

  •  (streampark) tison
    Comments:
  •  (streampark) Willem Ning Jiang
    Comments:
  •  (streampark) Stephan Ewen
    Comments:
  •  (streampark) Thomas Weise
    Comments:
  •  (streampark) Duo Zhang
    Comments:

IPMC/Shepherd notes:


Teaclave

Teaclave is a universal secure computing platform.

Teaclave has been incubating since 2019-08-20.

Three most important unfinished issues to address before graduating:

Are there any issues that the IPMC or ASF Board need to be aware of?

How has the community developed since the last report?

How has the project developed since the last report?

How would you assess the podling's maturity?

Please feel free to add your own commentary.

  •  Initial setup
  •  Working towards first release
  •  Community building
  •  Nearing graduation
  •  Other:

Date of last release:

XXXX-XX-XX

When were the last committers or PPMC members elected?

Have your mentors been helpful and responsive?

Are things falling through the cracks? If so, please list any open issues that need to be addressed.

Is the PPMC managing the podling's brand / trademarks?

Are 3rd parties respecting and correctly using the podlings name and brand? If not what actions has the PPMC taken to correct this? Has the VP, Brand approved the project name?

Signed-off-by:

  •  (teaclave) Felix Cheung
    Comments:
  •  (teaclave) Furkan Kamaci
    Comments:
  •  (teaclave) Jianyong Dai
    Comments:
  •  (teaclave) Matt Sicker
    Comments:
  •  (teaclave) Zhijie Shen
    Comments:
  •  (teaclave) Gordon King
    Comments:

IPMC/Shepherd notes:


Toree

Toree provides applications with a mechanism to interactively and remotely access Apache Spark.

Toree has been incubating since 2015-12-02.

Three most important unfinished issues to address before graduating:

  1. Increase active contributors

Are there any issues that the IPMC or ASF Board need to be aware of?

None

How has the community developed since the last report?

The community saw a recent boost in activity working on the completion of remaining tasks related to Apache Spark 3.3 and Scala 2.13.

We still see much of the users asking questions in the gitter channel rather than using the mailing lists.

The discussion around retirement process was stopped with the boost in community activity.

  The Apache Toree project recently had a presentation at the Halifax Community over Code, drawing a good audience. The attendees showed great interest, posing several questions. This indicates the community should look into opportunities for us to further promote awareness of the project.

How has the project developed since the last report?

Most of the remaining tasks related to Apache Spark 3.3 and Scala 2.13 are completed and comunity should start planning next release.

How would you assess the podling's maturity?

Please feel free to add your own commentary.

  •  Initial setup
  •  Working towards first release
  •  Community building
  •  Nearing graduation
  •  Other:

Date of last release:

2022-04-11

When were the last committers or PPMC members elected?

  Cheng Pan was added to the PPMC on 2023-08-28

Have your mentors been helpful and responsive?

None

Is the PPMC managing the podling's brand / trademarks?

No Trademark issues

Signed-off-by:

  •  (toree) Luciano Resende
    Comments:
  •  (toree) Weiwei Yang
    Comments:

IPMC/Shepherd notes:


Training

The Training project aims to develop resources which can be used for training purposes in various media formats, languages and for various Apache and non-Apache target projects.

Training has been incubating since 2019-02-21.

In June 2023, we started adjusting the project goals. Besides a pure focus on content creation tools we have identified the need for two additional aspects:

(1) For ASF processes some documentation exists, e.g. https://community.apache.org/contributor-ladder, but the ASF member journey is still a challenge for many new members, especially those with less coding experience.

As a solution it has been suggested to provide training material for the following problems:

  • You've just graduated to a TLP. What are the challenges you will now face?
  • New committer onboarding
  • New PMC member onboarding
  • New PMC Chair onboarding
  • New board member onboarding

(2) Creation of some general recommendations/guidelines for:

  • managing/validation of training material contributions of arbitrary ASF projects has been propsed.

We expand our focus now on the following aspects:

We have to work on strategies to increase the participation and the visibility of the project and its goals.

Besides requests for contributions from individual contributors from other Apache projects we want to show what the Apache Training project can offer to those projects.

We should build on the assumption that synergy and network effects can help us to increase the community around training and skill management topics.

Three most important unfinished issues to address before graduating:

Improve the community participation (other Apache projects should actively be linked to this project, since they "have the content") (Re)define the short-, mid-, and long-term goals of the project.

  • Select an approach to handle non coding / non document related tasks (e.g., community related activities on events)

  • Create a strategy how this projects contributes to or is supported by other Apache projects

  • Create a tutorial on how the tools provided by this project can be used to create own content

  • Review current policies around contribution review and releases to find a pragmatic compromise

  • Are there any issues that the IPMC or ASF Board need to be aware of?

The Training Project needs more contribution from other Apache projects, hence a clear communication strategy for interlinking existing projects with the Apache Training project is needed.

We need feedback from other Apache projects on the presentations and trainings developed till now.

In order to improve this collaboration we suggest to investigate the status of other project’s documentation in a systematic approach, especially with an eye on available training related material.

Are there any issues that the IPMC or ASF Board need to be aware of?

How would you assess the podling's maturity?

There are currently some issues with this podling that we are working to address, we believe that the issues are not yet critical and can be turned around from within the community but want to make the board aware of this early on.

  • Initial setup oft he project’s structure:

Goals and strategy needs refinement. We plan an online session for this, in December 2023

  • Community building: The community exists of a very small number of people but is more or less invisible, as of today (April 2023).

Activation of more people requires clear goals, and also a stage to kick-off communication. We plan to be present in events, such as CLT2024 and the ASF conference in Bratislava.

How has the community developed since the last report?

Initial connection to Apache Wayang has been established. We started working on a joint proposal for the Apache Conference in 2024 in Bratislava.

Eric Tessenow joined our discussions and kicked off a contribution of new "ASF onboarding material".

How has the project developed since the last report?

A review regarding the options for using LLMs has been done.

The repository inspection tool has been improved in such a way, that a "compatible usage of a publicly hosted LLM" is possible and in line with the ASF guidelines.

Communication with a first "partner project" seems to be successful. We will continue with this kind of cross-project collaboration.

How would you assess the podling's maturity?

Please feel free to add your own commentary.

  •  Initial setup
  •  Working towards first release
  •  Community building
  •  Nearing graduation - Currently, we are far away from graduation, but we will bring up a plan in the next quarter.  - [ ] Other:

Date of last release:  

Working towards first release: What type of artefacts to release is not clear, due to unclear goals and strategy. We are in the process of clarification.

When were the last committers or PPMC members elected?

November 2020

Have your mentors been helpful and responsive?

Are things falling through the cracks? If so, please list any open issues that need to be addressed.

Mentors have been responsive and helpful when reached out to.

 ### Is the PPMC managing the podling's brand / trademarks? Are 3rd parties respecting and correctly using the podlings name and brand? If not what actions has the PPMC taken to correct this? Has the VP, Brand approved the project name?

The name search process has not yet been started, as there is still time to do that if and when graduation draws nearer.

The PPMC is actively monitoring usage of the Podlings current name on other sites.

The Podling is not directly affiliating with any sponsors donating content and presenting an independent image on the webpage.

 ### Signed-off-by:

  •  (training) Craig Russell
    Comments:
  •  (training) Christofer Dutz
    Comments: I currently don't quite agree with the assessment of nearing graduation when applying our normal incubator graduation rules, however this project seems to be aiming for one of the "infrastructure" slots (Ponymail, Whimsy, Steve, ...) We probably should discsuss what to do with projects of this type.
  •  (training) Justin Mclean
    Comments:
  •  (training) Lars Francke
    Comments:

IPMC/Shepherd notes:

  • No labels