NextGenMapReduce has details on the ongoing effort to develop Next Generation Apache Hadoop MapReduce.
This wiki tracks various pieces under development (improvement: make it fine-grained) and people working on them, please use mapreduce-dev@hadoop.apache.org for discussions.
Project leads
The people you want to talk to for specific areas as you contribute:
MapReduce ApplicationMaster - Sharad & Vinod
- Availability - Sharad
RM - Arun & Mahadev
Scheduler - Arun & Mahadev
ApplicationsManager & Availability - Mahadev
NodeManager - Chris & Vinod
- Security - Vinod
Todo lists with assignments:
CapacityScheduler - Arun
ApplicationsManager - Mahadev
MapReduce ApplicationMaster - Sharad
NodeManager - Chris
- Security - Vinod
- Port MAPREDUCE-1220 to MRv2 - Greg
JobHistory service - Krishna
- UI (hamlet) - Luke
- Metrics - Luke
- MR AM Availability - Sharad
Resource Manager Availability - Mahadev
CapacityScheduler tests - TBD (Arun)
- Enhanced UI for RM/NM - TBD (Luke)
Proposals:
Add a feature/bug/* proposal you want to work on over here...