Information about the upcoming mainline releases based on the information from the hadoop mailing lists.

  • Feature freeze date:  all features should be merged
  • Code freeze date - blockers/critical only, no more improvements and non blocker/critical bug-fixes


Please also see, EOL (End-of-life) release branches.

Upcoming releases

  • 3.4.0
  • 3.3.2
  • 3.2.3
Feature freeze dateNA
Code freeze dateNA
Planned release date
Actual release date
Release Manager:
Branchbranch-3.2
Release StatusHadoop 3.2 Release
  • 2.10.2

For more details, please check Hadoop Active Release Lines

Old releases (Released)

Information about old releases only for the records here. For the final features included in a given release please check the official release notes.

3.2.2

Feature freeze dateSep 30, 2020
Code freeze dateOct 15, 2020
Planned release dateDec 20, 2020
Actual release dateJan 15, 2021
Release Manager:He Xiaoqiao
Branchbranch-3.2

3.1.4

Feature freeze dateWednesday, 11 March 2020
Code freeze dateWednesday, 22 April 2020
Planned release dateWednesday, 29 April 2020
Actual release date
Release Manager:

Gabor Bota

Branchbranch-3.1

Planned features: Hadoop 3.1 Release

3.3.0

Feature freeze dateFeb 28, 2020
Code freeze dateMarch 10, 2020
Planned release dateMarch 15, 2020
Actual release dateJuly 14,2020
Release Manager:Brahma Reddy Battula
Branchtrunk

Planned features:

YARN features

JIRA

Summary

Component

Feature Owner

Comments

Status

1.YARN-9414Application Catalog for YARN applicationsYARNEric Yang
Merged
2.

YARN-5542

Scheduling of opportunistic containersYARN

Konstantinos Karanasos/Abhishek Modi


Merged
3.YARN-9473Support Vector Engine ( a new accelerator hardware) based on pluggable device frameworkYARNPeter Bacsko
Merged
4.YARN-9264[Umbrella] Follow-up on IntelOpenCL FPGA pluginYARNPeter Bacsko
Merged
5.YARN-9145[Umbrella] Dynamically add or remove auxiliary servicesYARNBillie Rinaldi
Merged
6.YARN-9050[Umbrella] Usability improvements for scheduler activitiesYARNTao Yang
Merged
7.YARN-8851[Umbrella] A pluggable device plugin framework to ease vendor plugin developmentYARNZhankun Tang
Merged
8.YARN-9014runC container runtimeYARNEric Badger
Merged Partially
HDFS Features: 

JIRA

Summary

Component

Feature Owner

Comments

Status

1.

HDFS-13891

HDFS RBF stabilization phaseHDFSBrahma Reddy Battula
Merged
2.HDFS-12345Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)HDFSErik Krogen
Merged
3.HDFS-13762Support non-volatile storage class memory(SCM) in HDFS cache directivesHDFSFeilong He
Merged
Common Features: 

JIRA

Summary

Component

Feature Owner

CommentsStatus
1.

HADOOP-16095

Support impersonation for AuthenticationFilter


CommonEric Yang
Merged
2.HADOOP-15620Über-jira: S3A phase VI: Hadoop 3.3 featuresCommonSteve Loughran
Merged Partially
3.HADOOP-15763Über-JIRA: abfs phase II: Hadoop 3.3 features & fixesCommonSteve Loughran
Merged Partially
4.HADOOP-15338Java 11 runtime supportCommonAkira Ajisaka
Merged
5.HADOOP-15619Über-JIRA: S3Guard Phase IV: Hadoop 3.3 featuresCommonSteve Loughran
Merged Partially
6.HADOOP-13363Upgrade protobuf from 2.5.0 to something newerCommonVinay
Merged

2.10.0

Feature freeze date
Code freeze date
Planned release date2019
Actual release dateOct 31, 2019
Release Manager:Jonathan Hung
Branchbranch-2

Planned features: 

YARN features

JIRASummaryComponentFeature OwnerCommentsStatus
1.

YARN-8200

Backport resource types/GPU features to branch-2

YARNJonathan
Merged to branch-2.10
HDFS Features: 

JIRASummaryComponentFeature OwnerCommentsStatus
1.

HDFS-12943

Consistent Reads from Standby Node

HDFSKonstantin
Merged
2.HDFS-13541

NameNode Port based selective encryption

HDFSChen
Merged
3.HDFS-14403Cost-Based RPC Fair Call QueueHDFSErik
Merged

3.1.3

Feature freeze dateAug 25, 2019
Code freeze dateAug 30, 2019
Planned release dateSep 07, 2019
Actual release date
Release Manager:Zhankun Tang
Branchbranch-3.1

Planned features:

3.2.1

Feature freeze dateAug 30, 2019
Code freeze dateAug 30, 2019
Planned release dateSept 7, 2019
Actual release dateSept 22, 2019
Release Manager:Rohith Sharma K S
Branchbranch-3.2

3.2.0

Feature freeze dateSep 7, 2018
Code freeze dateSep 14, 2018
Planned release dateSept 30, 2018
Actual release dateJan 8, 2019
Release Manager:Sunil Govindan
Branchtrunk

Planned features:

YARN features

JIRASummaryComponentFeature OwnerCommentsStatus
1.

YARN-3409

Node Attributes Support in YARNYARNNaganarasimha/ Sunil
Merged
2.YARN-1011Resource OvercommitmentYARNHaibo / Miklos
Moved Out
3.YARN-8135

Hadoop Submarine project for DeepLearning workloads 

YARNWangda
Merged
4.YARN-7129Application Catalog for YARN applicationsYARNEric Yang
Moved Out
5.YARN-7512Support service upgrade via YARN Service API and CLIYARNChandni
Merged
6.YARN-5742Serve aggregated logs of historical apps from ATSv2YARNRohith Sharma
Merged
HDFS Features: 

JIRASummaryComponentFeature OwnerCommentsStatus
1.

HDFS-10285

HDFS Storage Policy SatisfierHDFSUma
Merged
2.HDFS-12615Router-based HDFS federationHDFSInigoImprovement WorksMerged
Common Features: 

JIRASummaryComponentCommentsComments
1.

HADOOP-15226

S3Guard Phase III


CommonSteve LoughranMerged
2.HADOOP-15220S3a phase V CommonSteve LoughranMerged
3.HADOOP-15407Support Windows Azure Storage - Blob file system in HadoopCommonDa Zhou/Steve LoughranMerged

Version 3.1

Feature freeze dateJan 30, 2018
Code freeze dateFeb 08, 2018
Planned release dateFeb 28, 2018
Release Manager:Wangda Tan
Branchtrunk
YARN features

JIRASummaryComponentFeature OwnerCommentsStatus
1.

YARN-5079,

YARN-4793,

YARN-4757,

YARN-6419

YARN native servicesYARNJian He
Merged
2.YARN-5734Dynamic scheduler queue configurationYARNJonathan / XuanAlso 2.9Merged
3.YARN-5881

Add absolute resource configuration to CapacityScheduler

YARNSunil G
Merged
4.YARN-5673

Container-executor rewrite for better security,

extensibility and portability

YARNVarun V
Move out
5.YARN-6223GPU IsolationYARNWangda
Merged
6.YARN-5972Support Pausing/Freezing of opportunistic containersYARNArun Suresh
Move out
7.YARN-3926Resource Profile and multiple resource typesYARNVarun V / SunilMaybe 3.0Merged
8.YARN-1011Resource overcommittmentYARNHaibo / Karthik KUnder discussionMove out
9.YARN-6592Support rich placement constraints in YARNYARNArun Suresh / Kostas / WangdaTentativeMerged
10.
YARN-7117
Capacity Scheduler: Support Auto Creation of Leaf Queues While Doing Queue MappingYARNSuma
Merged
11.YARN-5983FPGA support


Merged
HDFS Features: 

JIRASummaryComponentFeature OwnerComments
1.

HDFS-10285

HDFS Storage Policy SatisfierHDFSUmaMove out
2.HDFS-9806HDFS tiered storageHDFSChris DouglasMerged
3.HDFS-7240Ozone: Object store for HDFSHDFSAnuMove out
Common Features: 

JIRASummaryComponentCommentsComments
1.

HADOOP-13786

Add S3Guard committer for zero-rename commits to

S3 endpoints

HDFSSteve LoughranMerged

Version 2.9

Feature freeze date6th October 2017 20th October 2017
Code freeze date20th October 2017 27th October 2017
Planned release date3rd November 2017 17th November 2017
Release Manager:Subru Krishnan, Arun Suresh
Tracking PageHadoop 2.9 Release
Branchbranch-2
Planned features:



JIRASummaryComponentFeature OwnerProduction Deployment Sponsor(*)Status
1.YARN-2928 / YARN-5355ATS v2YARNVrushali / VarunJoep (Twitter)Merged in branch-2
2.YARN-2877 / YARN-5220Opportunistic ContainersYARNKonstantinos / ArunRoni (Microsoft)Merged in branch-2
3.YARN-5085 Container UpdateYARNArun / WangdaRoni / Sarvesh (Microsoft)Merged in branch-2
4.YARN-2915Yarn FederationYARNSubru / CarloSarvesh (Microsoft)Merged in branch-2
5.YARN-5139Global Scheduling (Capacity Scheduler)YARNWangda
Merged in branch-2
6.YARN-3368YARN Web UI v2YARNSunil / WangdaJoep (Twitter)Merged in branch-2
7.YARN-5734API based (Capacity) Scheduler configurationYARNJonathan / XuanJonathan (LinkedIn)Merged in branch-2
8.YARN-4726Allocation reuse for container upgradesYARNArun / JianSarvesh (Microsoft)Merged in branch-2
9.HDFS-10467HDFS Router based federationHDFSInigo / ChrisInigo (Microsoft)Merged in branch-2

(*) Production Deployment Sponsor: "We will favor inclusion of a feature in the 2.9.0 release if it is associated with an immediate production deployment requirement. Other cases: We would recommend moving it to the next major release."

Version 3.0

Feature freeze dateSep 15, 2017
Code freeze date
Planned release date2017-11-01
Release Manager:Andrew Wang
Tracking pageHadoop 3.0.0 release
Branchbranch-3.0

Planned features:



JIRASummaryComponentFeature OwnerStatus
1.

HADOOP-11656


Classpath isolationHADOOP
Merged
2.HADOOP-13345
S3GuardHADOOP
Merged
3.HADOOP-9902
Shell script rewriteHADOOP
Merged
4.HADOOP-13578
Add Codec for ZStandard CompressionHADOOP
Merged
5.HADOOP-10950,MAPREDUCE-5785
Reworked daemon and task heap managementHADOOP, MAPREDUCE
Merged
6.MAPREDUCE-2841
MapReduce task-level native optimizationMAPREDUCE
Merged
7.HADOOP-11804
Shaded client jarsHADOOP
Merged
8.YARN-2915
Yarn FederationYARN
Merged
9.YARN-5520
Support for Opportunistic Containers and Distributed Scheduling.YARN
Merged
10.YARN-5355
TimelineService v2 alpha 2YARN
Merged
12.YARN-5734
API based scheduler configurationYARN
Merged
12.

YARN-5079,YARN-4793,YARN-4757,YARN-6419


Yarn native servicesYARN
PENDING
13.HADOOP-12756
Support for Microsoft Azure Data Lake and Aliyun Object Storage System filesystem connectorsHADOOP
Merged
14.HDFS-7285
Support for Erasure Codes in HDFSHDFS
Merged
15.HDFS-5570
 Removal of hftp in favor of webhdfsHDFS
Merged
16.HDFS-6440
Support for more than two standby NamenodesHDFS
Merged
17.HDFS-1312
Intra-datanode balancerHDFS
Merged
18.HDFS-9427
Move default ports out of ephemeral rangeHDFS
Merged
19.HDFS-10467
HDFS Router based federationHDFSInigo / ChrisMerged







  • No labels

5 Comments

  1. Brahma Reddy Battula

    Nice to see, all at one place.

    1) Looks following missed the JIRA ID, wn't be good to give JIRA IDS..?

    • API-based scheduler configuration
    • Resource profiles
    • HDFS Storage Policy Satisfier
    • HDFS tiered storage
    • ..........


    2) Duplicate entries for erasure coding.

    3) Looks some features are missed for 3.0 release.  E.G. Aliyun Object Storage,MapReduce task-level native optimization..etc

    http://hadoop.apache.org/docs/r3.0.0-alpha4/

    1. Marton Elek

      Thanks, I added the missing elements from the 3.0.0-alpha4 and started to reformat the 3.0 section and adding the JIRA ids.

  2. Wangda Tan

    Subramaniam Krishnan, is it better to include release date in sub title, like "Ver 2.9.0 (3rd Nov, 2017)"?

    1. Subramaniam Krishnan

      I prefer to not include release dates in sub titles (yet), at least till we get more disciplined. The major.minor version is anyways is an unique identifier, thanks.

  3. Brahma Reddy Battula

     Given that dot or Minor releases shouldn't break the compatibility.,I prefer we should have compatible report before we ship 3.2 as we merging so many features..?