Differences between revisions 1 and 2
Revision 1 as of 2005-08-18 21:20:03
Size: 8168
Editor: SteveTocco
Comment: just updating the release criteria to indicate this was for v1m1, not v1.
Revision 2 as of 2009-09-20 23:24:37
Size: 8168
Editor: localhost
Comment: converted to 1.6 markup
Deletions are marked like this. Additions are marked like this.
Line 16: Line 16:
#1.0 [[BR]]
Objective: All DRTs/Checkin tests pass at 100% when executed against the release candidate revision number in the source tree.[[BR]]
Background: All DRTs must pass at 100% for NetUI, JWS and Controls.[[BR]]
Gating: Yes [[BR]]
Owner(s): [[BR]]
#1.0 <<BR>>
Objective: All DRTs/Checkin tests pass at 100% when executed against the release candidate revision number in the source tree.<<BR>>
Background: All DRTs must pass at 100% for NetUI, JWS and Controls.<<BR>>
Gating: Yes <<BR>>
Owner(s): <<BR>>
Line 22: Line 22:
#1.1[[BR]] #1.1<<BR>>
Line 24: Line 24:
release candidate revision number in the source tree. [[BR]]
Background: Any BVTs/detailed tests not passing should have JIRA issue filed and be commented out for the release candidate. If at a later date a fix is to be added to 1.0 (something like 1.0.1) the test can be re-enabled in the 1.0 branch or in the next major release (1.1 or 2.0) [[BR]]
Gating: Yes [[BR]]
Owner(s): [[BR]]
release candidate revision number in the source tree. <<BR>>
Background: Any BVTs/detailed tests not passing should have JIRA issue filed and be commented out for the release candidate. If at a later date a fix is to be added to 1.0 (something like 1.0.1) the test can be re-enabled in the 1.0 branch or in the next major release (1.1 or 2.0) <<BR>>
Gating: Yes <<BR>>
Owner(s): <<BR>>
Line 29: Line 29:
#1.2[[BR]]
Objective: Any tests commented out due to failures should have JIRA issues filed (defects or enhancements) to be fixed in subsequent releases. Comments within test configuration files should indicate the JIRA issue tracking the problem.[[BR]]
Background: N/A [[BR]]
Gating: Yes[[BR]]
Owner(s):[[BR]]
#1.2<<BR>>
Objective: Any tests commented out due to failures should have JIRA issues filed (defects or enhancements) to be fixed in subsequent releases. Comments within test configuration files should indicate the JIRA issue tracking the problem.<<BR>>
Background: N/A <<BR>>
Gating: Yes<<BR>>
Owner(s):<<BR>>
Line 35: Line 35:
#1.3[[BR]]
Objective: The website content must be generated in support of the release candidate.[[BR]]
Background: N/A[[BR]]
Gating: Yes[[BR]]
Owner(s):[[BR]]
#1.3<<BR>>
Objective: The website content must be generated in support of the release candidate.<<BR>>
Background: N/A<<BR>>
Gating: Yes<<BR>>
Owner(s):<<BR>>
Line 41: Line 41:
#1.4[[BR]] #1.4<<BR>>
Line 43: Line 43:
Background: We must be able to successfully build the javadoc.[[BR]]
Gating: Yes[[BR]]
Owner(s):[[BR]]
Background: We must be able to successfully build the javadoc.<<BR>>
Gating: Yes<<BR>>
Owner(s):<<BR>>
Line 47: Line 47:
#1.5[[BR]]
Objective: JSF integration tests must pass at 100%.[[BR]]
Background: We must be able to pass these tests. Failures have JIRA issue tagged and filed for next release and test commented out of run.[[BR]]
Gating: Yes[[BR]]
Owner(s):[[BR]]
#1.5<<BR>>
Objective: JSF integration tests must pass at 100%.<<BR>>
Background: We must be able to pass these tests. Failures have JIRA issue tagged and filed for next release and test commented out of run.<<BR>>
Gating: Yes<<BR>>
Owner(s):<<BR>>
Line 53: Line 53:
'''DISTRIBUTION BITS'''[[BR]]
The following indicate activities that must occur in support of the Beehive Distribution.[[BR]]
'''DISTRIBUTION BITS'''<<BR>>
The following indicate activities that must occur in support of the Beehive Distribution.<<BR>>
Line 56: Line 56:
#2.0[[BR]]
Objective: The Beehive Distribution must be able to be created from the release candidate.[[BR]]
Background: We must be able to build the distribution from the release candidate.[[BR]]
Gating: Yes[[BR]]
Owner(s):[[BR]]
#2.0<<BR>>
Objective: The Beehive Distribution must be able to be created from the release candidate.<<BR>>
Background: We must be able to build the distribution from the release candidate.<<BR>>
Gating: Yes<<BR>>
Owner(s):<<BR>>
Line 62: Line 62:
#2.1[[BR]]
Objective: The Beehive Test Distribution must be able to be created from the release candidate.[[BR]]
Background: We must be able to build the test distribution from the release candidate. This is really needed to verify bits in the distribution.[[BR]]
Gating: Yes[[BR]]
Owner(s):[[BR]]
#2.1<<BR>>
Objective: The Beehive Test Distribution must be able to be created from the release candidate.<<BR>>
Background: We must be able to build the test distribution from the release candidate. This is really needed to verify bits in the distribution.<<BR>>
Gating: Yes<<BR>>
Owner(s):<<BR>>
Line 68: Line 68:
#2.2[[BR]]
Objective: All tests (DRTs/checkin/BVTs/detailed) in support of Beehive must be able to be executed from the test distribution against the distribution derived from the release candidate.[[BR]]
Background: Thus test code must fully be enabled to run in this manner.[[BR]]
Gating: Yes[[BR]]
Owner(s):[[BR]]
#2.2<<BR>>
Objective: All tests (DRTs/checkin/BVTs/detailed) in support of Beehive must be able to be executed from the test distribution against the distribution derived from the release candidate.<<BR>>
Background: Thus test code must fully be enabled to run in this manner.<<BR>>
Gating: Yes<<BR>>
Owner(s):<<BR>>
Line 74: Line 74:
#2.3[[BR]]
Objective: All DRTs/Checkin tests must pass at 100% when executed from the test distribution against the distribution for the release candidate for Windows 2003 Server.[[BR]]
Background: We need the same pass rate to verify it is a good distribution.[[BR]]
Gating: Yes[[BR]]
Owner(s):[[BR]]
#2.3<<BR>>
Objective: All DRTs/Checkin tests must pass at 100% when executed from the test distribution against the distribution for the release candidate for Windows 2003 Server.<<BR>>
Background: We need the same pass rate to verify it is a good distribution.<<BR>>
Gating: Yes<<BR>>
Owner(s):<<BR>>
Line 80: Line 80:
#2.4[[BR]]
Objective: All DRTs/Checkin tests must pass at 100% when executed from the test distribution against the distribution for the release candidate for Redhat Linux AS 3.0.[[BR]]
Background: We need the same pass rate to verify it is a good distribution.[[BR]]
Gating: Yes[[BR]]
Owner(s):[[BR]]
#2.4<<BR>>
Objective: All DRTs/Checkin tests must pass at 100% when executed from the test distribution against the distribution for the release candidate for Redhat Linux AS 3.0.<<BR>>
Background: We need the same pass rate to verify it is a good distribution.<<BR>>
Gating: Yes<<BR>>
Owner(s):<<BR>>
Line 86: Line 86:
#2.5[[BR]]
Objective: All BVT/Detailed tests must pass at 100% when executed from the test distribution against the distribution for the release candidate for Window 2003 Server.[[BR]]
Background: We need the same pass rate to verify it is a good distribution.[[BR]]
Gating: Yes[[BR]]
Owner(s):[[BR]]
#2.5<<BR>>
Objective: All BVT/Detailed tests must pass at 100% when executed from the test distribution against the distribution for the release candidate for Window 2003 Server.<<BR>>
Background: We need the same pass rate to verify it is a good distribution.<<BR>>
Gating: Yes<<BR>>
Owner(s):<<BR>>
Line 92: Line 92:
#2.6[[BR]]
Objective: All BVT/Detailed tests must pass at 100% when executed from the test distribution against the distribution for the release candidate for Redhat Linux AS 3.0.[[BR]]
Background: We need the same pass rate to verify it is a good distribution.[[BR]]
Gating: Yes[[BR]]
Owner(s):[[BR]]
#2.6<<BR>>
Objective: All BVT/Detailed tests must pass at 100% when executed from the test distribution against the distribution for the release candidate for Redhat Linux AS 3.0.<<BR>>
Background: We need the same pass rate to verify it is a good distribution.<<BR>>
Gating: Yes<<BR>>
Owner(s):<<BR>>
Line 98: Line 98:
#2.7[[BR]]
Objective: The distribution created from the release candidate must be published for download and signed.[[BR]]
Background: N/A[[BR]]
Gating: Yes[[BR]]
Owner(s):[[BR]]
#2.7<<BR>>
Objective: The distribution created from the release candidate must be published for download and signed.<<BR>>
Background: N/A<<BR>>
Gating: Yes<<BR>>
Owner(s):<<BR>>
Line 104: Line 104:
'''RELEASE PLANNING'''[[BR]]
The following indicate activities that must occur in support of the Beehive Distribution for Release Planning.[[BR]]
'''RELEASE PLANNING'''<<BR>>
The following indicate activities that must occur in support of the Beehive Distribution for Release Planning.<<BR>>
Line 107: Line 107:
#3.0[[BR]]
Objective: The release candidate needs to be proposed for vote within Apache. This needs to be a minimum of three days prior to release and needs to include all documentation, tests.[[BR]]
Background: We should not go to vote until all docs are ready including samples, user guides, java doc, etc.[[BR]]
Gating: Yes[[BR]]
Owner(s):[[BR]]
#3.0<<BR>>
Objective: The release candidate needs to be proposed for vote within Apache. This needs to be a minimum of three days prior to release and needs to include all documentation, tests.<<BR>>
Background: We should not go to vote until all docs are ready including samples, user guides, java doc, etc.<<BR>>
Gating: Yes<<BR>>
Owner(s):<<BR>>
Line 113: Line 113:
#3.1[[BR]]
Objective: The vote submitted for the release candidate must pass.[[BR]]
Background: N/A[[BR]]
Gating: Yes[[BR]]
Owner(s):[[BR]]
#3.1<<BR>>
Objective: The vote submitted for the release candidate must pass.<<BR>>
Background: N/A<<BR>>
Gating: Yes<<BR>>
Owner(s):<<BR>>
Line 119: Line 119:
#3.2[[BR]] #3.2<<BR>>
Line 125: Line 125:
Background: Should be published as part of the dist itself.[[BR]]
Gating: Yes[[BR]]
Owner(s):[[BR]]
Background: Should be published as part of the dist itself.<<BR>>
Gating: Yes<<BR>>
Owner(s):<<BR>>
Line 129: Line 129:
#3.3[[BR]]
Objective: For the release candidate, no open bugs will exist. All items will be fixed or assigned to the new release.[[BR]]
Background: Currently all things for the future are assigned to Fix For version equal to "TBD".[[BR]]
Gating: No[[BR]]
#3.3<<BR>>
Objective: For the release candidate, no open bugs will exist. All items will be fixed or assigned to the new release.<<BR>>
Background: Currently all things for the future are assigned to Fix For version equal to "TBD".<<BR>>
Gating: No<<BR>>
Line 136: Line 136:
'''DOCUMENTATION'''[[BR]]
#4.0[[BR]]
Objective: All samples must be completed for the release candidate. The samples list includes: [[BR]]
   1) Petstore [[BR]]
   2) External config feature samples [[BR]]
   3) DB control [[BR]]
   4) Service control [[BR]]
   5) JSF sample[[BR]]
Background: List may grow.[[BR]]
Gating: Yes[[BR]]
Owner(s):[[BR]]
'''DOCUMENTATION'''<<BR>>
#4.0<<BR>>
Objective: All samples must be completed for the release candidate. The samples list includes: <<BR>>
   1) Petstore <<BR>>
   2) External config feature samples <<BR>>
   3) DB control <<BR>>
   4) Service control <<BR>>
   5) JSF sample<<BR>>
Background: List may grow.<<BR>>
Gating: Yes<<BR>>
Owner(s):<<BR>>
Line 148: Line 148:
#4.1[[BR]] #4.1<<BR>>
Line 150: Line 150:
Background: These need to be proofed and executed.[[BR]]
Gating: Yes[[BR]]
Owner(s):[[BR]]
Background: These need to be proofed and executed.<<BR>>
Gating: Yes<<BR>>
Owner(s):<<BR>>
Line 154: Line 154:
#4.2[[BR]] #4.2<<BR>>
Line 156: Line 156:
Background: This is mainly a driver to indicate if there is any API that we intend users to implement/understand, Javadoc must be provided.[[BR]]
These need to be authored/proofed by developers.[[BR]]
Gating: Yes[[BR]]
Owner(s):[[BR]]
Background: This is mainly a driver to indicate if there is any API that we intend users to implement/understand, Javadoc must be provided.<<BR>>
These need to be authored/proofed by developers.<<BR>>
Gating: Yes<<BR>>
Owner(s):<<BR>>
Line 161: Line 161:
#4.3[[BR]]
Objective: All tutorials on the website must be able to be successfully executed against the distribution created from the release candidate.[[BR]]
Background: N/A[[BR]]
Gating: Yes [[BR]]
Owner(s):[[BR]]
#4.3<<BR>>
Objective: All tutorials on the website must be able to be successfully executed against the distribution created from the release candidate.<<BR>>
Background: N/A<<BR>>
Gating: Yes <<BR>>
Owner(s):<<BR>>
Line 167: Line 167:
#4.4[[BR]]
Objective: The Beehive website must be updated to support the release candidate, including samples, download information, etc.[[BR]]
Background: N/A[[BR]]
Gating: Yes[[BR]]
Owner(s):[[BR]]
#4.4<<BR>>
Objective: The Beehive website must be updated to support the release candidate, including samples, download information, etc.<<BR>>
Background: N/A<<BR>>
Gating: Yes<<BR>>
Owner(s):<<BR>>

BEEHIVE V1.0m1 RELEASE CRITERIA

Author: Steve Tocco Last Revised Date: 5/4/05, Version 1.10

This document outlines all of the release criteria to be satisfied before Beehive 1.0 can be released. This document does not address elements to specifically get Beehive 1.0 out of Incubation at Apache, but some of these milestones may be used in defense of that position.

So here is the proposed list of release criteria for v1 Beehive. In the remainder of this document, the Subversion revision number that (eventually) reflects Beehive 1.0 will be simply referred to as the release candidate.

The release criteria generally fall into one of the following areas: Source Tree, Distribution Bits, Release Planning, and Documentation.

SOURCE TREE The following indicate activities that must occur in the Beehive Subversion Source Tree before we are ready to ship Beehive 1.0.

#1.0
Objective: All DRTs/Checkin tests pass at 100% when executed against the release candidate revision number in the source tree.
Background: All DRTs must pass at 100% for NetUI, JWS and Controls.
Gating: Yes
Owner(s):

#1.1
Objective: All BVT/detailed tests pass at 100% when executed against the release candidate revision number in the source tree.
Background: Any BVTs/detailed tests not passing should have JIRA issue filed and be commented out for the release candidate. If at a later date a fix is to be added to 1.0 (something like 1.0.1) the test can be re-enabled in the 1.0 branch or in the next major release (1.1 or 2.0)
Gating: Yes
Owner(s):

#1.2
Objective: Any tests commented out due to failures should have JIRA issues filed (defects or enhancements) to be fixed in subsequent releases. Comments within test configuration files should indicate the JIRA issue tracking the problem.
Background: N/A
Gating: Yes
Owner(s):

#1.3
Objective: The website content must be generated in support of the release candidate.
Background: N/A
Gating: Yes
Owner(s):

#1.4
Objective: The javadoc target for the release candidate must be able to pass successfully. Background: We must be able to successfully build the javadoc.
Gating: Yes
Owner(s):

#1.5
Objective: JSF integration tests must pass at 100%.
Background: We must be able to pass these tests. Failures have JIRA issue tagged and filed for next release and test commented out of run.
Gating: Yes
Owner(s):

DISTRIBUTION BITS
The following indicate activities that must occur in support of the Beehive Distribution.

#2.0
Objective: The Beehive Distribution must be able to be created from the release candidate.
Background: We must be able to build the distribution from the release candidate.
Gating: Yes
Owner(s):

#2.1
Objective: The Beehive Test Distribution must be able to be created from the release candidate.
Background: We must be able to build the test distribution from the release candidate. This is really needed to verify bits in the distribution.
Gating: Yes
Owner(s):

#2.2
Objective: All tests (DRTs/checkin/BVTs/detailed) in support of Beehive must be able to be executed from the test distribution against the distribution derived from the release candidate.
Background: Thus test code must fully be enabled to run in this manner.
Gating: Yes
Owner(s):

#2.3
Objective: All DRTs/Checkin tests must pass at 100% when executed from the test distribution against the distribution for the release candidate for Windows 2003 Server.
Background: We need the same pass rate to verify it is a good distribution.
Gating: Yes
Owner(s):

#2.4
Objective: All DRTs/Checkin tests must pass at 100% when executed from the test distribution against the distribution for the release candidate for Redhat Linux AS 3.0.
Background: We need the same pass rate to verify it is a good distribution.
Gating: Yes
Owner(s):

#2.5
Objective: All BVT/Detailed tests must pass at 100% when executed from the test distribution against the distribution for the release candidate for Window 2003 Server.
Background: We need the same pass rate to verify it is a good distribution.
Gating: Yes
Owner(s):

#2.6
Objective: All BVT/Detailed tests must pass at 100% when executed from the test distribution against the distribution for the release candidate for Redhat Linux AS 3.0.
Background: We need the same pass rate to verify it is a good distribution.
Gating: Yes
Owner(s):

#2.7
Objective: The distribution created from the release candidate must be published for download and signed.
Background: N/A
Gating: Yes
Owner(s):

RELEASE PLANNING
The following indicate activities that must occur in support of the Beehive Distribution for Release Planning.

#3.0
Objective: The release candidate needs to be proposed for vote within Apache. This needs to be a minimum of three days prior to release and needs to include all documentation, tests.
Background: We should not go to vote until all docs are ready including samples, user guides, java doc, etc.
Gating: Yes
Owner(s):

#3.1
Objective: The vote submitted for the release candidate must pass.
Background: N/A
Gating: Yes
Owner(s):

#3.2
Objective: Release Notes must be produced and published in support of the release candidate. This should capture:

  • A release description. Daryl says it best: "This would describe the overall goals of the release (feature work, bug fix work, etc). In addition, it would be nice if each release had a bit of a road map for the expectations and time frame is for the next release in the line. In addition, if the release is a branch from some release, the relationship of the release with the branches should be described."
  • A list of new features.
  • A list (JIRA links) of issues fixed since the last release. This need not include documentation bugs.
  • A list (JIRA links) of known/unresolved issues. This need not include documentation bugs.

Background: Should be published as part of the dist itself.
Gating: Yes
Owner(s):

#3.3
Objective: For the release candidate, no open bugs will exist. All items will be fixed or assigned to the new release.
Background: Currently all things for the future are assigned to Fix For version equal to "TBD".
Gating: No
Owner(s):

DOCUMENTATION
#4.0
Objective: All samples must be completed for the release candidate. The samples list includes:

  • 1) Petstore
    2) External config feature samples
    3) DB control
    4) Service control
    5) JSF sample

Background: List may grow.
Gating: Yes
Owner(s):

#4.1
Objective: All samples must be part of the distribution for the release candidate. Background: These need to be proofed and executed.
Gating: Yes
Owner(s):

#4.2
Objective: All Java Doc for "Public Use" APIs must be authored as part of the release candidate. Background: This is mainly a driver to indicate if there is any API that we intend users to implement/understand, Javadoc must be provided.
These need to be authored/proofed by developers.
Gating: Yes
Owner(s):

#4.3
Objective: All tutorials on the website must be able to be successfully executed against the distribution created from the release candidate.
Background: N/A
Gating: Yes
Owner(s):

#4.4
Objective: The Beehive website must be updated to support the release candidate, including samples, download information, etc.
Background: N/A
Gating: Yes
Owner(s):

V1m1ReleaseCriteria (last edited 2009-09-20 23:24:37 by localhost)