Differences between revisions 299 and 300
Revision 299 as of 2008-02-12 15:55:41
Size: 5317
Comment:
Revision 300 as of 2009-09-20 21:55:08
Size: 5333
Editor: localhost
Comment: converted to 1.6 markup
Deletions are marked like this. Additions are marked like this.
Line 2: Line 2:
[wiki:Self:DRLVMTestTracking Back to DRLVM Test Tracking] [[DRLVMTestTracking|Back to DRLVM Test Tracking]]
Line 7: Line 7:
You can find a description of our progress measured from October, 3 on the [wiki:Self:Unit_Tests_Pass_on_DRLVM_Day_Highlights project history page]. You can find a description of our progress measured from October, 3 on the [[Unit_Tests_Pass_on_DRLVM_Day_Highlights|project history page]].
Line 11: Line 11:
||[http://issues.apache.org/jira/browse/HARMONY-2337 2337]||[http://svn.apache.org/viewvc/harmony/enhanced/classlib/trunk/modules/swing/src/test/api/java/common/javax/swing/JCheckBoxMenuItemTest.java?view=co JCheckBoxMenuItemTest]||Dima||swing Linux||
||[http://issues.apache.org/jira/browse/HARMONY-2367 2367]||[http://svn.apache.org/viewvc/harmony/enhanced/classlib/trunk/modules/swing/src/test/api/java/common/javax/swing/text/PlainViewI18N_VisualPositionTest.java?view=co PlainViewI18N_VisualPositionTest]||Ivan||swing||
||[[http://issues.apache.org/jira/browse/HARMONY-2337|2337]]||[[http://svn.apache.org/viewvc/harmony/enhanced/classlib/trunk/modules/swing/src/test/api/java/common/javax/swing/JCheckBoxMenuItemTest.java?view=co|JCheckBoxMenuItemTest]]||Dima||swing Linux||
||[[http://issues.apache.org/jira/browse/HARMONY-2367|2367]]||[[http://svn.apache.org/viewvc/harmony/enhanced/classlib/trunk/modules/swing/src/test/api/java/common/javax/swing/text/PlainViewI18N_VisualPositionTest.java?view=co|PlainViewI18N_VisualPositionTest]]||Ivan||swing||
Line 16: Line 16:
||[http://issues.apache.org/jira/browse/HARMONY-1751 1751]||[http://svn.apache.org/viewvc/harmony/enhanced/classlib/trunk/modules/prefs/src/test/java/org/apache/harmony/prefs/tests/java/util/prefs/PreferencesTest.java?view=co PreferencesTest]||Stepan||preferences||
||[http://issues.apache.org/jira/browse/HARMONY-2315 2315]||[http://svn.apache.org/viewvc/harmony/enhanced/classlib/trunk/modules/luni/src/test/java/org/apache/harmony/tests/java/net/InetAddressTest.java?view=co InetAddressTest]||Mikhail||luni||
||[http://issues.apache.org/jira/browse/HARMONY-2387 2387]||[http://svn.apache.org/viewvc/harmony/enhanced/classlib/trunk/modules/luni/src/test/java/org/apache/harmony/tests/internal/net/www/protocol/http/HttpURLConnectionTest.java?view=co HttpURLConnectionTest]||Denis||luni||
||[http://issues.apache.org/jira/browse/HARMONY-2438 2438]||[http://svn.apache.org/viewvc/harmony/enhanced/classlib/trunk/modules/swing/src/test/api/java/common/javax/swing/DefaultCellEditorTest.java?view=co DefaultCellEditorTest]||Dima||swing||
||[[http://issues.apache.org/jira/browse/HARMONY-1751|1751]]||[[http://svn.apache.org/viewvc/harmony/enhanced/classlib/trunk/modules/prefs/src/test/java/org/apache/harmony/prefs/tests/java/util/prefs/PreferencesTest.java?view=co|PreferencesTest]]||Stepan||preferences||
||[[http://issues.apache.org/jira/browse/HARMONY-2315|2315]]||[[http://svn.apache.org/viewvc/harmony/enhanced/classlib/trunk/modules/luni/src/test/java/org/apache/harmony/tests/java/net/InetAddressTest.java?view=co|InetAddressTest]]||Mikhail||luni||
||[[http://issues.apache.org/jira/browse/HARMONY-2387|2387]]||[[http://svn.apache.org/viewvc/harmony/enhanced/classlib/trunk/modules/luni/src/test/java/org/apache/harmony/tests/internal/net/www/protocol/http/HttpURLConnectionTest.java?view=co|HttpURLConnectionTest]]||Denis||luni||
||[[http://issues.apache.org/jira/browse/HARMONY-2438|2438]]||[[http://svn.apache.org/viewvc/harmony/enhanced/classlib/trunk/modules/swing/src/test/api/java/common/javax/swing/DefaultCellEditorTest.java?view=co|DefaultCellEditorTest]]||Dima||swing||
Line 22: Line 22:
[[Anchor(patches)]] <<Anchor(patches)>>
Line 26: Line 26:
||[http://issues.apache.org/jira/browse/HARMONY-2282 2282]||[http://svn.apache.org/viewvc/harmony/enhanced/classlib/trunk/modules/swing/src/test/api/java/common/javax/swing/SpinnerDateModelTest.java?view=co SpinnerDateModelTest]|||| ||[[http://issues.apache.org/jira/browse/HARMONY-2282|2282]]||[[http://svn.apache.org/viewvc/harmony/enhanced/classlib/trunk/modules/swing/src/test/api/java/common/javax/swing/SpinnerDateModelTest.java?view=co|SpinnerDateModelTest]]||||
Line 31: Line 31:
[[Anchor(reliability)]] <<Anchor(reliability)>>
Line 34: Line 34:
You can find daily test run results at [http://harmonytest.org]. To detect intermittent problems you can use a [http://issues.apache.org/jira/secure/attachment/12342921/luni.sh script]. You can find daily test run results at [[http://harmonytest.org]]. To detect intermittent problems you can use a [[http://issues.apache.org/jira/secure/attachment/12342921/luni.sh|script]].
Line 37: Line 37:
[[Anchor(FAQ)]] <<Anchor(FAQ)>>
Line 40: Line 40:
Q. How can I launch a standalone class library unit test?[[BR]]
A. Check a command line in [http://mail-archives.apache.org/mod_mbox/incubator-harmony-dev/200610.mbox/%3c2c9597b90610020929wcd07673h8815ef1e88816cc6@mail.gmail.com%3e a post] from Alexei Zakharov.[[BR]]
Q. How can I launch a standalone class library unit test?<<BR>>
A. Check a command line in [[http://mail-archives.apache.org/mod_mbox/incubator-harmony-dev/200610.mbox/%3c2c9597b90610020929wcd07673h8815ef1e88816cc6@mail.gmail.com%3e|a post]] from Alexei Zakharov.<<BR>>
Line 50: Line 50:
[[BR]] <<BR>>
Line 52: Line 52:
Q. How to run tests for a specific module?[[BR]]
A. To run tests for the module, use Elena's comment to
[http://issues.apache.org/jira/browse/HARMONY-1789 HARMONY-1789]. To avoid compilation errors, add {{{junit.jar}}} to {{{CLASSPATH}}} environment variable.[[BR]]
Q. How to run tests for a specific module?<<BR>>
A. To run tests for the module, use Elena's comment to
[[http://issues.apache.org/jira/browse/HARMONY-1789|HARMONY-1789]]. To avoid compilation errors, add {{{junit.jar}}} to {{{CLASSPATH}}} environment variable.<<BR>>
Line 60: Line 60:
[[BR]] <<BR>>
Line 62: Line 62:
Q. I feel I've lost the point. What have I missed?[[BR]] Q. I feel I've lost the point. What have I missed?<<BR>>
Line 65: Line 65:
Q. Why several bugs contain URL of this page?[[BR]] Q. Why several bugs contain URL of this page?<<BR>>
Line 68: Line 68:
Q. Where can I get a list of tests which fail?[[BR]]
A. The site http://www.harmonytest.org contains results of recent test runs. For example, this [http://harmonytest.org/testapp.do?method=showrun&id=13&name=&result=2&jira=0 request] produces a list of tests which fail in a Linux test run by Alexey Varlamov.
Q. Where can I get a list of tests which fail?<<BR>>
A. The site http://www.harmonytest.org contains results of recent test runs. For example, this [[http://harmonytest.org/testapp.do?method=showrun&id=13&name=&result=2&jira=0|request]] produces a list of tests which fail in a Linux test run by Alexey Varlamov.
Line 71: Line 71:
Q. How can I get test failures for my package?[[BR]] Q. How can I get test failures for my package?<<BR>>
Line 74: Line 74:
Q. How can I get a list of tests which fail due to reliability issues?[[BR]]
A. Adjust the [http://issues.apache.org/jira/secure/attachment/12342921/luni.sh script] which produces a {{{luni.log}}} file. Apply the command {{{grep FAILED luni.log | sort | uniq -c}}} to produce a reliability statistics.
Q. How can I get a list of tests which fail due to reliability issues?<<BR>>
A. Adjust the [[http://issues.apache.org/jira/secure/attachment/12342921/luni.sh|script]] which produces a {{{luni.log}}} file. Apply the command {{{grep FAILED luni.log | sort | uniq -c}}} to produce a reliability statistics.
Line 78: Line 78:
[wiki:Self:DRLVMTestTracking Back to DRLVM Test Tracking] [[DRLVMTestTracking|Back to DRLVM Test Tracking]]

Back to DRLVM Test Tracking

Mission

There are more than 20,000 class library unit tests, and their numbers grow over time. Please, join us in making these tests pass on DRLVM. We strive for reliable execution, so the test pass many times in a row in the same VM.

You can find a description of our progress measured from October, 3 on the project history page.

Swing Issues

JIRA

Blocks

Investigated by

Comment

2337

JCheckBoxMenuItemTest

Dima

swing Linux

2367

PlainViewI18N_VisualPositionTest

Ivan

swing

Open Issues

JIRA

Blocks

Investigated by

Specific Configuration

1751

PreferencesTest

Stepan

preferences

2315

InetAddressTest

Mikhail

luni

2387

HttpURLConnectionTest

Denis

luni

2438

DefaultCellEditorTest

Dima

swing

Review Queue

JIRA

Blocks

Action Required

2282

SpinnerDateModelTest

Patch Queue

JIRA

Blocks

Action Required

Tried the patch

Pass Rates

You can find daily test run results at http://harmonytest.org. To detect intermittent problems you can use a script.

FAQ

Q. How can I launch a standalone class library unit test?
A. Check a command line in a post from Alexei Zakharov.

> echo %JAVA_HOME%
C:\Java\harmony-hdk-r450941\jdk\jre

> %JAVA_HOME%\bin\java
-Xbootclasspath/p:.\build\classes;.\build\tests;C:\Java\harmony\enhanced\classlib\trunk\depends\jars\junit_3.8.2\junit.jar
-Xem:opt junit.textui.TestRunner org.apache.harmony.beans.tests.java.beans.IntrospectionExceptionTest


Q. How to run tests for a specific module?
A. To run tests for the module, use Elena's comment to HARMONY-1789. To avoid compilation errors, add junit.jar to CLASSPATH environment variable.

> echo %DRLVM% 
C:\Java\harmony-hdk-r450941\jdk\jre

> ant -Dtest.jre.home=%DRLVM% -Dbuild.module=luni test 


Q. I feel I've lost the point. What have I missed?
A. You may miss occasional personal emails. To avoid confusion, please, do not use personal emails for technical reports and evaluations, publish them to JIRA or harmony-dev@ maillist instead.

Q. Why several bugs contain URL of this page?
A. They prevent DRLVM to pass class library unit tests. We mark such bugs with this URL and [drlvm][unit] prefix in Summary.

Q. Where can I get a list of tests which fail?
A. The site http://www.harmonytest.org contains results of recent test runs. For example, this request produces a list of tests which fail in a Linux test run by Alexey Varlamov.

Q. How can I get test failures for my package?
A. Go to http://www.harmonytest.org and put the package name into Search for test: field. This will display the recent statistics for the package.

Q. How can I get a list of tests which fail due to reliability issues?
A. Adjust the script which produces a luni.log file. Apply the command grep FAILED luni.log | sort | uniq -c to produce a reliability statistics.

Back to DRLVM Test Tracking

Unit_Tests_Pass (last edited 2009-09-20 21:55:08 by localhost)