Back to DRLVM Test Tracking

Mission

There are more than 20,000 class library unit tests, and their numbers grow over time. Please, join us in making these tests pass on DRLVM. We strive for reliable execution, so the test pass many times in a row in the same VM.

You can find a description of our progress measured from October, 3 on the project history page.

Swing Issues

JIRA

Blocks

Investigated by

Comment

2337

JCheckBoxMenuItemTest

Dima

swing Linux

2367

PlainViewI18N_VisualPositionTest

Ivan

swing

Open Issues

JIRA

Blocks

Investigated by

Specific Configuration

1751

PreferencesTest

Stepan

preferences

2315

InetAddressTest

Mikhail

luni

2387

HttpURLConnectionTest

Denis

luni

2438

DefaultCellEditorTest

Dima

swing

Review Queue

JIRA

Blocks

Action Required

2282

SpinnerDateModelTest

 

Patch Queue

JIRA

Blocks

Action Required

Tried the patch

Pass Rates

You can find daily test run results at script]. To detect intermittent problems you can use a [http://issues.apache.org/jira/secure/attachment/12342921/luni.sh.

FAQ

Q. How can I launch a standalone class library unit test?

  1. Check a command line in a post from Alexei Zakharov.
> echo %JAVA_HOME%
C:\Java\harmony-hdk-r450941\jdk\jre

> %JAVA_HOME%\bin\java
-Xbootclasspath/p:.\build\classes;.\build\tests;C:\Java\harmony\enhanced\classlib\trunk\depends\jars\junit_3.8.2\junit.jar
-Xem:opt junit.textui.TestRunner org.apache.harmony.beans.tests.java.beans.IntrospectionExceptionTest

Q. How to run tests for a specific module?

  1. To run tests for the module, use Elena's comment to HARMONY-1789. To avoid compilation errors, add junit.jar to CLASSPATH environment variable.
> echo %DRLVM% 
C:\Java\harmony-hdk-r450941\jdk\jre

> ant -Dtest.jre.home=%DRLVM% -Dbuild.module=luni test 

Q. I feel I've lost the point. What have I missed?

  1. You may miss occasional personal emails. To avoid confusion, please, do not use personal emails for technical reports and evaluations, publish them to JIRA or harmony-dev@ maillist instead.

Q. Why several bugs contain URL of this page?

  1. They prevent DRLVM to pass class library unit tests. We mark such bugs with this URL and [drlvm][unit] prefix in Summary.

Q. Where can I get a list of tests which fail?

  1. The site http://www.harmonytest.org contains results of recent test runs. For example, this request produces a list of tests which fail in a Linux test run by Alexey Varlamov.

Q. How can I get test failures for my package?

  1. Go to http://www.harmonytest.org and put the package name into Search for test: field. This will display the recent statistics for the package.

Q. How can I get a list of tests which fail due to reliability issues?

  1. Adjust the script which produces a luni.log file. Apply the command grep FAILED luni.log | sort | uniq -c to produce a reliability statistics.

Back to DRLVM Test Tracking

  • No labels