Differences between revisions 93 and 94
Revision 93 as of 2008-05-08 15:57:05
Size: 2710
Comment: According to new bti building process
Revision 94 as of 2009-09-20 21:54:48
Size: 2698
Editor: localhost
Comment: converted to 1.6 markup
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
[wiki:Self:DRLVMTestTracking Back to DRLVM Test Tracking] [[DRLVMTestTracking|Back to DRLVM Test Tracking]]
Line 3: Line 3:
[[Anchor(Summary)]] <<Anchor(Summary)>>
Line 57: Line 57:
[http://people.apache.org/~mloenko/snapshot_testing/script/r634719/index.html Automated Testing results]:__ [[http://people.apache.org/~mloenko/snapshot_testing/script/r634719/index.html|Automated Testing results]]:__
Line 70: Line 70:
[#Summary Back to Summary] [[#Summary|Back to Summary]]
Line 72: Line 72:
[wiki:Self:DRLVMTestTracking Back to DRLVM Test Tracking] [[DRLVMTestTracking|Back to DRLVM Test Tracking]]

Back to DRLVM Test Tracking

Summary

Reliability Tests Suite contains 100 tests including 13 that are considered as invalid currently. This suite is critical for testing Harmony readiness for running long large workloads such as Eclipse in the development mode. {*}

How to run reliability tests

Detailed instruction placed at http://harmony.apache.org/subcomponents/buildtest/index.html

1. There is approximate list of commands that should be executed:

  cd <new folder for bti>
  svn co https://svn.apache.org/repos/asf/harmony/enhanced/buildtest/trunk/infra
  cd infra
  ant -Dtest.suites="classlib,drlvm,reliability" install
  ant setup
  ant run

Results could be observed at build/results/reliability folder

2. In case of testing virtual machine in different location the following commands can help:

  cd <new folder for bti>
  svn co https://svn.apache.org/repos/asf/harmony/enhanced/buildtest/trunk/infra
  cd infra

Modify file "framework.local.properties" in order to set the path to tested vm like:

reliability.parameters.required.jvm.under.test=C:\harmony-jdk-628209\jre\bin\java.exe

Start test running

  ant -Dtest.suites=reliability install
  ant setup
  ant run

3. Here is also sample of individual test run if needed:

<vm folder>\working_vm\build\windows_x86_msvc_release\deploy\jdk\jre\bin\java.exe -classpath <bti folder>\build\checkouts\reliability\deploy\classes org.apache.harmony.test.reliability.share.ReliabilityTestStarter -testReliabilityMode longrunning -testTimeOut 1200 -testClassName org.apache.harmony.test.reliability.api.kernel.hooks.AddRmShtdwnHooksTest <vm folder>\working_vm\build\windows_x86_msvc_release\deploy\jdk\jre\bin\java.exe <bti folder>\build\checkouts\reliability\deploy\classes

Test run status

Pass rates according to Automated Testing results:

Platform

Valid

Failed

Excluded

Failed+excluded

Pass rate

Windows x86

87

2

13

15

83%

Linux x86

87

2

13

15

83%

Linux x86_64

87

4

17

21

76%

Excluded test list with references to corresponding JIRA could be found in files:

build/checkouts/reliability/run/exclude
build/checkouts/reliability/run/exclude.<platform>

Back to Summary

Back to DRLVM Test Tracking

Reliability_Tests_on_DRLVM (last edited 2009-09-20 21:54:48 by localhost)