Differences between revisions 13 and 14
Revision 13 as of 2007-07-03 15:49:05
Size: 1912
Comment:
Revision 14 as of 2009-09-20 21:55:33
Size: 1924
Editor: localhost
Comment: converted to 1.6 markup
Deletions are marked like this. Additions are marked like this.
Line 13: Line 13:
||[http://ant.apache.org/manual/OptionalTasks/junit.html ant + junit]||<:> x ||<:> X || || || ||
||[http://p-unit.svn.sourceforge.net/viewvc/p-unit/trunk/ p-unit]|| || ||<:> X || ||<:> x ||
||[http://svn.apache.org/repos/asf/harmony/enhanced/drlvm/trunk/build/make/targets/ working_vm/build/make/targets/reg.test*.xml]||<:> X ||<:> X || ||<:> X || ||
||[http://svn.apache.org/repos/asf/harmony/enhanced/buildtest/branches/2.0/tests/tools/harness buildtest/branches/2.0/tests/tools/harness]||<:> x ||<:> X || ||<:> X || ||
||[http://svn.apache.org/repos/asf/harmony/enhanced/buildtest/branches/2.0/adaptors/HUT_iterative/HUT_iterative/ buildtest/branches/2.0/adaptors/HUT_iterative/HUT_iterative/]||<:> x ||<:> X ||<:> x ||<:> X || ||
||[http://svn.apache.org/repos/asf/harmony/enhanced/buildtest/branches/2.0/tests/stress/qa/src/test/stress/org/apache/harmony/test/share/stress/Readme.txt buildtest/branches/2.0/tests/stress/qa/src/test/stress/o/a/h/t/share/]||<:> x ||<:> X ||<:> X ||<:> X || ||
||[[http://ant.apache.org/manual/OptionalTasks/junit.html|ant + junit]]||<:> x ||<:> X || || || ||
||[[http://p-unit.svn.sourceforge.net/viewvc/p-unit/trunk/|p-unit]]|| || ||<:> X || ||<:> x ||
||[[http://svn.apache.org/repos/asf/harmony/enhanced/drlvm/trunk/build/make/targets/|working_vm/build/make/targets/reg.test*.xml]]||<:> X ||<:> X || ||<:> X || ||
||[[http://svn.apache.org/repos/asf/harmony/enhanced/buildtest/branches/2.0/tests/tools/harness|buildtest/branches/2.0/tests/tools/harness]]||<:> x ||<:> X || ||<:> X || ||
||[[http://svn.apache.org/repos/asf/harmony/enhanced/buildtest/branches/2.0/adaptors/HUT_iterative/HUT_iterative/|buildtest/branches/2.0/adaptors/HUT_iterative/HUT_iterative/]]||<:> x ||<:> X ||<:> x ||<:> X || ||
||[[http://svn.apache.org/repos/asf/harmony/enhanced/buildtest/branches/2.0/tests/stress/qa/src/test/stress/org/apache/harmony/test/share/stress/Readme.txt|buildtest/branches/2.0/tests/stress/qa/src/test/stress/o/a/h/t/share/]]||<:> x ||<:> X ||<:> X ||<:> X || ||

This page describes ability of test suites to execute stress tests.

  • Name hyper-references the harness location.

  • Exclude Lists are checked when per-platfrom exclude list is supported for the test suite.

  • Time to Stop is checked when a system allows to specify a VM abort timeout.

  • Time to Work is checked when a system allows to specify a time of repeated execution of the test.

  • Crash Report is checked when a test crash is correctly reflected in the report and doesn't abort test execution.

  • Numeric Report is checked when a numeric test result can be transformed into a report table. Using this report it should be easy to answer a question which of two applications under test is better.

  • x is incomplete X.

Name

Exclude Lists

Time to Abort

Time to Work

Crash Report

Numeric Report

ant + junit

x

X

p-unit

X

x

working_vm/build/make/targets/reg.test*.xml

X

X

X

buildtest/branches/2.0/tests/tools/harness

x

X

X

buildtest/branches/2.0/adaptors/HUT_iterative/HUT_iterative/

x

X

x

X

buildtest/branches/2.0/tests/stress/qa/src/test/stress/o/a/h/t/share/

x

X

X

X

Harmony_Test_Harness_Comparison (last edited 2009-09-20 21:55:33 by localhost)