Wednesday December 03, 2008
Joseph D. Darcy's Sun WeblogJoseph D. Darcy's Sun Weblog OpenJDK 6: Some regression test results for b14 Running with the usual jtreg flags, -a -ignore:quiet always and -s for the langtools area, the basic regression test results on Linux for OpenJDK 6 build 14 are:
In this build, we upgraded from a HotSpot 10 base to HotSpot 11. HotSpot 11 is also being used in the 6u10 release. The set of included tests for the HotSpot versions differ: 0: b13-hotspot/summary.txt pass: 5 1: b14-hotspot/summary.txt pass: 3 0 1 Test pass --- compiler/6547163/Test.java pass --- compiler/6563987/Test.java pass --- compiler/6571539/Test.java pass --- compiler/6595044/Main.java --- pass compiler/6663621/IVTest.java --- pass compiler/6724218/Test.java 6 differences In langtools all the tests continue to pass: 0: ./b13-langtools/summary.txt pass: 1,351 1: ./b14-langtools/summary.txt pass: 1,351 No differences And in jdk, a few new tests were added in b14 and the existing tests have generally consistent results: (2008-12-03 11:44:47.0) Permalink Comments [3]0: b13-jdk/summary.txt pass: 3,072; fail: 23; error: 3 1: b14-jdk/summary.txt pass: 3,077; fail: 26; error: 3 0 1 Test --- fail com/sun/org/apache/xml/internal/ws/server/Test.java pass fail java/awt/TextArea/UsingWithMouse/SelectionAutoscrollTest.html --- pass java/awt/image/ConvolveOp/EdgeNoOpCrash.java --- pass javax/management/monitor/DerivedGaugeMonitorTest.java pass fail javax/swing/JColorChooser/Test6541987.java --- pass javax/swing/JFileChooser/6484091/bug6484091.java --- pass sun/management/jmxremote/LocalRMIServerSocketFactoryTest.java --- pass sun/nio/cs/TestUTF8.java --- pass sun/security/ssl/com/sun/net/ssl/internal/ssl/SSLEngineImpl/EmptyExtensionData.java --- pass tools/pack200/MemoryAllocatorTest.java 10 differences Post a Comment: Comments are closed for this entry. |
Calendar
RSS Feeds
All /Annotation Processing /General /Java /JavaOne /Numerics /OpenJDK SearchLinks
NavigationReferersToday's Page Hits: 494 |
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Hi Joe--I'm confused, as I don't follow the release process--isn't passing regression tests a requirement for build promotion? If not, how are failing regression tests prioritized?
Thanks!
Patrick
Posted by Patrick Wright on December 03, 2008 at 12:38 PM PST #
Patrick,
I do review the regression test results before posting the source bundles; however, as you've observed not all the tests pass currently. Over time, the fraction of failing tests as well as the total number of failing tests have decreased. Prioritizing addressing the test failures is generally done by the teams in the affected component area; for example in b13 we resolved all failing langtools tests (as well as made those tests runnable in the much faster "same vm" mode). Most of remaining failures are in AWT and 2D.
Posted by Joe Darcy on December 03, 2008 at 01:28 PM PST #
Joe,
thanks for the reply and clarification.
Patrick
Posted by Patrick Wright on December 03, 2008 at 01:49 PM PST #