Joseph D. Darcy's Sun Weblog

Joseph D. Darcy's Sun Weblog


20081203 Wednesday December 03, 2008

OpenJDK 6: Some regression test results for b14

Running with the usual jtreg flags, -a -ignore:quiet always and -s for the langtools area, the basic regression test results on Linux for OpenJDK 6 build 14 are:

  • HotSpot, 3 tests passed.

  • Langtools, 1,351 tests passed.

  • JDK, 3,077 tests pass, 26 tests fail, 3 tests have errors.

In this build, we upgraded from a HotSpot 10 base to HotSpot 11. HotSpot 11 is also being used in the 6u10 release. The set of included tests for the HotSpot versions differ:

0: b13-hotspot/summary.txt  pass: 5
1: b14-hotspot/summary.txt  pass: 3

0      1      Test
pass   ---    compiler/6547163/Test.java
pass   ---    compiler/6563987/Test.java
pass   ---    compiler/6571539/Test.java
pass   ---    compiler/6595044/Main.java
---    pass   compiler/6663621/IVTest.java
---    pass   compiler/6724218/Test.java

6 differences

In langtools all the tests continue to pass:


0: ./b13-langtools/summary.txt  pass: 1,351
1: ./b14-langtools/summary.txt  pass: 1,351

No differences

And in jdk, a few new tests were added in b14 and the existing tests have generally consistent results:

0: b13-jdk/summary.txt  pass: 3,072; fail: 23; error: 3
1: b14-jdk/summary.txt  pass: 3,077; fail: 26; error: 3

0      1      Test
---    fail   com/sun/org/apache/xml/internal/ws/server/Test.java
pass   fail   java/awt/TextArea/UsingWithMouse/SelectionAutoscrollTest.html
---    pass   java/awt/image/ConvolveOp/EdgeNoOpCrash.java
---    pass   javax/management/monitor/DerivedGaugeMonitorTest.java
pass   fail   javax/swing/JColorChooser/Test6541987.java
---    pass   javax/swing/JFileChooser/6484091/bug6484091.java
---    pass   sun/management/jmxremote/LocalRMIServerSocketFactoryTest.java
---    pass   sun/nio/cs/TestUTF8.java
---    pass   sun/security/ssl/com/sun/net/ssl/internal/ssl/SSLEngineImpl/EmptyExtensionData.java
---    pass   tools/pack200/MemoryAllocatorTest.java

10 differences
(2008-12-03 11:44:47.0) Permalink Comments [3]

Comments:

Hi Joe--I'm confused, as I don't follow the release process--isn't passing regression tests a requirement for build promotion? If not, how are failing regression tests prioritized?

Thanks!
Patrick

Posted by Patrick Wright on December 03, 2008 at 12:38 PM PST #

Patrick,

I do review the regression test results before posting the source bundles; however, as you've observed not all the tests pass currently. Over time, the fraction of failing tests as well as the total number of failing tests have decreased. Prioritizing addressing the test failures is generally done by the teams in the affected component area; for example in b13 we resolved all failing langtools tests (as well as made those tests runnable in the much faster "same vm" mode). Most of remaining failures are in AWT and 2D.

Posted by Joe Darcy on December 03, 2008 at 01:28 PM PST #

Joe,

thanks for the reply and clarification.

Patrick

Posted by Patrick Wright on December 03, 2008 at 01:49 PM PST #

Post a Comment:

Comments are closed for this entry.

Calendar

« July 2009
SunMonTueWedThuFriSat
   
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
 
       
Today

RSS Feeds

XML
All
/Annotation Processing
/General
/Java
/JavaOne
/Numerics
/OpenJDK

Search

Links

    Blogroll
  • Download the JRE

    News

Navigation



Referers

Today's Page Hits: 494