Joseph D. Darcy's Sun Weblog

Friday September 12, 2008

OpenJDK 6: Some regression test results for b12

Running with jtreg flags -a -ignore:quiet, the basic regression test results on Linux for OpenJDK 6 build 12 are:

• HotSpot, 5 tests pass.

• Langtools, 1,346 tests pass, 2 tests fail.

• JDK, 2,985 tests pass, 36 tests fail, 4 tests have errors.

For langtools, from the previous build a few new (passing) tests were added and @ignore tests were really ignored; using jtdiff, part of the jtreg package to compute the differences of the tests results:

0: ./b11-langtools/summary.txt  pass: 1,341; fail: 2; error: 6
1: ./b12-langtools/summary.txt  pass: 1,346; fail: 2

0      1      Test
---    pass   tools/javac/6176978/T6176978.java
---    pass   tools/javac/6627362/T6627362.java
error  ---    tools/javac/T6405099.java
error  ---    tools/javac/api/T6306137.java
error  ---    tools/javac/api/T6397104.java
error  ---    tools/javac/api/TestJavacTaskScanner.java
error  ---    tools/javac/code/ArrayClone.java
---    pass   tools/javac/enum/T6509042.java
error  ---    tools/javac/generics/inference/6365166/NewTest.java
---    pass   tools/javac/staticImport/6665223/T6665223.java
---    pass   tools/javac/synthesize/Main.java

11 differences

Also for the jdk area, some new passing tests were added and the -ignore:quiet option prevents some tests that knowingly produce an error result from running. The few new failures warrant a bit of investigation.

0: b11-jdk/summary.txt  pass: 2,989; fail: 32; error: 22
1: b12-jdk/summary.txt  pass: 2,985; fail: 36; error: 4

0      1      Test
error  ---    com/sun/crypto/provider/Cipher/DES/PerformanceTest.java
pass   ---    com/sun/org/apache/xml/internal/security/exceptions/LocaleTest.java
pass   ---    com/sun/org/apache/xml/internal/security/transforms/ClassLoaderTest.java
error  ---    com/sun/security/auth/callback/DialogCallbackHandler/Default.java
error  ---    com/sun/security/auth/callback/TextCallbackHandler/Default.java
error  ---    com/sun/security/sasl/gsskerb/AuthOnly.java
error  ---    com/sun/security/sasl/gsskerb/ConfSecurityLayer.java
error  ---    com/sun/security/sasl/gsskerb/NoSecurityLayer.java
pass   fail   java/awt/Focus/DeiconifiedFrameLoosesFocus/DeiconifiedFrameLoosesFocus.html
fail   pass   java/awt/Focus/FrameMinimizeTest/FrameMinimizeTest.java
pass   fail   java/awt/TextArea/UsingWithMouse/SelectionAutoscrollTest.html
---    pass   java/awt/Window/PropertyChangeListenerLockSerialization/PropertyChangeListenerLockSerialization.java
error  ---    java/io/SystemInAvailable.java
error  ---    java/lang/instrument/TransformerManagementThreadRemoveTests.java
error  ---    java/lang/management/ThreadMXBean/SynchronizationStatistics.java
fail   pass   java/nio/channels/SocketChannel/Connect.java
pass   ---    java/rmi/activation/Activatable/checkActivateRef/CheckActivateRef.java
error  ---    java/util/AbstractList/CheckForComodification.java
---    pass   java/util/EnumSet/BogusEnumSet.java
error  ---    java/util/zip/3GBZipFiles.sh
fail   ---    javax/management/Introspector/LegacyIntrospectorTest.java
error  ---    javax/management/remote/mandatory/URLTest.java
error  ---    javax/security/auth/kerberos/KerberosHashEqualsTest.java
---    pass   javax/sound/midi/Gervill/DLSSoundbankReader/TestGetSoundbankFile.java
---    pass   javax/sound/midi/Gervill/DLSSoundbankReader/TestGetSoundbankInputStream.java
---    pass   javax/sound/midi/Gervill/DLSSoundbankReader/TestGetSoundbankInputStream2.java
---    pass   javax/sound/midi/Gervill/DLSSoundbankReader/TestGetSoundbankUrl.java
---    pass   javax/sound/midi/Gervill/SF2SoundbankReader/TestGetSoundbankFile.java
---    pass   javax/sound/midi/Gervill/SF2SoundbankReader/TestGetSoundbankInputStream.java
---    pass   javax/sound/midi/Gervill/SF2SoundbankReader/TestGetSoundbankInputStream2.java
---    pass   javax/sound/midi/Gervill/SF2SoundbankReader/TestGetSoundbankUrl.java
fail   pass   javax/swing/JColorChooser/Test6541987.java
pass   ---    javax/xml/crypto/dsig/GenerationTests.java
pass   ---    javax/xml/crypto/dsig/ValidationTests.java
pass   ---    javax/xml/crypto/dsig/keyinfo/KeyInfo/Marshal.java
pass   ---    sun/net/idn/PunycodeTest.java
pass   ---    sun/net/idn/TestStringPrep.java
pass   ---    sun/security/pkcs11/ec/TestCurves.java
error  ---    sun/security/provider/PolicyFile/GrantAllPermToExtWhenNoPolicy.java
error  ---    sun/security/provider/PolicyParser/ExtDirs.java
error  ---    sun/security/provider/PolicyParser/ExtDirsChange.java
error  ---    sun/security/provider/PolicyParser/ExtDirsDefaultPolicy.java
error  ---    sun/security/provider/PolicyParser/PrincipalExpansionError.java
pass   fail   sun/tools/jps/jps-Defaults.sh
pass   fail   sun/tools/jps/jps-l_1.sh
pass   fail   sun/tools/jstatd/jstatdDefaults.sh
pass   fail   sun/tools/jstatd/jstatdExternalRegistry.sh
pass   fail   sun/tools/jstatd/jstatdPort.sh
pass   fail   sun/tools/jstatd/jstatdServerName.sh

49 differences

I did a quick trial run of the regression tests on windows too, but my new cygwin installs seems to be missing a few pieces and many of the shell tests fail. I assume most of those failures are spurious, so I'll wait until the cygwin install seems configured properly before rerunning and posting windows results.

OpenJDK 6: Sources for b12 published

On September 12, the OpenJDK 6 b12 source bundle was published. Changes of note in this build:

• An updated version of Gervill is included (6717691, 6740210).

• Functionality of several IcedTea patches which correct JCK failures have been applied (6735154, 6733501).

• I've ported fixes from the forthcoming 6u10 release in a subset of the component workspaces to OpenJDK 6:

  • corba (6372405, 5104239, 6191561, 6486322, 6465377, 6553303, 6372405, 6438259)

  • jaxp (6573268, 6738894)

  • jaxws (6538484, 6699090)

  • langtools (6627362, 6627364, 6627366, 6176978)

• Incorporation of various build fixes, including the gcc ciTypeFlow.cpp issue (6732815, 6734545, 6590549, 6720240, 6548261, 6681798, 6741642).

• A few more legal notices were corrected (6635663, 6719182).

• Configuration information for some networking tests can now be provided as a properties files specified on the jtreg command line; see the source for jdk/test/TestEnv.java for details (6720349).

• Assorted other fixes (6681889, 6739302, 6730743).

While the changes in this build have corrected a number of JCK 6b test failures, a handful of tests still fail; eliminating those few remaining failures is a goal for the next build or two. (JCK 6b was released several months ago and has now replaced JCK 6a as the relevant test suite to pass for Java SE 6 compatibility.)

Internally, the code for OpenJDK 6 is split into teamware workspaces with a similar structure to the JDK 7 Mercurial repositories (corba, jaxp, jaxws, langtools, jdk, etc.). For a subset of these component workspaces, I've brought over the fixes in corresponding areas from 6u10. OpenJDK 6 build 12 will be one of the last teamware-based OpenJDK 6 build before we transition to a public Mercurial repository. Around the time of the Mercurial transition we will also upgrade the HotSpot in OpenJDK 6 from HotSpot 10 to HotSpot 11; HotSpot 11 is also being used in 6u10. From that point on, the same HotSpot sources will be used for both OpenJDK 6 and the 6 update releases.

I expect build 13 within a few weeks with the Mercurial repositories to follow a few weeks after that.