Joseph D. Darcy's Sun Weblog

Friday November 07, 2008

OpenJDK 6: Some regression test results for b13

For regression testing of OpenJDK 6, the big news in b13 is due to work by Jon on multiple fronts; by getting out a new version of jtreg and developing a number of test fixes, all the langtools regression tests now pass when run in "samevm" mode (jtreg -s ...). As the name implies, in same vm mode a test is run in the same jvm as the previous test as opposed to starting a fresh jvm for each test, giving much speedier test results.

The base jtreg flags for these test runs were -a -ignore:quiet with -s just used for the langtools tests. On a per workspace basis, the results on Linux for OpenJDK 6 build 13 are:

• HotSpot, 5 tests pass.

• Langtools, 1,351 tests pass.

• JDK, 3,072 test pass, 23 tests fail, 3 tests have errors.

Compared to the regression test results for b12, in b13 HotSpot is unchanged:

0: ./b12-hotspot/summary.txt  pass: 5
1: ./b13-hotspot/summary.txt  pass: 5

No differences

The langtools tests now all pass:

0: ./b12-langtools/summary.txt  pass: 1,346; fail: 2
1: ./b13-langtools/summary.txt  pass: 1,351

0      1      Test
pass   ---    tools/javac/6176978/T6176978.java
---    pass   tools/javac/T6725036.java
---    pass   tools/javac/T6759996.java
---    pass   tools/javac/VersionOpt.java
---    pass   tools/javac/generics/T6657499.java
fail   pass   tools/javac/processing/model/testgetallmembers/Main.java
fail   ---    tools/javac/versionOpt.sh
---    pass   tools/javadoc/6176978/T6176978.java

8 differences

And in jdk, several dozen new tests were added and some previously failing tests pass:

0: ./b12-jdk/summary.txt  pass: 2,985; fail: 36; error: 4
1: ./b13-jdk/summary.txt  pass: 3,072; fail: 23; error: 3

0      1      Test
fail   pass   com/sun/jdi/JdbReadTwiceTest.sh
---    pass   com/sun/org/apache/xml/internal/security/exceptions/LocaleTest.java
---    pass   com/sun/org/apache/xml/internal/security/transforms/ClassLoaderTest.java
---    pass   com/sun/tools/extcheck/TestExtcheckArgs.java
fail   pass   java/awt/Focus/DeiconifiedFrameLoosesFocus/DeiconifiedFrameLoosesFocus.html
pass   fail   java/awt/Focus/FrameMinimizeTest/FrameMinimizeTest.java
fail   pass   java/awt/TextArea/UsingWithMouse/SelectionAutoscrollTest.html
fail   pass   java/io/File/Basic.java
fail   pass   java/io/File/SetAccess.java
fail   pass   java/io/File/SetReadOnly.java
---    pass   java/lang/Boolean/Factory.java
---    pass   java/lang/Boolean/GetBoolean.java
---    pass   java/lang/Boolean/MakeBooleanComparable.java
---    pass   java/lang/Boolean/ParseBoolean.java
---    pass   java/lang/Byte/Decode.java
---    pass   java/lang/Double/BitwiseConversion.java
---    pass   java/lang/Double/Constants.java
---    pass   java/lang/Double/Extrema.java
---    pass   java/lang/Double/NaNInfinityParsing.java
---    pass   java/lang/Double/ParseDouble.java
---    pass   java/lang/Double/ParseHexFloatingPoint.java
---    pass   java/lang/Double/ToHexString.java
---    pass   java/lang/Float/BitwiseConversion.java
---    pass   java/lang/Float/Constants.java
---    pass   java/lang/Float/Extrema.java
---    pass   java/lang/Float/NaNInfinityParsing.java
---    pass   java/lang/Float/ParseFloat.java
---    pass   java/lang/Integer/BitTwiddle.java
---    pass   java/lang/Integer/Decode.java
---    pass   java/lang/Integer/GetInteger.java

---    pass   java/lang/Integer/ParsingTest.java
---    pass   java/lang/Long/BitTwiddle.java
---    pass   java/lang/Long/Decode.java
---    pass   java/lang/Long/GetLong.java
---    pass   java/lang/Long/ParsingTest.java
---    pass   java/lang/Math/AbsPositiveZero.java
---    pass   java/lang/Math/Atan2Tests.java
---    pass   java/lang/Math/CubeRootTests.java
---    pass   java/lang/Math/Expm1Tests.java
---    pass   java/lang/Math/HyperbolicTests.java
---    pass   java/lang/Math/HypotTests.java
---    pass   java/lang/Math/IeeeRecommendedTests.java
---    pass   java/lang/Math/Log10Tests.java
---    pass   java/lang/Math/Log1pTests.java
---    pass   java/lang/Math/MinMax.java
---    pass   java/lang/Math/PowTests.java
---    pass   java/lang/Math/Rint.java
---    pass   java/lang/Math/TanTests.java
---    pass   java/lang/Short/ByteSwap.java
---    pass   java/lang/Short/Decode.java
---    pass   java/lang/StrictMath/CubeRootTests.java
---    pass   java/lang/StrictMath/Expm1Tests.java
---    pass   java/lang/StrictMath/HyperbolicTests.java
---    pass   java/lang/StrictMath/HypotTests.java
---    pass   java/lang/StrictMath/Log10Tests.java
---    pass   java/lang/StrictMath/Log1pTests.java
---    pass   java/lang/ToString.java
---    pass   java/lang/annotations/AnnotationTypeMismatchException/FoundType.java
---    pass   java/lang/annotations/Missing/MissingTest.java
---    pass   java/lang/annotations/ParameterAnnotations.java
---    pass   java/lang/annotations/RecursiveAnnotation.java
---    pass   java/lang/annotations/UnitTest.java
---    pass   java/lang/annotations/loaderLeak/Main.java
---    pass   java/lang/annotations/package-info.java
fail   pass   java/net/ipv6tests/TcpTest.java
error  pass   java/nio/channels/SocketChannel/AdaptSocket.java
---    pass   java/rmi/activation/Activatable/checkActivateRef/CheckActivateRef.java
---    pass   javax/sound/midi/Gervill/EmergencySoundbank/TestCreateSoundbank.java
---    pass   javax/sound/midi/Gervill/ModelByteBuffer/RandomFileInputStream/Available.java
---    pass   javax/sound/midi/Gervill/ModelByteBuffer/RandomFileInputStream/Close.java
---    pass   javax/sound/midi/Gervill/ModelByteBuffer/RandomFileInputStream/MarkReset.java
---    pass   javax/sound/midi/Gervill/ModelByteBuffer/RandomFileInputStream/MarkSupported.java
---    pass   javax/sound/midi/Gervill/ModelByteBuffer/RandomFileInputStream/Read.java
---    pass   javax/sound/midi/Gervill/ModelByteBuffer/RandomFileInputStream/ReadByte.java
---    pass   javax/sound/midi/Gervill/ModelByteBuffer/RandomFileInputStream/ReadByteIntInt.java
---    pass   javax/sound/midi/Gervill/ModelByteBuffer/RandomFileInputStream/Skip.java
---    pass   javax/xml/crypto/dsig/GenerationTests.java
---    pass   javax/xml/crypto/dsig/ValidationTests.java
---    pass   javax/xml/crypto/dsig/keyinfo/KeyInfo/Marshal.java
---    pass   sun/net/idn/PunycodeTest.java
---    pass   sun/net/idn/TestStringPrep.java
---    pass   sun/security/pkcs11/ec/TestCurves.java
fail   pass   sun/tools/jps/jps-Defaults.sh
fail   pass   sun/tools/jps/jps-l_1.sh
fail   pass   sun/tools/jstatd/jstatdDefaults.sh
fail   pass   sun/tools/jstatd/jstatdExternalRegistry.sh
fail   pass   sun/tools/jstatd/jstatdPort.sh
fail   pass   sun/tools/jstatd/jstatdServerName.sh
fail   pass   sun/tools/native2ascii/NativeErrors.java

89 differences