Monday October 19, 2009 Joseph D. Darcy's Sun Weblog
Joseph D. Darcy's Sun Weblog
Monday October 19, 2009 OpenJDK 6: b17 regression test results
Running with the usual jtreg flags, -a -ignore:quiet always and -s for the langtools area, the basic regression test results on Linux for OpenJDK 6 build 17 are:
With the sync of HotSpot 14 into OpenJDK 6, more tests were added:
0: b16-hotspot/summary.txt pass: 3 1: b17-hotspot/summary.txt pass: 24 0 1 Test --- pass compiler/6646019/Test.java --- pass compiler/6646020/Tester.java --- pass compiler/6661247/Test.java --- pass compiler/6663848/Tester.java --- pass compiler/6689060/Test.java --- pass compiler/6695810/Test.java --- pass compiler/6700047/Test6700047.java --- pass compiler/6711100/Test.java --- pass compiler/6712835/Test6712835.java --- pass compiler/6714694/Tester.java --- pass compiler/6716441/Tester.java --- pass compiler/6726999/Test.java --- pass compiler/6741738/Tester.java --- pass compiler/6756768/Test6756768.java --- pass compiler/6756768/Test6756768_2.java --- pass compiler/6757316/Test6757316.java --- pass compiler/6758234/Test6758234.java --- pass compiler/6775880/Test.java --- pass compiler/6795362/Test6795362.java --- pass compiler/6805724/Test6805724.java --- pass runtime/6819213/TestBootNativeLibraryPath.java 21 differences
In langtools all the tests continue to pass; a few tests were rearranged and some more tests were added:
0: b16-langtools/summary.txt pass: 1,352 1: b17-langtools/summary.txt pass: 1,354 0 1 Test --- pass tools/javac/T6558476.java --- pass tools/javac/T6882235.java --- pass tools/javac/annotations/pos/TrailingComma.java pass --- tools/javac/api/6440333/T6440333.java pass --- tools/javac/api/Sibling.java pass --- tools/javac/innerClassFile/Driver.java --- pass tools/javac/innerClassFile/Driver.sh pass --- tools/javac/links/T.java --- pass tools/javac/links/links.sh --- pass tools/javac/processing/model/util/elements/TestGetConstantExpression.java 10 differences
And in jdk, a few dozen new tests were added in b17 and the existing tests have generally consistent results:
(2009-10-19 14:44:32.0) Permalink Comments [2]0: b16-jdk/summary.txt pass: 3,085; fail: 29; error: 4 1: b17-jdk/summary.txt pass: 3,118; fail: 26 0 1 Test error pass com/sun/jdi/DoubleAgentTest.java --- pass com/sun/jndi/dns/CheckAccess.java --- pass com/sun/org/apache/xml/internal/security/TruncateHMAC.java --- pass com/sun/security/sasl/util/CheckAccess.java fail pass java/awt/Focus/FrameMinimizeTest/FrameMinimizeTest.java fail pass java/awt/Graphics/DrawImageBG/SystemBgColorTest.java error --- java/awt/PrintJob/EdgeTest/EdgeTest.java error pass java/awt/PrintJob/MultipleEnd/MultipleEnd.java fail pass java/awt/print/PrinterJob/ExceptionTest.java --- pass java/beans/Introspector/Test6660539.java --- pass java/beans/XMLEncoder/6777487/TestBox.java --- pass java/beans/XMLEncoder/6777487/TestCheckedCollection.java --- pass java/beans/XMLEncoder/6777487/TestCheckedList.java --- pass java/beans/XMLEncoder/6777487/TestCheckedMap.java --- pass java/beans/XMLEncoder/6777487/TestCheckedRandomAccessList.java --- pass java/beans/XMLEncoder/6777487/TestCheckedSet.java --- pass java/beans/XMLEncoder/6777487/TestCheckedSortedMap.java --- pass java/beans/XMLEncoder/6777487/TestCheckedSortedSet.java --- pass java/beans/XMLEncoder/6777487/TestEnumMap.java --- pass java/beans/XMLEncoder/6777487/TestEnumSet.java --- pass java/lang/Double/ToString.java --- pass java/nio/channels/Selector/RegAfterPreClose.java fail pass java/rmi/transport/pinLastArguments/PinLastArguments.java --- pass java/security/AccessControlContext/FailureDebugOption.java --- pass java/util/SimpleTimeZone/EndOfDay.java --- pass java/util/TimeZone/ListTimeZones.java --- pass javax/sound/midi/Gervill/SoftChannel/NoteOverFlowTest2.java --- pass javax/sound/midi/Gervill/SoftReceiver/GetMidiDevice.java --- pass javax/sound/midi/Gervill/SoftSynthesizer/TestPreciseTimestampRendering.java --- fail javax/swing/JTextArea/Test6593649.java --- pass javax/swing/plaf/synth/Test6660049.java --- pass javax/swing/text/LayoutQueue/Test6588003.java --- pass sun/pisces/JoinMiterTest.java error pass sun/security/ssl/javax/net/ssl/NewAPIs/SessionTimeOutTests.java --- pass tools/pack200/MemoryAllocatorTest.java 35 differences
Trackback URL: http://blogs.sun.com/darcy/entry/openjdk_6_b17_regression_tests
Post a Comment:
Calendar
| « November 2009 | ||||||
| Sun | Mon | Tue | Wed | Thu | Fri | Sat |
|---|---|---|---|---|---|---|
1 | 2 | 3 | 5 | 6 | 7 | |
8 | 9 | 10 | 11 | 12 | 13 | 14 |
15 | 16 | 17 | 19 | 20 | 21 | |
22 | 23 | 24 | 25 | 26 | 27 | 28 |
29 | 30 | |||||
| Today | ||||||
RSS Feeds
All
/Annotation Processing
/General
/Java
/JavaOne
/Numerics
/OpenJDK
Search
Links
- Blogroll
-
- News
Navigation
Referers
Today's Page Hits: 779
Are the failures / errors captured in bug tracker yet (https://bugs.openjdk.java.net/ or http://bugs.sun.com)?
Any plans for CI builds (maybe hudson http://hudson-ci.org/) with bugs getting capture in any of the above bug trackers when failure occurs?
I assume the change planning (http://openjdk.java.net/guide/changePlanning.html#bug) is the best way for open developer to start helping to fix these right (after necessary paperwork for submissions)...right?
Posted by Eric B on October 27, 2009 at 08:35 AM PDT #
@Eric B,
We're considered setting up a Hudson system for OpenJDK 6, but haven't gotten around to that yet. In general, the long-standing regression test failures may not have particular bugs created for them, but their absolute number and percentage of the total number of tests is declining over time.
To get involved in OpenJDK 6, I recommend joining the jdk6-dev@openjdk.java.net mailing list.
Posted by Joe Darcy on October 28, 2009 at 03:32 PM PDT #