BM Seer Unofficial thoughts from an anonymous Sun employee

T5440 World Record SPECjAppServer Single Application Server

Monday Nov 24, 2008

One Sun SPARC Enterprise T5440 server with four UltraSPARC T2 Plus processors at 1.4GHz, delivered a single system World Record result of 6334.86 SPECjAppServer2004 JOPS@Standard. The Sun SPARC Enterprise T5440 consumed an average of 1578 Watts of power to obtain this result for a power-performance rating of 0.25 Watts/JOP.

The Sun SPARC Enterprise T5440 server (four 1.4 GHz UltraSPARC T2 Plus chips) demonstrated 32% better performance over the HP DL580 G5 result of 4410.07 SPECjAppServer2004 JOPS@Standard, which used four 2.66 GHz Intel 6-core Xeon processors.

The Sun SPARC Enterprise T5440 server (four 1.4 GHz UltraSPARC T2 Plus chips) demonstrated 75% better performance over the HP DL580 G5 result of 3339.94 SPECjAppServer2004 JOPS@Standard, which used four 2.93 GHz Intel 4-core Xeon processors.

This benchmark used the Oracle WebLogic 10.3 Application Server and Oracle Database 11g Enterprise Edition. This benchmark result proves that the Sun SPARC Enterprise T5440 server using the UltraSPARC T2 Plus processor performs as an outstanding J2EE application server as well as an Oracle 11g OLTP database server.

This result used a Sun SPARC Enterprise T5440 server (four 1.4 GHz UltraSPARC T2 Plus chips) in the database tier to obtain this World Record result. This Sun SPARC Enterprise T5440 consumed an average of 1463 Watts of power to obtain this result for a power-performance rating of 0.23 Watts/JOP.

These results were obtained using Sun Java SE 6 Update 6 Performance Release on the Sun SPARC Enterprise T5440 server and running the Solaris 10 10/08 Operating Environment.

The power-performance metric is a measure of server efficiency ratio that includes system power & performance consumption on a specific benchmark. (Power-performance = Watts / Performance).

Sun publishes watts on this SPEC benchmark, why won't HP on the 6core systems with this size memory?

Performance Landscape

SPECjAppServer2004 Performance Chart as of 10/13/2008. Complete benchmark results may be found at the SPEC benchmark website http://www.spec.org. SPECjAppServer2004 JOPS@Standard (bigger is better)

Submitter SPECjApp
Server2004
JOPS@Standard
J2EE Server DB Server
Sun 6334.86 1x Sun SPARC Enterprise T5440
32 cores, 4 chips @ 1.4 GHz US-T2 Plus
Oracle WebLogic 10.3
1x Sun SPARC Enterprise T5440
32 cores, 4 chips @ 1.4 GHz US-T2 Plus
Oracle 11g DB 11.1.0.7
HP 4410.07 1x ProLiant DL580 G5
24 cores, 4 chips @ 2.66 GHz Xeon X7460
Oracle WebLogic 10.3
1x ProLiant DL580 G5
24 cores, 4 chips @ 2.66 GHz Xeon X7460
Oracle 11g DB 11.1.0.6
HP 3339.94 1x ProLiant DL580 G5
16 cores, 4 chips @ 2.93 GHz Xeon X7350
Oracle WebLogic 10.3
1x ProLiant DL580 G5
16 cores, 4 chips @ 2.93 GHz Xeon X7350
Oracle 11g DB 11.1.0.6

Benchmark Description

SPECjAppServer2004 (Java Application Server) is a multi-tier benchmark for measuring the performance of Java 2 Enterprise Edition (J2EE) technology-based application servers. SPECjAppServer2004 is an end-to-end application which exercises all major J2EE technologies implemented by compliant application servers as follows:
  • The web container, including servlets and JSPs
  • The EJB container
  • EJB2.0 Container Managed Persistence
  • JMS and Message Driven Beans
  • Transaction management
  • Database connectivity
Moreover, SPECjAppServer2004 also heavily exercises all parts of the underlying infrastructure that make up the application environment, including hardware, JVM software, database software, JDBC drivers, and the system network.

The primary metric of the SPECjAppServer2004 benchmark is jAppServer Operations Per Second (JOPS) which is calculated by adding the metrics of the Dealership Management Application in the Dealer Domain and the Manufacturing Application in the Manufacturing Domain. There is NO price/performance metric in this benchmark.

Results Summary

Results 6334.86 SPECjAppServer2004 JOPS@Standard
Reference Date: Nov 20, 2008
Systems: 2x Sun SPARC Enterprise T5440
Total Number Processors: 4, 4
Processor/GHz of Server: UltraSPARC T2 Plus 1.4 GHz
Operating System: Solaris 10 10/08
Software: Oracle WebLogic 10.3 Application Server, Standard Edition
Oracle Database Enterprise Edition Release 11.1.0.7
JVM: JDK 1.6.0_06 Performance Release

Disclosure Statement:

SPECjAppServer2004
Sun SPARC Enterprise T5440 (4 chips, 32 cores) 6334.86 SPECjAppServer2004 JOPS@Standard. HP DL580 G5 (4 chips, 24 cores) 4410.07 SPECjAppServer2004 JOPS@Standard. HP DL580 G5 (4 chips, 16 cores) 3339.94 SPECjAppServer2004 JOPS@Standard. SPEC, SPECjAppServer reg tm of Standard Performance Evaluation Corporation. Results from www.spec.org as of 10/13/08

SPECjAppServer2004 Sun SPARC Enterprise T5240 (16 cores, 2 chip) 3331.31 SPECjAppServer2004 JOPS@Standard. IBM p570(4 cores, 2 chips) 1197.51 SPECjAppServer2004 JOPS@Standard. IBM p550(4 cores, 2 chips) 1197.51 SPECjAppServer2004 JOPS@Standard. SPEC, SPECjAppServer reg tm of Standard Performance Evaluation Corporation. Results from www.spec.org as of 04/09/2008. Power References: IBM p6 570 power specifications from 80% of maximum report power consumption published here, 06/07/07, posted at ftp://ftp.software.ibm.com/common/ssi/rep_sp/n/PSB01628USEN/PSB01628USEN.PDF IBM p5 power specifications calculated by applying 70% of the power numbers published in ?Facts and Features Report?, 3/10/06, posted at http://www-03.ibm.com/servers/eserver/pseries/hardware/factsfeatures.html

[4] Comments
Like this post? del.icio.us | furl | slashdot | technorati | digg
Comments:

I'd like to see HP results using Java 6u6p performance release instead of JRockit R27.6...

I'm not saying that their results would be better than yours, I'm only saying that I would like to know it :-) I mean, we are always in doubt about how JVM and parameter tuning affect to hardware scores...

Best regards

Posted by J on November 24, 2008 at 12:46 PM PST #

Having watched HP benchmark results for a long time, I imagine it will be a long time before they publish on this benchmark again. They have been beaten and they don't want to keep proving they are slower.

I don't see any way that SW tuning will get those 6-cores near CMT.

Posted by BM Seer on November 24, 2008 at 12:53 PM PST #

Bmseer,

The SPEC benchmarking organisation has processes and procedures in place to make sure that the information and results posted at www.spec.org are of high quality, however it is the wrong nomenclature to say that SPECjAppServer2004 results are "certified" in fact results are reviewed and "accepted" if they are deemed to follow the SPECjAppServer2004 run rules. Can I suggest you should change this blog entry to say published or accepted rather than "certified"

regards
Tom Daly

Posted by Tom on November 24, 2008 at 09:24 PM PST #

Sure no problem fixing typos. I got these words from an internal doc, I now see it has also been fixed.

By the way it is BM Seer not Bmseer :)

Posted by BM Seer on November 25, 2008 at 05:44 AM PST #

Post a Comment:
Comments are closed for this entry.