BM Seer Unofficial thoughts from an anonymous Sun employee

SPECjbb2005 Sun SPARC Enterprise T5440 World Record Multi-JVM 4-Chip

Tuesday Oct 14, 2008

The Sun SPARC Enterprise T5440 with four 1.4 GHz UltraSPARC T2 Plus processors obtained the best multi-JVM 4 chip results on the SPECjbb2005 server-side Java benchmark.

A Sun SPARC Enterprise T5440 server equipped with four UltraSPARC T2 Plus processors at 1.4GHz, delivered a World Record 4-chip result of 692736 SPECjbb2005 bops, 21648 SPECjbb2005 bops/JVM. The Sun SPARC Enterprise T5440 consumed an average of 1525 Watts of power to obtain this result.

One Sun SPARC Enterprise T5440 server (four 1.4 GHz UltraSPARC T2 Plus chips) demonstrated 16% better performance over the IBM p560 result of 593904 SPECjbb2005 bops, 74238 SPECjbb2005 bops/JVM which uses eight 3.6 GHz POWER6 Dual-core chips in Quad-modules. The Sun T5440 server has 47% better power-performance than the IBM p560.

One Sun SPARC Enterprise T5440 server (four 1.4 GHz UltraSPARC T2 Plus chips) demonstrated 72% better performance over the IBM p570 result of 402923 SPECjbb2005 bops, 100731 SPECjbb2005 bops/JVM which uses four 4.7 GHz POWER6 chips. The Sun T5440 server has 2.5X better power-performance than the IBM p570.

One Sun SPARC Enterprise T5440 server (four 1.4 GHz UltraSPARC T2 Plus chips) demonstrated 36% better performance over the Dell R900 result of 508240 SPECjbb2005 bops, 132917 SPECjbb2005 bops/JVM which uses four 6-core 2.66 GHz Intel Xeon X7460 chips.

A Sun SPARC Enterprise T5440 server (four 1.4 GHz UltraSPARC T2 Plus chips) demonstrated 87% better performance over the HP DL585 G5 result of 368543 SPECjbb2005 bops, 92136 SPECjbb2005 bops/JVM which uses four quad-core 2.3 GHz AMD Opteron 8356 chips.

One Sun SPARC Enterprise T5440 server (four 1.4 GHz UltraSPARC T2 Plus chips) demonstrated 30% better performance over the Sun X4450 result of 531669 SPECjbb2005 bops, 132917 SPECjbb2005 bops/JVM which uses four 2.66 Ghz Intel Xeon X7460 chips. However, the Sun X4450 server has 2X better power-performance than the Sun T5440.

The Sun SPARC Enterprise T5440 server (four 1.4 GHz UltraSPARC T2 Plus chips) demonstrated 50% better performance over the Dell R900 result of 446209 SPECjbb2005 bops, 55776 SPECjbb2005 bops/JVM which uses four quad-core 2.93 GHz Intel Xeon X7350 chips.

One Sun SPARC Enterprise T5440 server (four 1.4 GHz UltraSPARC T2 Plus chips) demonstrated 2X better performance over the IBM p550 result of 350642 SPECjbb2005 bops, 87661 SPECjbb2005 bops/JVM which uses four 4.2 GHz POWER6 chips. The Sun T5440 server has 50% better power-performance than the IBM p550.

Power-performance is computed as watt/performance. Since power-performance is related to price/performance they are both calculated with performance in the denominator.

Competitive Landscape

SPECjbb2005 Performance Chart (ordered by performance)

bops : SPECjbb2005 Business Operations per Second (bigger is better)

System Processors Performance
Chips Cores Threads GHz /
Type 		bops bops/JVM
Sun SPARC Enterprise T5440 4 32 256 1.4 US-T2 Plus 692736 21648
IBM Power 560 8 16 32 3.6 DC POWER6 QCM 593904 74238
Dell R900 4 24 24 2.66 6C Xeon 508240 132917
Dell R900 4 16 16 2.93 QC Xeon 446209 55776
IBM p570 4 8 16 4.7 DC POWER6 402923 100731
HP DL585 G5 4 16 16 2.3 QC Opteron 368543 92136
IBM p550 4 8 16 4.2 POWER6 350642 87661

Complete benchmark results may be found at the SPEC benchmark website http://www.spec.org.

Benchmark Description

SPECjbb2005 (Java Business Benchmark) measures the performance of a Java implemented application tier (server-side Java). The benchmark is based on the order processing in a wholesale supplier application. The performance of the user tier and the database tier are not measured in this test. The metrics given are number of SPECjbb2005 bops (Business Operations per Second) and SPECjbb2005 bops/JVM (bops per JVM instance).

Disclosure Statement:

SPECjbb2005 Sun SPARC Enterprise T5440 (4 chips, 32 cores) 692736 SPECjbb2005 bops, 21648 SPECjbb2005 bops/JVM. Results submitted to SPEC. IBM p560 (8 chips, 16 cores) 593904 SPECjbb2005 bops, 74238 SPECjbb2005 bops/JVM. Results submitted to SPEC. IBM p550 (4 chips, 8 cores) 350642 SPECjbb2005 bops, 87661 SPECjbb2005 bops/JVM. IBM P570 (4 chips, 8 cores) 402923 SPECjbb2005 bops, 100731 SPECjbb2005 bops/JVM. Dell R900 (4 chips, 16 cores) 446209 SPECjbb2005 bops, 55776 SPECjbb2005 bops/JVM. Dell R900 (4 chips, 24 cores) 508240 SPECjbb2005 bops, 127060 SPECjbb2005 bops/JVM. HP DL585 G5 (4 chips, 16 cores) 368543 SPECjbb2005 bops, 92136 SPECjbb2005 bops/JVM. Sun X4450 (4 chips, 24 cores) 531669 SPECjbb2005 bops, 132917 SPECjbb2005 bops/JVM. SPEC, SPECjbb reg tm of Standard Performance Evaluation Corporation. Results from www.spec.org as of 10/13/08

Power References:

IBM p550 power specifications from 80% of maximum report power consumption published in "Facts and Features Report", 02/05/08, posted at ftp://ftp.software.ibm.com/common/ssi/pm/br/n/psb01628usen/PSB01628USEN.PDF

IBM p570 power specifications from 80% of maximum report power consumption published here, 06/07/07, posted at ftp://ftp.software.ibm.com/common/ssi/rep_sp/n/PSB01628USEN/PSB01628USEN.PDF

IBM p560 power specifications from 80% of maximum report power consumption published here, 10/10/08, posted at ftp://ftp.software.ibm.com/common/ssi/pm/sp/n/pod03014usen/POD03014USEN.PDF (2400*.8=1920)

Results Summary

Results
SPECjbb2005: 692736 SPECjbb2005 bops, 21648 SPECjbb2005 bops/JVM
Reference Date: Oct 13, 2008
Systems: Sun SPARC Enterprise T5440
Total Number Processors: 4
Processor/GHz of Server: UltraSPARC T2 Plus 1.4 GHz
Operating System: Solaris 10 10/08
JVM: Java HotSpot(TM) 32-Bit Server, Version 1.6.0_06 Performance Release

[1] Comments
Like this post? del.icio.us | furl | slashdot | technorati | digg
Posted at 02:07PM Oct 14, 2008 in Benchmark Issues
Tags:
Comments:

Hi BMSeer,

I'm just confused with your statement saying T5440 is the best specjbb2005 performance machine. In your table I can see total throughput is 692736 and probably the highest number now. This benchmark specifically for T5440 uses 32 JVMs and the performance (not througput) is only 21648/JVM whic is the lowest number in your table. By comparing to Dell R900 (6 core Xeom) the throughput is 508240 and performance is 132917/JVM which means use only 4 JVMs. This benchmark will give us two important information : CPU/Core performance and JVM performance. Unfortunately you didn't put SUN Intel/AMD machine to be compared here. However we know that SUN X4600M2 (8 chips, 32 cores) will give 683542 and the performance is 85443/JVM by runnning 8 JVMs. So it is very clear nothing so special with T5440 to run Java application because it has the lowest performance/JVM and SUN JVM performance on Intel/AMD is lower than Jrockit JVM which is used on Dell R900 benchmark. The other important thing that we have to know, by running more JVM means more memory will be needed. By looking at T5440 compared to Dell R900 (32 JVM vs 4 JVM), it is very clear that Intel wins in Java performance benchmark (the most efficient) and Jrockit is much faster than SUN JVM.

Posted by Frank on October 16, 2008 at 06:35 PM PDT #

Post a Comment:
Comments are closed for this entry.