Tuesday Oct 14, 2008
The Sun SPARC Enterprise T5440 with four 1.4 GHz UltraSPARC T2 Plus
processors obtained the best multi-JVM 4 chip results on the
SPECjbb2005 server-side Java benchmark.
A Sun SPARC Enterprise T5440 server equipped with four UltraSPARC T2
Plus processors at 1.4GHz, delivered a World Record 4-chip result of
692736 SPECjbb2005 bops, 21648 SPECjbb2005 bops/JVM. The Sun SPARC
Enterprise T5440 consumed an average of 1525 Watts of power to obtain
this result.
One Sun SPARC Enterprise T5440 server (four 1.4 GHz UltraSPARC T2 Plus
chips) demonstrated 16% better performance over the IBM p560 result of
593904 SPECjbb2005 bops, 74238 SPECjbb2005 bops/JVM which uses eight
3.6 GHz POWER6 Dual-core chips in Quad-modules. The Sun T5440 server
has 47% better power-performance than the IBM p560.
One Sun SPARC Enterprise T5440 server (four 1.4 GHz UltraSPARC T2 Plus
chips) demonstrated 72% better performance over the IBM p570 result of
402923 SPECjbb2005 bops, 100731 SPECjbb2005 bops/JVM which uses four
4.7 GHz POWER6 chips. The Sun T5440 server has 2.5X better
power-performance than the IBM p570.
One Sun SPARC Enterprise T5440 server (four 1.4 GHz UltraSPARC T2 Plus
chips) demonstrated 36% better performance over the Dell R900 result of
508240 SPECjbb2005 bops, 132917 SPECjbb2005 bops/JVM which uses four
6-core 2.66 GHz Intel Xeon X7460 chips.
A Sun SPARC Enterprise T5440 server (four 1.4 GHz UltraSPARC T2 Plus
chips) demonstrated 87% better performance over the HP DL585 G5 result
of 368543 SPECjbb2005 bops, 92136 SPECjbb2005 bops/JVM which uses four
quad-core 2.3 GHz AMD Opteron 8356 chips.
One Sun SPARC Enterprise T5440 server (four 1.4 GHz UltraSPARC T2 Plus
chips) demonstrated 30% better performance over the Sun X4450 result of
531669 SPECjbb2005 bops, 132917 SPECjbb2005 bops/JVM which uses four
2.66 Ghz Intel Xeon X7460 chips. However, the Sun X4450 server has 2X
better power-performance than the Sun T5440.
The Sun SPARC Enterprise T5440 server (four 1.4 GHz UltraSPARC T2 Plus
chips) demonstrated 50% better performance over the Dell R900 result of
446209 SPECjbb2005 bops, 55776 SPECjbb2005 bops/JVM which uses four
quad-core 2.93 GHz Intel Xeon X7350 chips.
One Sun SPARC Enterprise T5440 server (four 1.4 GHz UltraSPARC T2 Plus
chips) demonstrated 2X better performance over the IBM p550 result of
350642 SPECjbb2005 bops, 87661 SPECjbb2005 bops/JVM which uses four 4.2
GHz POWER6 chips. The Sun T5440 server has 50% better power-performance
than the IBM p550.
Power-performance is computed as watt/performance. Since
power-performance is related to price/performance they are both
calculated with performance in the denominator.
Competitive Landscape
SPECjbb2005 Performance Chart (ordered by performance)
bops : SPECjbb2005 Business Operations per Second (bigger is better)
| System |
Processors |
Performance |
| Chips |
Cores |
Threads |
GHz /
Type |
bops |
bops/JVM |
| Sun SPARC Enterprise T5440 |
4 |
32 |
256 |
1.4 US-T2 Plus |
692736 |
21648 |
| IBM Power 560 |
8 |
16 |
32 |
3.6 DC POWER6 QCM |
593904 |
74238 |
| Dell R900 |
4 |
24 |
24 |
2.66 6C Xeon |
508240 |
132917 |
| Dell R900 |
4 |
16 |
16 |
2.93 QC Xeon |
446209 |
55776 |
| IBM p570 |
4 |
8 |
16 |
4.7 DC POWER6 |
402923 |
100731 |
| HP DL585 G5 |
4 |
16 |
16 |
2.3 QC Opteron |
368543 |
92136 |
| IBM p550 |
4 |
8 |
16 |
4.2 POWER6 |
350642 |
87661 |
Complete benchmark results may be found at the SPEC benchmark website http://www.spec.org.
Benchmark Description
SPECjbb2005 (Java Business Benchmark) measures the performance of a Java implemented application tier (server-side Java). The benchmark is based on the order processing in a wholesale supplier application. The performance of the user tier and the
database tier are not measured in this test. The metrics given are number of SPECjbb2005 bops (Business Operations per Second) and SPECjbb2005 bops/JVM (bops per JVM instance).
Disclosure Statement:
SPECjbb2005
Sun SPARC Enterprise T5440 (4 chips, 32 cores) 692736 SPECjbb2005 bops, 21648 SPECjbb2005 bops/JVM. Results submitted to SPEC.
IBM p560 (8 chips, 16 cores) 593904 SPECjbb2005 bops, 74238 SPECjbb2005 bops/JVM. Results submitted to SPEC.
IBM p550 (4 chips, 8 cores) 350642 SPECjbb2005 bops, 87661 SPECjbb2005 bops/JVM.
IBM P570 (4 chips, 8 cores) 402923 SPECjbb2005 bops, 100731 SPECjbb2005 bops/JVM.
Dell R900 (4 chips, 16 cores) 446209 SPECjbb2005 bops, 55776 SPECjbb2005 bops/JVM.
Dell R900 (4 chips, 24 cores) 508240 SPECjbb2005 bops, 127060 SPECjbb2005 bops/JVM.
HP DL585 G5 (4 chips, 16 cores) 368543 SPECjbb2005 bops, 92136 SPECjbb2005 bops/JVM.
Sun X4450 (4 chips, 24 cores) 531669 SPECjbb2005 bops, 132917 SPECjbb2005 bops/JVM.
SPEC, SPECjbb reg tm of Standard Performance Evaluation Corporation.
Results from www.spec.org as of 10/13/08
Power References:
IBM p550 power specifications from 80% of maximum report power consumption
published in "Facts and Features Report", 02/05/08, posted at
ftp://ftp.software.ibm.com/common/ssi/pm/br/n/psb01628usen/PSB01628USEN.PDF
IBM p570 power specifications from 80% of maximum report power consumption
published here, 06/07/07, posted at
ftp://ftp.software.ibm.com/common/ssi/rep_sp/n/PSB01628USEN/PSB01628USEN.PDF
IBM p560 power specifications from 80% of maximum report power consumption
published here, 10/10/08, posted at
ftp://ftp.software.ibm.com/common/ssi/pm/sp/n/pod03014usen/POD03014USEN.PDF (2400*.8=1920)
Results Summary
|
Results
|
|
|
SPECjbb2005:
|
|
692736 SPECjbb2005 bops, 21648 SPECjbb2005 bops/JVM
|
|
|
Reference Date:
|
|
Oct 13, 2008
|
|
Systems:
|
|
Sun SPARC Enterprise T5440
|
|
Total Number Processors:
|
|
4
|
|
Processor/GHz of Server:
|
|
UltraSPARC T2 Plus 1.4 GHz
|
|
Operating System:
|
|
Solaris 10 10/08
|
|
JVM:
|
|
Java HotSpot(TM) 32-Bit Server, Version 1.6.0_06 Performance Release
|
Tuesday Oct 14, 2008
Outperforms IBM Cell Broadband Engine, and Significantly Simpler Applications Code Development!
Note: When I blogged that IBM was slowly getting more cores per chip (power6 is only dual-core, new p560 is Quad-core module but still DC chips), a comment said that IBM had made huge advances in Multi-core with the cell processor. Well quite simply, the IBM Cell is difficult to program. see below in the IBM paper where IBM researchers describe elaborate optimizations of the Aho-Corasick algorithm to:
(1) overcome "memory congestion", i.e., contention amongst the SPEs, and
(2) compensate for the limited local storage that is associated with each SPE.
...but what about performance, read on...
Significance of Sun's Results
String searching or pattern matching are important to a variety of
commercial, government and HPC applications. One of the core
functions needed for text identification algorithms in data
repositories is real-time string searching. Another application example is computer virus detection. For this benchmark, the
IBM, HP and Sun systems used the Aho-Corasick algorithm for string
searching.
A Sun SPARC Enterprise T5440 could search a book as tall as Mt. Everest
(29,208 feet, 861 GB book) in 68 seconds, which corresponds to a string
search rate of 12.72 GB/s.
A Sun SPARC Enterprise T5440 can search at a rate of 12.72 GB/s, which
corresponds to searching a book containing one terabyte of data (34,745
feet high) in only 79 seconds.
The 4-chip Sun SPARC Enterprise T5240 performed string searching at a rate of 12.7 GB/s which is 26.8 times faster than the 2-chip IBM Cell Broadband Engine DD3 Blade that performed string searching at a rate of 0.475 GB/s
The 4-chip Sun SPARC Enterprise T5440 performed string searching 3.3 times faster than the 4-chip HP DL-580 (2.93 GHz Xeon QC) that performed string searching at a rate of 3.87 GB/s. On other tests we have measured the power consumption of the HP DL-580 (2.93 GHz Xeon QC) to be 830 watts. Using this value for the power consumption of the HP DL-580, Sun estimates the Sun SPARC Enterprise T5440 to have a 1.8 times advantage in delivered power-performance.
The Aho-Corasick algorithm as deployed on the IBM Cell Broadband
Engine DD3 Blade required substantial optimization and tuning to achieve the
reported performance, whereas on the Sun SPARC Enterprise T5220, T5240 or T5440
only a basic implementation of the algorithm and a simple compilation were
needed.
The Sun SPARC Enterprise T5440 demonstrated a 2x speedup over the Sun
SPARC Enterprise T5240, which demonstrated a 2x speedup over the Sun
SPARC Enterprise T5220.
The 2-chip Sun SPARC Enterprise T5240 performed string searching at a rate of 6.36 GB/s which is 13.4 times faster than the 2-chip IBM Cell Broadband Engine DD3 Blade that performed string searching at a rate of 0.475 GB/s.
The 2-chip Sun SPARC Enterprise T5440 performed string searching 1.6 times faster than the 4-chip HP DL-580 (2.93 GHz Xeon QC) that performed string searching at a rate of 3.87 GB/s.
The 1-chip Sun SPARC Enterprise T5220 performed string searching at a rate of 3.16 GB/s which is 6.7 times faster than the 2-chip IBM Cell Broadband Engine DD3 Blade that performed string searching at a rate of 0.475 GB/s.
Performance Landscape (in GBytes/sec)
| System |
Throughput
(GB/sec) |
Chips |
Cores |
GHz |
Sun SPARC Enterprise
T5440 |
12.7 |
4 |
32 |
1.4 |
Sun SPARC Enterprise
T5240 |
6.4 |
2 |
16 |
1.4 |
| HP DL-580 |
3.9 |
4 |
16 |
2.9 |
Sun SPARC Enterprise
T5220 |
3.2 |
1 |
8 |
1.4 |
IBM Cell Broadband Engine
DD3 Blade |
0.48 |
2 |
16 |
3.2 |
Benchmark Description
One of the core functions needed for text identification algorithms in data
repositories is real-time string searching. This string searching benchmark
demonstrates the usefulness of Sun's UltraSPARC T2 and T2 Plus processors for
both ease of code creation and speed of code execution.
In IEEE Computer, Volume 41, Number 4, pp. 42-50, April 2008, IBM describes a
variant of the Aho-Corasick string searching algorithm that uses deterministic
finite automata. The algorithm first constructs a graph that represents a
dictionary, then walks that graph using successive input characters from a text
file. Each "state" in the graph includes a state transition table (STT)
that is accessed using the next input character from the text file to
determine the address of the next state in the graph. IBM defines an automaton
as a two-step loop that: (1) obtains the address of the next state from the
STT, and (2) fetches the next state in the graph.
IBM reports the performance of its Cell Broadband Engine (CBE) to execute this
algorithm to search a 4.4 MB version of the King James Bible using a dictionary
of the 20,000 most used words in the English language (average word length of
7.59 characters). Each of the 8 synergistic processing elements (SPEs) of each
of the two CBEs executes 16 automata, for a total of 256 automata.
All automata and hence all SPEs access a single, shared dictionary.
IBM describes elaborate optimizations of the Aho-Corasick algorithm, including
state shuffling, state replication, alphabet shuffling and state caching.
These optimizations were required to: (1) overcome "memory congestion", i.e.,
contention amongst the SPEs for access to the shared dictionary, and (2)
compensate for the limited local storage that is associated with each SPE.
These optimizations were necessary to achieve the performance reported for
the CBE DD3 Blade.
In order to closely approximate the dictionary and Bible that were used by IBM,
Sun used a dictionary of 25,143 English words (the Open Solaris
file cvs.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/cmd/spell/list)
for which the average word length is 7.2 characters, and a 4.6 MB version
of the King James Bible (www.patriot.net/users/bmcgin/kjv12.zip). For
reporting of results in Gbits/s, the length of a byte is assumed to be 8 bits.
In order to demonstrate the usefulness of Sun's UltraSPARC T2 and T2 Plus
processors for both ease of code generation and speed of code execution, Sun
implemented the Aho-Corasick algorithm using ANSI C. No optimizations of the
algorithm were required to achieve the performance reported for the T5220,
T5240 and T5440.
Disclosure Statement:
String Searching: Sun SPARC Enterprise T5440 (4 x 1.4 GHz UltraSPARC T2 Plus, 4 chips, 32 cores),
Solaris 10, Sun C 5.9, 12.7 GB/sec; Sun SPARC Enterprise T5240 (2 x 1.4 GHz UltraSPARC T2 Plus, 2 chips, 16 cores),
Solaris 10, Sun C 5.9, 6.36 GB/sec;
Sun SPARC Enterprise T5220 (1 x 1.4 GHz UltraSPARC T2, 1 chip, 8 cores),
Solaris 10, Sun C 5.9, 3.16 GB/sec;
IBM Cell Broadband Engine DD3 Blade (2 x 3.2 GHz Cell Broadband Engine,
2 chips, 16 cores), Linux kernel v2.6.16, IBM CBE Software Development Kit
v2.1, 0.475 GB/sec. HP DL-580 (4 x 2.9 GHz Intel Xeon X7350, 4 chips, 16 cores), SuSE Linux Enterprise Server v10 patch 1, Sun C 5.9, 3.87 GB/sec.
IBM results are obtained from Figure 7(d) of
IEEE Computer, Volume 41, Number
4, pp. 42-50, April 2008. Sun benchmark results as of 10/13/2008.
Results Summary
| |
|
12.7 T5440 |
| |
|
6.36 T5240 |
| Throughput (GB/sec) |
|
3.16 T5220 |
| Reference Date: |
|
October 13, 2008 |
| Systems: |
|
Sun SPARC Enterprise T5220, T5240, T5440
|
| Total Number Processors: |
|
1, 2, 4 |
| Processor/GHz of Server: |
|
1.4 GHz UltraSPARC T2, T2 Plus |
| Operating System: |
|
Solaris 10 |
Monday Oct 13, 2008
...I'll end my day with info on an HPC benchmark...
The Sun SPARC Enterprise T5440 server
delivers the best performance on the SPEC OMPL2001
benchmark for four chips.
These results were run on the Sun SPARC Enterprise T5440 server
using the UltraSPARC T2 Plus processor running at 1.4 GHz.
The Sun SPARC Enterprise T5440 system with 1.4GHz UltraSPARC T2 Plus
processors delivered a SPECompL2001 result of 235655, the fastest result
using 4 chips or less.
The Sun SPARC Enterprise T5440 system equiped with 1.4GHz UltraSPARC T2 Plus
processors delivered more than 1.6X the performance of a 4 socket 2.5GHz AMD
Opteron 8360 based system as shown by SPECompL2001 benchmark results.
The Sun SPARC Enterprise T5440 system equiped with 1.4GHz UltraSPARC T2 Plus
processors delivered more than 2.9X the performance of a 4 socket 2.93GHz
Intel Xeon X7350 based system as shown by SPECompL2001 benchmark results.
The Sun SPARC Enterprise T5440 system with four 1.4GHz UltraSPARC T2 Plus
processors with 128GB of memory delivered a result of 228198 SPECompLpeak2001
and 203416 SPECompLbase2001.
SPECompL2001 Performance Chart -
(bigger is better, Select 2 chip or less results ordered by peak metric )
| Result |
Chips |
Cores |
OpenMP
Thrds |
System |
| Peak |
Base |
| 235655 |
208492 |
4 |
32 |
255 |
Sun SPARC Enterprise T5440, UltraSPARC T2 Plus, 1.4GHz |
| - |
146796 |
4 |
16 |
16 |
AMD Tyan n425QE, QC Opt 8360, 2.5GHz |
| - |
141858 |
4 |
16 |
16 |
AMD Tyan n425QE, QC Opt 8356, 2.3GHz |
| - |
82487 |
4 |
16 |
16 |
Supermicro X7QC3, QC Xeon X7350, 2.93GHz |
Benchmark Description
The SPEC OMPL2001 Benchmark Suite was released in 2002 and
tests HPC performance using OpenMP for parallelism on larger systems.
-
9 programs (2 in C and 7 in Fortran)
parallelized using OpenMP API
Goals of suite:
- Targeted to large parallel shared-memory systems
- Run rules, tools and reporting similar to SPEC CPU2000
- Programs representative of HPC and Scientific Applications
Disclosure Statement:
SPEC, SPEComp reg tm of Standard Performance Evaluation Corporation.
Results from www.spec.org as of 10/8/08 and this report.
Sun SPARC Enterprise T5440 (4 chips, 32 cores, 256 threads, 1.4GHz)
235655 SPECompL2001.
SPEC, SPEComp reg tm of Standard Performance Evaluation Corporation.
Results from www.spec.org as of 10/8/08 and this report.
Sun SPARC Enterprise T5440 (4 chips, 32 cores, 256 threads, 1.4GHz)
235655 SPECompL2001; Tyan Thunder n425QE (4 chips, 16 cores, 16 threads,
2.5GHz) 146796 SPECompL2001.
SPEC, SPEComp reg tm of Standard Performance Evaluation Corporation.
Results from www.spec.org as of 10/8/08 and this report.
Sun SPARC Enterprise T5440 (4 chips, 32 cores, 256 threads, 1.4GHz)
235655 SPECompL2001; SPECompL2001; Supermicro X7QC3 (4 chips, 16 cores,
16 threads, 2.93GHz) 82487 SPECompL2001.
Results Summary
| Result |
|
Sun SPARC Enterprise T5440: |
|
235655 SPECompL2001 |
|
|
|
208492 SPECompLbase2001 |
| Reference Date: |
|
Oct 13, 2008 |
| Operating System: |
|
Solaris 10 |
| Compiler: |
|
Sun Studio 12 |
Monday Oct 13, 2008
The Sun SPARC Enterprise T5440 server with four 1.4 GHz UltraSPARC
T2 Plus processors achieving 7520 SD benchmark users on the two-tier SAP Sales and
Distribution (SD) standard SAP ERP 6.0 (2005) application benchmark.
The Sun SPARC Enterprise T5440 server with four 1.4 GHz UltraSPARC T2 Plus
processors achieved over 37,000 SAPS.
The Sun SPARC Enterprise T5440 server with four 1.4 GHz UltraSPARC T2 Plus processors
showed 80% improvement compared to Sun SPARC Enterprise T5240 with two
1.4 GHz UltraSPARC T2 PLUS processors.
SAP does not allow any SWaP or price-performance comparisons to be made.
The Sun SPARC Enterprise T5440 server with four 1.4 GHz UltraSPARC T2 Plus processors
outperformed all 2-chip and 4-chip systems.
The 16-core 16RU IBM p570 POWER6 used four times the space of the 4RU
Sun SPARC Enterprise T5440 system.
The Solaris Operating System, used in this benchmark, clearly demonstrates
that the system can support over seven thousand concurrent users accessing the
SAP application server.
This benchmark was run with Oracle 10g. Oracle 10g performed very well
on the Sun SPARC Enterprise T5440 server.
SAP-SD 2-Tier Performance Table (in decreasing performance order, Benchmark Users, bigger is better)
| System |
Users |
Chips,
Type
GHz |
Mem |
OS |
DB |
LI/Hr |
SAPS |
BM rev |
Date |
| IBM p 570 |
8000 |
8 DC POWER6 4.7 |
128 GB |
AIX 5L Ver 5.3 |
DB2 9 |
801,330 |
40,070 |
6.0 |
21-May-07 |
| Sun SPARC Enterprise T5440 |
7520 |
4 US T2 Plus 1.4 |
128 GB |
Solaris 10 |
Oracle 10g |
753,000 |
37,647 |
6.0 |
10-Oct-08 |
| HP ProLiant DL580 G5 |
5155 |
4 6C Xeon 2.66 |
64 GB |
Win- dows Server 2003 EE |
SQL Server 2005 |
516,670 |
25,830 |
6.0 |
12-Sep-08 |
| HP ProLiant BL680c G5 |
4432 |
4 6C Xeon 2.4 |
64 GB |
Win- dows Server 2003 EE |
SQL Server 2005 |
443,670 |
22,180 |
6.0 |
12-Sep-08 |
| Sun SPARC Enterprise T5240 |
4170 |
2 US T2 Plus 1.4 |
128 GB |
Solaris 10 |
Oracle 10g |
418,000 |
20,900 |
6.0 |
09-Apr-08 |
| IBM p 570 |
4010 |
4 DC POWER6 4.7 |
64 GB |
AIX 5L Version 5.3 |
Oracle 10g |
402,330 |
20,120 |
6.0 |
21-May-07 |
| HP ProLiant DL585 G5 |
3801 |
4 QC Opteron 2.5 |
64 GB |
Win- dows Server 2003 EE |
SQL Server 2005 |
380,330 |
19,020 |
6.0 |
11-Jul-08 |
| HP ProLiant BL685c G5 |
3524 |
4 QC Opteron 2.3 |
64 GB |
Win- dows Server 2003 EE |
SQL Server 2005 |
353,000 |
17,650 |
6.0 |
28-Mar-08 |
| IBM p 550 |
3104 |
4 POWER6 4.2 |
64 GB |
Redhat Enter. Linux 5 |
DB2 9.5 |
312,670 |
15,630 |
6.0 |
29-Jan-08 |
| Sun SPARC Enterprise T5120 |
2175 |
1 US T2 1.4 |
64 GB |
Solaris 10 |
Oracle 10g |
219,000 |
10,950 |
6.0 |
09-Oct-07 |
| HP ProLiant DL385 G5 |
2102 |
2 QC Opteron 2.3 |
32 GB |
Win- dows Server 2003 EE |
SQL Server 2005 |
210,330 |
10,520 |
6.0 |
28-Mar-08 |
| HP Integrity BL860C |
1165 |
2 DC Itan2 1.66 |
24 GB |
HP-UX 11i v3 |
Oracle 10g |
117,000 |
5,850 |
6.0 |
22-Sep-08 |
Complete benchmark results may be found at the SAP benchmark website http://www.sap.com/benchmark.
Benchmark Description
The SAP Standard Application SD (Sales and Distribution) Benchmark is a
two-tier ERP business test that is indicative of full business workloads
of complete order processing and invoice processing, and demonstrates the
ability to run both the application and database software on a single
system. The SAP Standard Application SD Benchmark represents the critical
tasks performed in real-world ERP business environments.
SAP is one of the premier world-wide ERP application providers, and maintains
a suite of benchmark tests to demonstrate the performance of competitive
systems on the various SAP products.
Disclosure Statement:
Two-tier SAP Standard Sales and Distribution (SD) standard SAP ERP 6.0 (2005) application benchmark:
SPARC Enterprise Model T5440 (4-way, 4 processors, 32 cores, 256 threads) 4 x 1.4 GHz
UltraSPARC T2 Plus, 128GB memory, 7520 SD Benchmark users, 1.98 sec avg response time,
Cert#2008058, Oracle 10g, Solaris 10;
SPARC Enterprise Model T5240 (2-way, 2 processors, 16 cores, 128 threads) 2 x 1.4 GHz
UltraSPARC T2 Plus, 128GB memory, 4170 SD Benchmark users, 1.97 sec avg response time,
Cert#2008021, Oracle 10g, Solaris 10;
SPARC Enterprise Model T5120 (1-way, 1 proc, 8 cores, 64 threads) 1 x 1.4 GHz
UltraSPARC T2, 64GB memory, 2175 SD Benchmark users, 1.91 sec avg response time,
Cert#2007059, Oracle 10g, Solaris 10;
IBM System p 570 (8-way, 8 processors, 16 cores, 32 threads) 8 x 4.7 GHz
POWER6+, 128GB memory, 8000 SD Benchmark users, 1.98s avg resp time, Cert#2007039,
DB2 9, AIX 5L Version 5.3;
IBM System p 570 (4-way, 4 processors, 8 cores, 16 threads) 4 x 4.7 GHz
POWER6+, 64GB memory, 4010 SD Benchmark users, 1.96s avg resp time, Cert#2007038,
Oracle 10g, AIX 5L Version 5.3;
IBM System p 550 (4-way, 4 processors, 8 cores, 16 threads) 4 x 4.2 GHz
POWER6+, 64GB memory, 3104 SD Benchmark users, 1.91s avg resp time, Cert#2008002,
DB2 9, Redhat Enterprise Linux 5;
HP ProLiant DL580 G5 (4-way, 4 processors, 24 cores, 24 threads)
4 x 2.66 GHz Intel Xeon, 64GB memory, 5155 SAP SD Benchmark users,
1.97 sec avg response time, Cert#2008050, SQL Server 2005,
Windows Server 2003 Enterprise Edition;
HP ProLiant BL680c G5 (4-way, 4 processors, 24 cores, 24 threads)
4 x 2.4 GHz Intel Xeon, 64GB memory, 4432 SAP SD Benchmark users,
1.99 sec avg response time, Cert#2008049, SQL Server 2005,
Windows Server 2003 Enterprise Edition;
HP ProLiant DL585 G5 (4-way, 4 processors, 16 cores, 16 threads)
4 x 2.5 GHz Quad-Core AMD Opteron, 64GB memory, 3801 SAP SD Benchmark users,
1.99 sec avg response time, Cert#2008041, SQL Server 2005,
Windows Server 2003 Enterprise Edition;
HP ProLiant BL685c G5 (4-way, 4 processors, 16 cores, 16 threads)
4 x 2.3 GHz Quad-Core AMD Opteron, 64GB memory, 3524 SAP SD Benchmark users,
1.98 sec avg response time, Cert#2008016, SQL Server 2005,
Windows Server 2003 Enterprise Edition;
HP ProLiant DL385 G5 (2-way, 2 processors, 8 cores, 8 threads)
2 x 2.3 GHz Quad-Core AMD Opteron, 32GB memory, 2102 SAP SD Benchmark users,
1.99 sec avg response time, Cert#2008015, SQL Server 2005,
Windows Server 2003 Enterprise Edition;
HP Integrity BL860C (2-way, 2 processors, 4 cores, 8 threads)
2 x 1.66 GHz Dual-Core Intel Itanium, 24GB memory, 1165 SAP SD Benchmark users,
1.94 sec avg response time, Cert#2008052, Oracle 10g, HP-UX 11i V3;
SAP, R/3, mySAP reg TM of SAP AG in Germany and other countries.
More info www.sap.com/solutions/benchmark.
Results Summary
| Certified Results |
|
Performance: |
|
7520 benchmark users |
|
Server: |
|
Sun SPARC Enterprise T5440 |
|
Processors: |
|
4 x 1.4 GHz UltraSPARC T2 Plus |
|
Memory: |
|
128 GB |
|
Operating system: |
|
Solaris 10 |
|
Database S/W: |
|
Oracle 10g |
|
SAP S/W: |
|
SAP ECC 6.0 |
|
SAP Certification: |
|
2008058 |
|
Storage: |
|
3 x Sun StorageTek(tm) 2510
3 x Sun StorageTek(tm) 2540
2 x Sun StorEdge 6120 |
Thursday Apr 17, 2008
HP puts out various "real stories" about competitors. They have an updated one about the new IBM power6 systems.
http://h71028.www7.hp.com/ERC/cache/107848-0-0-0-121.aspx
I'll try to comment on some of them:
Fact 1 they state:
IBM software experts have admitted that software already tuned for out-of-order version of POWER is, “no [sic] so good for in-order power6 processor.”
“Maximizing Application Performance on POWER” IBM Linux on POWER GCC Team Lead, April 19, 2007, page 8,
SW_Summit_gcc_and_tool_chain_Peter.pdf
If you don't understand the issues with"out-of-order", what you can take away is that not every technology that you hear hyped by vendors will give you a true advantage when you look at whole system performance on real applications.
Fact 2 & 3: shows that adding GHz doesn't add delivered performance but it does add a disproportionate number of watts. IBM p 595 (POWER6) 27,500 watts max for 64 cores.
27500w/64-core = 430watts/power6-core
The max rated system electrical load for the POWER6-595 server has increased nearly 5000 watts over the POWER5-p595 for the same number of processors.(ENUS108-257)
Then they go on to compare multi-threaded server chips with a 1-job benchmark. I don't know why they didn't compare on server benchmark SPECrate_int2006, maybe when you test these as servers you see real differences. Let's look at the latest 2-chip results for Itanium2, power6, and UltraSPARC T2 Plus:
A 2-chip Sun SPARC Enterprise T5240 server, running the UltraSPARC T2 Plus processor at 1.4 GHz, beat the 2-chip IBM 4.7GHz POWER6-based p570 by 29% on the SPECint_rate2006 benchmark, and also beat the 2-chip HP 1.66GHz Itanium-based Integrity rx2660 by 2.5 times on the SPECint_rate2006 benchmark.
Fact 4: shows IBM is raising its software prices.
Fact 5: HP states that AIX 6.1 will be needed to more fully exploit POWER6, and then asks: how many ISV applications are certified for AIX 6.1?
For more on the latest SPECint_rate 2006 results see:
http://blogs.sun.com/bmseer/entry/2_chip_spec_cpu2006_rate
For more on prices on small 4-core IBM: http://blogs.sun.com/bmseer/entry/some_ibm_power6_actual_prices
I haven't seen anything on IBM p 595 power6 prices 64-core 5GHz, if you have any pointers please post in the comments.
Disclosure statement:
SPEC, SPECint reg tm of Standard Performance Evaluation Corporation. Sun result submitted to SPEC, other results from www.spec.org as of 4/7/08. Sun SPARC Enterprise T5240 (UltraSPARC T2 Plus, 2 chips, 16 cores), 157 SPECint_rate2006; IBM p 570 (POWER6, 2 chips, 4 cores), 122 SPECint_rate2006, HP Integrity rx2660 (Itanium2, 2-chip, 1.66GHz/18MB), 62.8 SPECint_rate2006.
Monday Apr 14, 2008
In the last week this blog had talked a lot about the great performance of the SPARC Enterprise T5140 and T5240 servers.
But forget the leading performance, price/performance, watt/perf results, if you want to try it for yourself you can. Sun continues its try-and-buy program and extends it to the new Sun SPARC Enterprise T5140 and T5240 servers.
Free 60-day trial program. You pay nothing (Sun even pays the shipping), for details
see: http://www.sun.com/tryandbuy/index.jsp (scroll down to find T5240/T5140)
Reminder: Summary of technical index of CMT blogs @ Allan Packer's blog:
http://blogs.sun.com/allanp/entry/sun_s_cmt_goes_multi
I've had several talks with friends at different competitors, and they said they didn't think Sun had it in it to really make a breakthrough in performance, price, and power -- but now they all talk about high-level meetings in their companies (competitors) who are frantically trying to figure out how to counter Sun's offering.
Monday Apr 14, 2008
For a survey of the wide variety of blogs with good technical data on the new UltraSPARC T2 Plus servers (Sun SPARC Enterprise T5240, Sun SPARC Enterprise T5140,...), please look at Allan Packer's blog index at:
http://blogs.sun.com/allanp/entry/sun_s_cmt_goes_multi
Friday Apr 11, 2008
What most people forget, is that datacenters are really throughput
engines. I don't know any datacenter (besides home ones) that only
use one thread or one core. When you look at racks of servers in a datacenter, you are
looking at thousands of threads! Which means 10,000 to 100,000 or more in a complete datacenter. Lots of work to be done, lots of threads doing it!
Sun has announced blade system world record results for
SPECint_rate2006 and SPECfp_rate2006.
These results were
run on the Sun Blade 6000 system with 10 Sun Blade T6320 server modules which
use the 1.4 GHz UltraSPARC T2 processor.
The Sun Blade 6000 system fully populated with 10 T6320 server modules
delivered a SPECint_rate2006 score of 838, a world record result for
blade systems.
The Sun Blade 6000 system (10 RUs) powered by 10 Sun UltraSPARC T2 1.4 GHz
processors provides 73% more integer throughput than the IBM p 570 (16 RUs)
equipped with 8 POWER6 4.7 GHz processors, as measured by
SPECint_rate2006.
The Sun Blade 6000 system fully populated with 10 T6320 server modules
delivered a blade system world record SPECfp_rate2006 score of 571.
Sun has chosen to submit a single run as both
SPECfp_rate_base2006 and SPECfp_rate2006,
(which is allowed under the run rules), in order
to emphasize that even without aggressive tuning, the
score of 571 is a record for both base and peak.
The Sun Blade 6000 system powered by 10 Sun UltraSPARC T2 1.4 GHz
processors provides 73% more floating-point throughput than the IBM p 570
equipped with 8 POWER6 4.7 GHz processors, as measured by
SPECfp_rate_base2006.
The IBM p 570 system (16RU) uses 1.6x times more rack units than the 10RU Sun Blade 6000 system(16 RU vs. 10 RU).
SPEC CPU2006 Performance Charts -
bigger is better, selected recent results
SPECint_rate2006
Please see
www.spec.org for complete results
| System |
Processors |
Performance Results |
| Type |
GHz |
Chips |
Cores |
Threads |
Peak |
Base |
| Sun B6000 w/10 x T6320 |
UltraSPARC T2 |
1.4 |
10 |
80 |
640 |
838 |
752 |
| HP Superdome |
Itanium 2 |
1.6 |
32 |
64 |
64 |
824 |
770 |
| Sun M9000 |
SPARC VI |
2.4 |
32 |
64 |
64 |
650 |
553 |
| IBM p 570 |
POWER6 |
4.7 |
8 |
16 |
32 |
484 |
420 |
Results as of 7 Apr 2008 from www.spec.org.
SPECfp_rate2006
Please see
www.spec.org for complete results
or for just
SPECfp_rate2006 results ordered by peak score.
| System |
Processors |
Performance Results |
| Type |
GHz |
Chips |
Cores |
Threads |
Peak |
Base |
| Sun M9000 |
SPARC VI |
2.4 |
32 |
64 |
64 |
600 |
556 |
| Sun B6000 w/10 x T6320 |
UltraSPARC T2 |
1.4 |
10 |
80 |
640 |
571 |
571 |
| IBM p 570 |
POWER6 |
4.7 |
8 |
16 |
32 |
430 |
369 |
| HP rx8640 |
Itanium 2 |
1.6 |
16 |
32 |
32 |
371 |
357 |
Results as of 7 Apr 2008 from www.spec.org.
Benchmark Description<
SPEC CPU2006 is made up of two suites of benchmarks, CFP2006 and
CINT2006. CFP2006 targets floating-point performance, while CINT2006
targets integer performance.
Each suite has two different measures. First is the CPU measure, which
is the performance on the suite as a single stream. This can be either
a single thread or automatic compiled parallel run. This measure is
further defined by base and optimized runs. Base uses the same compiler
flags for all kernels, where optimized is allowed to use different
compiler flags for each kernel. Results are compared against a baseline
system run that was standardized by SPEC.
The second measure is Rate. It is a measure of how many CPU measures
can be run at a time. Typically, it is run as n processes on n
processors. It shows how well the same job mix can run on a system
under some load. It also is run as a base and optimized set of
results.
Disclosure Statement:
SPEC, SPECint reg tm of Standard Performance Evaluation Corporation.
Sun result submitted to SPEC,
other results from www.spec.org as of 4/7/08.
Sun Blade T6320 (UltraSPARC T2, 10 chips, 80 cores),
838 SPECint_rate2006, 752 SPECint_rate_base2006.
SPEC, SPECint reg tm of Standard Performance Evaluation Corporation.
Sun result submitted to SPEC,
other results from www.spec.org as of 4/7/08.
Sun Blade T6320 (UltraSPARC T2, 10 chips, 80 cores),
838 SPECint_rate2006, 752 SPECint_rate_base2006.
IBM p 570 (POWER6, 8 chips, 16 cores), 484 SPECint_rate2006,
420 SPECint_rate_base2006.
SPEC, SPECfp reg tm of Standard Performance Evaluation Corporation.
Sun result submitted to SPEC,
other results from www.spec.org as of 4/7/08.
Sun Blade T6320 (UltraSPARC T2, 10 chips, 80 cores),
571 SPECfp_rate2006, 571 SPECfp_rate_base2006.
SPEC, SPECint reg tm of Standard Performance Evaluation Corporation.
Sun result submitted to SPEC,
other results from www.spec.org as of 4/7/08.
Sun Blade T6320 (UltraSPARC T2, 10 chips, 80 cores),
571 SPECfp_rate_base2006.
IBM p 570 (POWER6, 8 chips, 16 cores),
369 SPECfp_rate_base2006.
Results Summary
| Results |
| Reference Date: |
|
Apr 7, 2008 |
| System: |
|
Sun Blade 6000 with 10 T6320 Modules |
| Processor: |
|
10 Sun UltraSPARC T2, 1.4 GHz |
|
|
|
838 SPECint_rate2006 |
|
|
|
752 SPECint_rate_base2006 |
|
|
|
571 SPECfp_rate2006 |
|
|
|
571 SPECfp_rate_base2006 |
| Software: |
|
Solaris 10, Sun Studio 12 Compiler gccfss |
Friday Apr 11, 2008
To see under the covers and the design of the amazing UltraSPARC T2 Plus based systems check out this great blog: http://blogs.sun.com/deniss/date/20080410.
More postings to come on this great product. Remember it is delivered-system-performance that is key.
A couple of warnings about the results of others:
- Check the prices for the configs as benchmarked (especially watch up out for entry level pricing as realistic configs on competitors can cost 2x to 10x more when configured with the fastest processors and full fast memory)
- Watch out for performance per widget metrics. Some things you can see (servers) some things you can't see (cores). Especially as some cores are extremely expensive and this totally throws of any advantage of per-core performance.
- Watch for benchmarks that aren't published (I'm still waiting for IBM p570 4-core & 8-core stream performance or LMbench.
- Watch out for 1.xGhz published on one benchmark and 2.xGHz published for performance.
Thursday Apr 10, 2008
The Sun SPARC Enterprise T5240 server
delivers the best performance on the SPEC OMPM2001
benchmark for two chips.
These results were run on the Sun SPARC Enterprise T5240 server
using the UltraSPARC T2 Plus processor running at 1.4 GHz.
The Sun SPARC Enterprise T5240 server
running the UltraSPARC T2 Plus processor at 1.4 GHz,
beat all dual chip scores running SPECompM2001 with
a score of 25488.
The Sun SPARC Enterprise T5240 server
running the UltraSPARC T2 Plus processor at 1.4 GHz,
beat all dual chip scores running SPECompM_base2001 with
a score of 21145.
The Sun SPARC Enterprise T5240 server running at 1.4 GHz beat the best
IBM dual chip result (POWER6) by 25% on the SPECompM2001 benchmark.
SPEComp2001 Performance Chart -
SPECompM2001 (bigger is better)
Select 2 chip or less results ordered by peak metric.
| Result |
Chips |
Cores |
OpenMP
Thrds |
System |
| Peak |
Base |
| 25488 |
21145 |
2 |
8 |
128 |
Sun SPARC Enterprise T5240, UltraSPARC T2 Plus, 1.4GHz |
| 20443 |
18950 |
2 |
4 |
8 |
IBM p 520, POWER6, 4.2 GHz |
| 19983 |
15355 |
2 |
4 |
8 |
IBM p5 550, POWER5+, 2.1 GHz |
| 19688 |
17980 |
2 |
4 |
8 |
IBM JS22, POWER6, 4.0 GHz |
| 19568 |
18218 |
2 |
4 |
8 |
IBM JS22, POWER6, 4.0 GHz |
| 16208 |
14399 |
1 |
8 |
63 |
Sun SE T5120/T5220, US T2, 1.4 GHz |
Benchmark Description
The SPEC OMPM2001 Benchmark Suite was released in June 2001 and
tests HPC performance using OpenMP for parallelism.
-
11 programs (3 in C and 8 in Fortran)
parallelized using OpenMP API
Goals of suite:
- Targeted to mid-range (4-32 processor) parallel systems
- Run rules, tools and reporting similar to SPEC CPU2000
- Programs representative of HPC and Scientific Applications
Disclosure Statement:
SPEC, SPEComp reg tm of Standard Performance Evaluation Corporation.
Sun result submitted to SPEC.
Other results from www.spec.org as of 4/6/08.
Sun SPARC Enterprise T5240 (2 chips, 16 cores, 128 threads, 1.4GHz)
25488 SPECompM2001.
SPEC, SPEComp reg tm of Standard Performance Evaluation Corporation.
Sun result submitted to SPEC.
Other results from www.spec.org as of 4/6/08.
Sun SPARC Enterprise T5240 (2 chips, 16 cores, 128 threads, 1.4GHz)
21145 SPECompM_base2001.
SPEC, SPEComp reg tm of Standard Performance Evaluation Corporation.
Sun result submitted to SPEC.
Other results from www.spec.org as of 4/6/08.
Sun SPARC Enterprise T5240 (2 chips, 16 cores, 128 threads, 1.4GHz)
25294 SPECompM2001.
IBM p 520 (2 chips, 4 cores, 8 threads, 4.2GHz) 20443 SPECompM2001.
Results Summary
| Result |
|
Sun SPARC Enterprise T5240: |
|
25488 SPECompM2001 |
|
|
|
21145 SPECompM_base2001 |
| Reference Date: |
|
Apr 09, 2008 |
| Operating System: |
|
Solaris 10 8/07 |
| Compiler: |
|
Sun Studio 12 |
Thursday Apr 10, 2008
Sun has announced two-chip world record results for
SPECint_rate2006 and SPECfp_rate2006.
These results were
run on the Sun SPARC Enterprise T5240 server which
uses the UltraSPARC T2 Plus processor running at 1.4 GHz.
The Sun SPARC Enterprise T5240 server, powered by two UltraSPARC T2 Plus
processors, delivered a World Record 2-chip "peak" result of 157 on the
SPECint_rate2006 benchmark.
The Sun SPARC Enterprise T5240 server, powered by two UltraSPARC T2 Plus
processors, delivered a World Record 2-chip "base" result of 142 on the
SPECint_rate_base2006 benchmark.
A 2-chip Sun SPARC Enterprise T5240 server, running the UltraSPARC
T2 Plus processor at 1.4 GHz, beat the 2-chip IBM 4.7GHz POWER6 based
p 570 by 29% on the SPECint_rate2006 benchmark.
The Sun SPARC Enterprise T5240 server delivers 1.9X the throughput
performance of the Sun SPARC Enterprise T5220 server as measured by
SPECint_rate2006 in the same amount of space.
The Sun SPARC Enterprise T5240 server, powered by two UltraSPARC T2 Plus
processors, delivered a World Record 2-chip "peak" result of 119 on the
SPECfp_rate2006 benchmark.
The Sun SPARC Enterprise T5240 server, powered by two UltraSPARC T2 Plus
processors, delivered a World Record 2-chip "base" result of 111 on the
SPECfp_rate_base2006 benchmark.
A 2-chip Sun SPARC Enterprise T5240 server, running the UltraSPARC
T2 Plus processor at 1.4 GHz, beat the 2-chip IBM 4.7GHz POWER6 based
p 570 by 3% on the SPECfp_rate2006 benchmark.
The Sun SPARC Enterprise T5240 server delivers 1.9X the throughput
performance of the Sun SPARC Enterprise T5220 server as measured by
SPECfp_rate2006 in the same amount of space.
SPEC CPU2006 Performance Charts -
bigger is better, selected recent results.
SPECint_rate2006
Please see
www.spec.org for complete results
| System |
Processors |
Performance
Results |
| Type |
GHz |
Chips |
Cores |
Threads |
Peak |
Base |
| Sun SE T5240 |
UltraSPARC T2 Plus |
1.4 |
2 |
16 |
128 |
157 |
142 |
| Supermicro X7DWA-N |
Xeon X5482 |
3.2 |
2 |
8 |
8 |
147 |
121 |
| SGI Altix XE 250 |
Xeon X5472 |
3.0 |
2 |
8 |
8 |
143 |
119 |
| HP DL160 G5 |
Xeon X5472 |
3.0 |
2 |
8 |
8 |
140 |
115 |
| IBM p 570 |
Power6 |
4.7 |
2 |
4 |
8 |
122 |
108 |
Results as of 7 Apr 2008 from www.spec.org.
SPECfp_rate2006
Please see
www.spec.org for complete results
| System |
Processors |
Performance
Results |
| Type |
GHz |
Chips |
Cores |
Threads |
Peak |
Base |
| Sun SE T5240 |
UltraSPARC T2 Plus |
1.4 |
2 |
16 |
128 |
119 |
111 |
| IBM p 570 |
POWER6 |
4.7 |
2 |
4 |
8 |
116 |
98.8 |
| IBM i 570 |
POWER6 |
4.7 |
2 |
4 |
8 |
115 |
102 |
| HP BL685c G5 |
Opteron 8356 |
2.3 |
2 |
8 |
8 |
89.8 |
82.0 |
| HP DL385 G5 |
Opteron 2356 |
2.3 |
2 |
8 |
8 |
89.3 |
81.1 |
Results as of 7 Apr 2008 from www.spec.org.
Benchmark Description
SPEC CPU2006 is made up of two suites of benchmarks, CFP2006 and
CINT2006. CFP2006 targets floating-point performance, while CINT2006
targets integer performance.
Each suite has two different measures. First is the CPU measure, which
is the performance on the suite as a single stream. This can be either
a single thread or automatic compiled parallel run. This measure is
further defined by base and optimized runs. Base uses the same compiler
flags for all kernels, where optimized is allowed to use different
compiler flags for each kernel. Results are compared against a baseline
system run that was standardized by SPEC.
The second measure is Rate. It is a measure of how many CPU measures
can be run at a time. Typically, it is run as n processes on n
processors. It shows how well the same job mix can run on a system
under some load. It also is run as a base and optimized set of
results.
Disclosure Statement:
SPEC, SPECint reg tm of Standard Performance Evaluation Corporation.
Sun result submitted to SPEC, other results from www.spec.org as of 4/7/08.
Sun SPARC Enterprise T5240 (UltraSPARC T2 Plus, 2 chips, 16 cores),
157 SPECint_rate2006, 142 SPECint_rate_base2006.
SPEC, SPECint reg tm of Standard Performance Evaluation Corporation.
Sun result submitted to SPEC, other results from www.spec.org as of 4/7/08.
Sun SPARC Enterprise T5240 (UltraSPARC T2 Plus, 2 chips, 16 cores),
157 SPECint_rate2006;
IBM p 570 (POWER6, 2 chips, 4 cores), 122 SPECint_rate2006.
SPEC, SPECint reg tm of Standard Performance Evaluation Corporation.
Sun result submitted to SPEC, other results from www.spec.org as of 4/7/08.
Sun SPARC Enterprise T5240 (UltraSPARC T2 Plus, 2 chips, 16 cores),
157 SPECint_rate2006;
Sun SPARC Enterprise T5220 (UltraSPARC T2, 1 chip, 8 cores),
83.2 SPECint_rate2006.
SPEC, SPECfp reg tm of Standard Performance Evaluation Corporation.
Sun result submitted to SPEC, other results from www.spec.org as of 4/7/08.
Sun SPARC Enterprise T5240 (UltraSPARC T2 Plus, 2 chips, 16 cores),
119 SPECfp_rate2006, 111 SPECfp_rate_base2006.
SPEC, SPECfp reg tm of Standard Performance Evaluation Corporation.
Sun result submitted to SPEC, other results from www.spec.org as of 4/7/08.
Sun SPARC Enterprise T5240 (UltraSPARC T2 Plus, 2 chips, 16 cores),
119 SPECfp_rate2006;
IBM p 570 (POWER6, 2 chips, 4 cores), 116 SPECfp_rate2006.
SPEC, SPECfp reg tm of Standard Performance Evaluation Corporation.
Sun result submitted to SPEC, other results from www.spec.org as of 4/7/08.
Sun SPARC Enterprise T5240 (UltraSPARC T2 Plus, 2 chips, 16 cores),
119 SPECfp_rate2006;
Sun SPARC Enterprise T5220 (UltraSPARC T2, 1 chip, 8 cores),
62.3 SPECfp_rate2006.
Results Summary
| Results |
| Reference Date: |
|
Apr 9, 2008 |
| System: |
|
Sun SPARC Enterprise T5240 |
| Processor: |
|
Sun UltraSPARC T2 Plus, 1.4 GHz |
|
|
|
157 SPECint_rate2006 |
|
|
|
142 SPECint_rate_base2006 |
|
|
|
119 SPECfp_rate2006 |
|
|
|
111 SPECfp_rate_base2006 |
| Software: |
|
Solaris 10, Sun Studio 12 Compiler |
Wednesday Apr 09, 2008
...at least one more world record writeup from me today, its getting late on this busy day.
so without further adieu...
The Sun SPARC Enterprise T5240 server,
equipped with 2 Sun UltraSPARC T2 Plus
chips (8cores/chip @1.2GHz, 8 threads/core), using Lotus Domino 7.0.1 mail
server delivered the overall World Record Performance, 2nd.
best Price/performance (it is beaten slightly by another Sun result 
) and best power-performance for the Lotus[R] R6iNotes on Domino mail server benchmark.
The Sun SPARC Enterprise T5240
server, equipped with 2 UltraSPARC T2 Plus processors with max 128
threads of execution achieved the overall World Record performance
of 65000 R6iNotes users
using the Lotus Domino 7.0.1 Messaging
Server.
The Sun SPARC Enterprise T5240
server equipped with 2 1.2GHz UltraSPARC T2 Plus achieved 18% more
performance and 42% better price/performance than the 4-chip IBM
p560Q 1.8GHz dual-core POWER5+ server.
The Sun Enterprise T5240 R6iNotes
has the best price/performance than all other competitor's systems,
including IBM and HP, for the R6iNotes benchmark.
The Sun Enterprise T5240 has 2.6X
better power-performance and 10.6X better SWAP than IBM POWER5+
IBMp560Q.
The 4RU IBM p550Q Power5+ used 2X
times the space of the 2RU Sun SPARC Enterprise T5240 system.
The 8RU IBM p560Q Power5+ used 4X
times the space of the 2RU Sun SPARC
Enterprise T5240 system.
The
SWaP metric is a measure of Server effeciency ratio that includes
System performance, power and space consumption on a specific
benchmark (SWaP = Performance/[Space(RU)xWatts])
power-performance
is computed as Watts/performance. Since power-performance is related
to price/performance they are both calculated with performance in
the denominator
Lotus Domino 7.0.1 NotesBench R6iNotes Performance Chart (in
increasing $/User order)
Users = number of users supported (bigger is better)
NotesMark
= the benchmark metric (bigger is better)
$/User = cost per user
(smaller is better)
|
System
|
Chip GHz
|
Cores/
Chip
|
OS
|
USERS
|
N-MARK
|
#Dom Part
|
AvRT
|
$/User
|
|
Sun T5240
|
2xUS T2 Plus 1.2
|
8
|
Sol10
|
65000
|
55101
|
6
|
224ms
|
$2.84
|
|
IBM-P5 560Q
|
2xPOWER5+ 1.8
|
4
|
AIXL
|
55000
|
46103
|
6
|
848ms
|
$4.89
|
|
Sun T5220
|
1x US T2 1.4
|
8
|
Sol10
|
43000
|
36240
|
6
|
584ms
|
$2.89
|
|
Sun V890
|
8x USIV+ 2.1
|
2
|
Sol10
|
40000
|
33862
|
4
|
324ms
|
$7.19
|
|
HP BL 480c
|
2x Xeon 2.6
|
4
|
Win 2003
|
27000
|
23117
|
3
|
517ms
|
$13.27
|
|
HP BL 685c
|
2x Opt 8222 2.6
|
4
|
Win 2003
|
26000
|
22329
|
3
|
612ms
|
$14.20
|
|
IBM-P5 550Q
|
2x POWER5 1.5
|
4
|
AIXL
|
24000
|
20108
|
4
|
932ms
|
$5.97
|
|
Sun T2000
|
1x US T1 1.4
|
8
|
Sol10
|
23200
|
19518
|
4
|
692ms
|
$4.48
|
|
IBM X3650
|
2x Xeon 3.8
|
2
|
Linux
|
22000
|
17777
|
4
|
3056ms
|
$3.47
|
|
Sun T2000
|
1xUS T1 1.2
|
8
|
Sol10
|
19000
|
16061
|
4
|
400ms
|
$3.94
|
|
HP Pro DL580
|
4x Xeon 3.0
|
2
|
Win 2003
|
18500
|
15953
|
4
|
434ms
|
$4.15
|
|
HP BL465c
|
2x Opt 2222 3.0
|
2
|
Win 2003
|
17500
|
15092
|
2
|
337ms
|
$16.30
|
|
Sun X4200
|
2X Opt 254 2.8
|
2
|
Linux
|
17000
|
14347
|
4
|
496ms
|
$2.66
|
Complete benchmark results may be found at the Lotus NotesBench
website http://www.notesbench.org.
Benchmark Description
The benchmark simulates active users accessing their Domino[R]
R6iNotes mail files via standard Web browser. Each simulated user
periodically sends, retrieves, and deletes a specified number of
e-mail messages from a browser. An average user runs this script four
times per hour.
The R5iNotes and R6iNotes workloads, using the Lotus Domino Mail
server (R5 or R6) are both HTTP based workloads. R6iNotes is heavier
with added features and larger mail files using the MIME format.
The Lotus Webmail and iNotes workloads are NOT comparable.
Disclosure Statement:
NotesBench R6iNotes Sun SPARC Enterprise T5240 (2chip,
8cores/chip@1.2GHz UltraSPARC T2 Plus, 8threads/core, 128GB, 6
partitions, Solaris[TM] 10 , Lotus[R] Domino 7.0.1, 65000 users,
$2.84per user, 55101 NotesMark tpm, 224ms avg rt. , IBM eServer
550Q, 8x1.5GHz POWER5, 32GB, 4 partitions, AIX 5L V5.3, Lotus[R]
Domino 7.0, 24000 users, $5.97 per user, 20108 NotesMark tpm, 932 ms
avg rt., IBM eServer 560Q, 8x1.8GHz POWER5+, 64GB, 6 partitions,
AIX5L V5.3, Lotus[R] Domino 7.0, 55000 users, $4.89 per user, 46193
NotesMark tpm, 848ms avg rt. More info: www.notesbench.org
IBM p5 550Q power specifications calculated by applying 70% of
the maximum Watts published in “Facts and Features Report”,
11/14/06, posted at
ftp:/ftp.software.ibm.com/common/ssi/rep_sp/n/PSB01628USEN/PSB01628USEN.PDF
Sun SPARC Enterprise T5240 server
Power consumption has been measured during the full benchmark
execution.
Results Summary
|
Audited Results
|
| |
Users: |
|
65000 |
| |
NotesMark: |
|
55101 |
| |
Price Performance: |
|
$2.84 $/User |
| |
Price Performance: |
|
$3.35 $ /NotesMark |
| |
Response: |
|
224 ms |
| Systems: |
|
One Sun SPARC Enterprise T5240 |
| Number Processors: |
|
2 chips, 8cores/chip@1.2GHz, 8 threads/core |
| Speed of Processors: |
|
1200 MHz |
| Storage: |
|
6xSTK2540(12x143GB), 8xSTK2501 (12x143GB) |
| Notes Version: |
|
Lotus Domino 7.0.1 |
| |
#Domino Partition |
|
6 |
| Operating System: |
|
Solaris 10 |
| Cost: |
|
$184,554.00 |
| Other Performance Metrics |
| |
Users/CPU: |
|
65000 |
| |
Users/Core |
|
4062 |
Wednesday Apr 09, 2008
The Sun SPARC Enterprise T5240 server delivered a World Record single server
result of 3331.31 SPECjAppServer2004 JOPS@Standard. This result used one
Sun SPARC Enterprise T5240 (two UltraSPARC T2 Plus 1.4GHz chips) for the
application server and a Sun SPARC Enterprise T5240 (with two UltraSPARC
T2 Plus 1.4GHz chips) for the database server.
This benchmark used the Oracle Application Server 10g and Oracle
Database 10g Enterprise Edition. This benchmark result proves that
the Sun SPARC Enterprise T5240 server using the UltraSPARC T2 Plus
processor performs as an oustanding J2EE application server as well
as an Oracle 10G OLTP database server.
The Sun SPARC Enterprise T5240 server in the application tier consumed
an average of 720 Watts in a 2RU space during the execution of this
benchmark. The Sun SPARC Enterprise T5240 server in the database tier
consumed an average of 670 Watts in a 2RU space during the execution of
this benchmark.
One Sun SPARC Enterprise T5240 server (two UltraSPARC T2 Plus chips) in
the application tier demonstrated 62% better performance over the HP BL460c
blade result of 2056.27 JOPS@Standard which used two 3.1 Ghz Xeon
X5460 chips.
One Sun SPARC Enterprise T5240 server (two 1.4 GHz UltraSPARC T2 Plus chips)
in the application tier demonstrated 2.8X better performance over the IBM
p570 result of 1197.51 JOPS@Standard which used two 4.7Ghz IBM POWER6 chips.
One SPARC Enterprise Sun T5240 server (two 1.4 GHz UltraSPARC T2 Plus chips)
in the application tier performed within 8% of the Dell result of 3593.58
JOPS@Standard which used two Dell PowerEdge 1950 servers with a total
of four 2.8 Ghz Xeon E5440 chips. The two Dell PE1950 servers
requires 2RU of rack space and consumes on average 938 Watts of power.
One Sun SPARC Enterprise T5240 server has 21% better SWaP and 18% better
power-performance than two Dell PowerEdge 1950 servers combined.
One SPARC Enterprise Sun T5240 server (two 1.4 GHz UltraSPARC T2 Plus chips)
in the application tier demonstrated 3.8X better performance than the HP
rx2660 result of 874.17 JOPS@Standard which used two 1.6 Ghz Itanium 2 chips.
The Sun SPARC Enterprise T5240 server has 2.8X better SWaP and 2.9X better
power-performance than the HP rx2660 server.
One Sun SPARC Enterprise T5240 server (two 1.4 GHz UltraSPARC T2 Plus chips)
in the application tier demonstrated 5.1X better performance over the
Dell PowerEdge 2900 result of 652.95 JOPS@Standard which used two
3.0 Xeon X5160 chips. The Sun SPARC Enterprise T5240 server has 5.7X
better SWaP and 2.4X better power-performance than the Dell PowerEdge 2900.
One Sun SPARC Enterprise T5240 server (two 1.4 GHz UltraSPARC T2 Plus
chips) in the application tier demonstrated 2.8X better performance over
the IBM Power6 570 result of 1197.51 JOPS@Standard which used two 4.7 Ghz
IBM POWER6 chips. The Sun SPARC Enterprise T5240 server has 7.6X better
SWaP and 3.9X better power-performance than the IBM Power6 570.
One Sun SPARC Enterprise T5240 server (two 1.4 GHz UltraSPARC T2 Plus
chips) in the database tier performed within 8% of the result of 3593.58
JOPS@Standard using the Dell PowerEdge R900 equipped with four
2.9 Ghz Xeon X7350 chips. The Sun SPARC Enterprise T5240 server has
3.1X better SWaP and 50% better power-performance than the Dell R900.
One SPARC Enterprise Sun T5240 server (two 1.4 GHz UltraSPARC T2 Plus
chips) in the database tier demonstrated 5.1X better performance over the
Dell PowerEdge 2900 result of 652.95 JOPS@Standard which uses two 3.0 GHz Xeon X5160 chips. The Sun SPARC Enterprise T5240 server has 5.7X
better SWaP and 2.4X better power-performance than the Dell PowerEdge 2900.
One Sun SPARC Enterprise T5240 server (two 1.4 GHz UltraSPARC T2 Plus
chips) in the database tier demonstrated 2.8X better performance over
the IBM p5 550 result of 1197.51 JOPS@Standard which used two 2.1 GHz IBM
POWER5+ chips. The Sun SPARC Enterprise T5240 server has 6.3X better SWaP
and 3.2X better power-performance than the IBM Power5 550.
The SWaP metric is a measure of server efficiency ratio that
includes system performance, power and space consumption on a
specific benchmark. (SWaP = Perf /[ Space (RU) x Watts ] )
Power-performance is computed as watt/performance. Since
power-performance is related to price/performance they are
both calculated with performance in the denominator.
SPECjAppServer2004 Performance Chart as of 04/09/2008. Complete benchmark results may be found at the SPEC benchmark website http://www.spec.org.
SPECjAppServer2004 JOPS@Standard (bigger is better)
| |
SPECjAppServer2004
JOPS@Standard |
J2EE Server |
DB Server |
| Sun |
3331.31 |
1x Sun SPARC Enterprise T5240
16 cores, 2 chip @ 1.4 GHz US-T2 Plus
Oracle OC4J 10.1.3.3.2 |
1 x Sun SPARC Enterprise T5240
16 cores, 2 chip @ 1.4 GHz US-T2 Plus
Oracle 10g DB 10.2.0.3 |
| HP |
2056.27 |
1x BL460c
8 cores, 2 chips @ 3.1 Xeon X5460
Oracle OC4J 10.1.3.3 |
1x BL480c
8 cores, 2 chips @ 2.8 Xeon E5440
Oracle 10g DB 10.2.0.3 |
| Sun |
2000.92 |
1x Sun SPARC Enterprise T5220
8 cores, 1 chip @ 1.4 GHz US-T2
Oracle OC4J 10.1.3.3 |
1 x Sun SPARC Enterprise T5120
8 cores, 1 chip @ 1.2 GHz US-T2
Oracle 10g DB 10.2.0.3 |
| Rackable |
1672.64 |
1x Rackable C2002
8 cores, 2 chips @ 2.66 Xeon X5355
Oracle OC4J 10.1.3.2 |
1x Rackable S3118
8 cores, 2 chips @ 2.33 Xeon E5345
Oracle 10g DB 10.2.0.2 |
| IBM |
1197.51 |
1 x IBM p570
4 cores, 2 chips @ 4.7 GHz IBM POWER6
IBM WebSphere 6.1 |
1 x IBM p550
4 cores, 2 chips @ 2.1 GHz IBM POWER5+
IBM DB2 v9.1 |
| HP |
874.17 |
1 x HP rx2660
4 cores, 2 chips @ 1.6 GHz Itanium 2
Oracle OC4J 10.1.3.2 |
1 x HP rx2660
4 cores, 2 chips @ 1.6 GHz Itanium 2
Oracle 10g DB 10.2.0.2 |
| Sybase |
652.95 |
1 x Dell PowerEdge 2900
4 cores, 2 chips @ 3.0 GHz Xeon 5160
Sybase EAS 6.0.2 |
1 x Dell PowerEdge 2900
4 cores, 2 chips @ 3.0 GHz Xeon 5160
SQLAnywhere 10.0.1 |
| Dell |
3593.58 |
2 x Dell PowerEdge 1950
16 cores, 4 chips @ 2.8 GHz Xeon E5440
Oracle OC4J 10.1.3.3 |
1 x Dell PowerEdge R900
16 cores, 4 chips @ 2.9 GHz Xeon X7350
Oracle 10g DB 10.2.0.2 |
Benchmark Description
SPECjAppServer2004 (Java Application Server) is a multi-tier benchmark for
measuring the performance of Java 2 Enterprise Edition (J2EE) technology-based
application servers. SPECjAppServer2004 is an end-to-end application which
exercises all major J2EE technologies implemented by compliant application
servers as follows:
-
The web container, including servlets and JSPs
-
The EJB container
-
EJB2.0 Container Managed Persistence
-
JMS and Message Driven Beans
-
Transaction management
-
Database connectivity
Moreover, SPECjAppServer2004 also heavily exercises all parts of the underlying
infrastructure that make up the application environment, including hardware,
JVM software, database software, JDBC drivers, and the system network.
The primary metric of the SPECjAppServer2004 benchmark is jAppServer Operations
Per Second (JOPS) which is calculated by adding the metrics of the
Dealership Management Application in the Dealer Domain and the Manufacturing
Application in the Manufacturing Domain. There is NO price/performance
metric in this benchmark.
Disclosure Statement:
SPECjAppServer2004
Sun SPARC Enterprise T5240 (16 cores, 2 chip) 3331.31 SPECjAppServer2004 JOPS@Standard.
IBM p570(4 cores, 2 chips) 1197.51 SPECjAppServer2004 JOPS@Standard.
IBM p550(4 cores, 2 chips) 1197.51 SPECjAppServer2004 JOPS@Standard.
HP BL460c (8 cores, 2 chips) 2056.27 SPECjAppServer2004 JOPS@Standard.
HP rx2660 (4 cores, 2 chips) 874.17 SPECjAppServer2004 JOPS@Standard.
Dell PE 2900 (4 cores, 2 chips) 652.95 SPECjAppServer2004 JOPS@Standard.
Dell PE 1950 (16 cores, 4 chips) 3593.68 SPECjAppServer2004 JOPS@Standard.
Dell PE R900 (4 cores, 4 chips) 3593.68 SPECjAppServer2004 JOPS@Standard.
SPEC, SPECjAppServer reg tm of Standard Performance Evaluation Corporation.
Results from www.spec.org as of 04/09/2008.
Power References:
Dell 1950 power rating estimated by applying 70% to the PSU rating
reported 03/10/08 for each server:
http://www.dell.com/content/products/productdetails.aspx/pedge_r900?c=us&cs=555&l=en&s=biz
HP rx2660 power calculated as 70% of max input power reported 07/17/07:
http://h18004.www1.hp.com/products/quickspecs/12698_div/12698_div.HTML#Technical%20Specifications
Dell power rating 08/24/07 from Dell DataCenter Capacity Planner:
http://www.dell.com/content/topics/topic.aspx/global/products/pedge/topics/en/config_calculator?c=us&cs=555&l=en&s=biz
System configured with 2 x Xeon 5160 processors, 8 x 2GB DIMMs, 1 x Disk, 1 x HBA & Redundant PSU
IBM p6 570 power specifications from 80% of maximum report power consumption
published here, 06/07/07, posted at
ftp://ftp.software.ibm.com/common/ssi/rep_sp/n/PSB01628USEN/PSB01628USEN.PDF
Dell R900 power estimated by applying 70% to the PSU rating, reported 03/10/08
at
http://www.dell.com/content/products/productdetails.aspx/pedge_r900?c=us&cs=555&l=en&s=biz
IBM p5 power specifications calculated by applying 70% of the power numbers
published in ?Facts and Features Report?, 3/10/06, posted at
http://www-03.ibm.com/servers/eserver/pseries/hardware/factsfeatures.html
Results Summary
| Certified Results |
|
3331.31 SPECjAppServer2004 JOPS@Standard |
| Reference Date: |
|
Apr 9, 2008 |
| Systems: |
|
2 x Sun SPARC Enterprise T5240 |
|
|
|
| Total Number Processors: |
|
2,2 |
| Processor/GHz of Server: |
|
UltraSPARC T2 Plus 1.4 GHz |
|
|
|
| Operating System: |
|
Solaris 10 8/07 |
| Software: |
|
Oracle Application Server 10g Release 10.1.3.3.2 - Java Edition |
|
|
Oracle Database Enterprise Edition Release 10.2.0.3 |
| JVM: |
|
J2SE 6.0 update 6p |
|
|
|
|
Hi BMSeer,
I'm just confused with your statement...