Tuesday Oct 09, 2007
The Sun SPARC Enterprise T5120 and Sun SPARC Enterprise T5220 each with
the 1.4 GHz UltraSPARC T2
processor obtained the best multi-JVM single chip results on the
SPECjbb2005 server-side Java benchmark.
The Sun SPARC Enterprise T5120 and Sun SPARC Enterprise T5220 servers
each equipped with a single UltraSPARC T2 processor at 1.4 GHz,
delivered a World Record single-chip result of 192055 SPECjbb2005 bops,
24007 SPECjbb2005 bops/JVM.
The Sun T5220 server (single UltraSPARC T2) demonstrated 9% better
performance than the 4-core 4.7GHz IBM p570 (Power6) result of 175,474
SPECjbb2005 bops 87737 SPECjbb2005 bops/JVM.
The Sun T5220 server has 2.5x better power-performance and has 4.9x
better SWaP than the IBM 4-core p570.
The Sun T5220 server (single UltraSPARC T2) demonstrated 20% better
performance than the Dell PowerEdge 6950
result of 159,382 SPECjbb2005 bops,
39846 SPECjbb2005 bops/JVM which used four 2.8GHz dual-core Opteron
processors. The Sun T5220 server has 1.6x better power-performance
and has 3.2x better SWaP.
The Sun T5120 server (single UltraSPARC T2) demonstrated 21% better
performance than the 4-socket HP rx6600
(2.8 GHz Xeon DC) result of 158174 SPECjbb2005 bops,
39544 SPECjbb2005 bops/JVM. The Sun T5120 server
has 3x better power-performance and has 21x better SWaP than the
HP rx6600.
The Sun T5120 server (single UltraSPARC T2) demonstrated 3x better
performance over the 2-socket IBM p505Q
result of 63,544 SPECjbb2005 bops,
31772 SPECjbb2005 bops/JVM. The Sun T5120
server has 2x better power-performance and has 2x better SWaP.
The SWaP metric is a measure of server efficiency ratio that
includes system performance, power and space consumption on a
specific benchmark. (SWaP = Perf /[ Space (RU) x Watts ] )
Power-performance is computed as watt/performance. Since
power-performance is related to price/performance they are
both calculated with performance in the denominator.
SPECjbb2005 Performance Chart (ordered by performance)
bops : SPECjbb2005 Business Operations per Second (bigger is better)
| System |
Date |
Processors |
Performance |
| (Chips, Cores, Threads) |
GHz CPU |
bops |
JVMs |
bops/JVM |
| Fujitsu PRIMERGY RX200 S3 |
7/07 |
(2, 8, 8) |
3GHz Xeon QC |
236416 |
4 |
59104 |
| Sun SPARC Enterprise T5120 |
10/07 |
(1, 8, 64) |
1.4GHz US T2 |
192055 |
8 |
24007 |
| Sun SPARC Enterprise T5220 |
10/07 |
(1, 8, 64) |
1.4GHz US T2 |
192055 |
8 |
24007 |
| IBM p570 |
6/07 |
(2, 4, 8) |
4.7 GHz POWER6 |
175474 |
2 |
87737 |
| HP rx6600 |
11/06 |
(4, 8, 16) |
1.6GHz Itanium2 DC |
158174 |
4 |
39544 |
| Dell PowerEdge 6950 |
1/07 |
(4, 4, 8) |
2.8GHz Opteron DC |
159382 |
4 |
39846 |
| Dell PowerEdge 860 |
1/07 |
(1, 2, 4) |
2.4GHz Xeon |
112092 |
1 |
112092 |
| IBM p570 |
6/07 |
(1, 2, 4) |
4.7GHz POWER6 |
88089 |
1 |
88089 |
| HP rx2660 |
1/07 |
(2, 4, 4) |
1.6GHz Itanium2 |
80884 |
1 |
80884 |
Complete benchmark results may be found at the SPEC benchmark website
http://www.spec.org.
Benchmark Description
SPECjbb2005 (Java Business Benchmark) measures the performance of a
Java implemented application tier (server-side Java). The benchmark is
based on the order processing in a wholesale supplier application. The
performance of the user tier and the
database tier are not measured in this test. The metrics given are
number of SPECjbb2005 bops (Business Operations per Second) and
SPECjbb2005 bops/JVM (bops per JVM instance).
Disclosure Statement:
SPECjbb2005 Sun SPARC Enterprise T5120 (1 chip, 8 cores) 192055
SPECjbb2005 bops, 24007 SPECjbb2005 bops/JVM, Sun SPARC Enterprise
T5220 (1 chip, 8 cores) 192055 SPECjbb2005 bops, 24007 SPECjbb2005
bops/JVM, Sun SPARC Enterprise T5120/T5220 results submitted to SPEC
for review, Dell PowerEdge 860 (1 chip, 4 cores) 112092 SPECjbb2005
bops, 112092 SPECjbb2005 bops/JVM, Dell PowerEdge 6950 (4 chips, 8
cores) 159382 SPECjbb2005 bops, 39846 SPECjbb2005 bops/JVM, HP rx2660
(2 chip, 4 cores) 80884 SPECjbb2005 bops, 80884 SPECjbb2005 bops/JVM,
HP rx6600 (4 chips 8 cores) 158174 SPECjbb2005 bops, 39544 SPECjbb2005
bops/JVM, IBM p570 (1 chip, 2 cores) 88089 SPECjbb2005 bops, 88089
SPECjbb2005 bops/JVM, IBM p570 (2 chips, 4 cores) 175474 SPECjbb2005
bops, 87737 SPECjbb2005 bops/JVM, IBM p505Q (2 chips, 4 cores) 63544
SPECjbb2005 bops, 31772 SPECjbb2005 bops/JVM, Fujitsu PRIMERGY RX200 S3
(2 chips, 8 cores) 236416 SPECjbb2005 bops, 59104 SPECjbb2005
bops/JVM, SPEC, SPECjbb reg tm of Standard Performance Evaluation
Corporation. Results as of 10/08/2007 on www.spec.org.
Power References:
The 2-core IBM p570 POWER6 system requires 4 RU or 4 times the rack
space of a Sun T5120 and consumes on
average 1040 Watts of power.
The 4-core IBM p570 POWER6 system requires 4 RU or twice the rack
space of a Sun T5220 and consumes on average 1040 Watts of power.
IBM p6 570 2-core & 4-core power specifications from 80% of maximum
report power consumption published here, 06/07/07, posted
here.
The IBM p505Q POWER5+ system requires 1 RU
of rack space and consumes on average 320 Watts of power. IBM p505
power specifications from 80% of maximum report power consumption
published in ?Facts and Features Report?, 03/27/06, posted
here.
The HP rx2600 server requires 2 RU of rack space and consumes on
average 563+ Watts of power. HP rx2600 power consumption estimated by
taking 70% of the maximum reported power dissipation, documented here
on 03/23/07: Actual HP power specs
here.
The HP rx6600 server requires 7 RU of rack
space and consumes on averge 1163 Watts of power. HP rx6600 power
consumption estimated by taking 70% of the maximum reported power
dissipation, documented
here on 03/23/07. The Dell PowerEdge 6950 requires 4 RU or twice the rack space
of a Sun T5220. The Dell PowerEdge 6950 power consumption from
here.
Prices based on publicly documented list prices.
Results Summary
| Results |
| |
SPECjbb2005 bops: |
|
192055 |
| |
SPECjbb2005 bops/JVM: |
|
24007 |
| |
Reference Date: |
|
Oct 9, 2007 |
| Systems: |
|
Sun SPARC Enterprise T5120, T5220 |
| Total Number Processors: |
|
1 |
| Processor/GHz of Server: |
|
UltraSPARC T2 1.4 GHz |
| Operating System: |
|
Solaris 10 8/07 |
| JVM: |
|
Java HotSpot(TM) 32-Bit Server, Version 1.6.0_04-p |
Tuesday Oct 09, 2007
The Sun SPARC Enterprise T5220 obtained a world record SPECweb2005
result 37,001 SPECweb2005 with one UltraSPARC T2
running Solaris 10 with Sun Java System Web Server.
The Sun SPARC Enterprise T5220 server delivers 22% greater
performance than the four-socket HP ProLiant DL580 G5 with 2.9 GHz
Quad-Core Xeon processors. In addition, the Sun SPARC Enterprise T5220
has 2.1x better power-performance and has 4.1x better SWaP.
Yes, beats FOUR SOCKETs filled with QUAD_CORE!
See below if you are not familiar with SWaP and why you should care
about the SWaP 'figure of merit.'
The Sun SPARC Enterprise T5220 server delivers 66% greater
performance than the 4-socket HP ProLiant DL585 G2 with 3 GHz dual-core
Opteron processors. In addition, the Sun SPARC Enterprise T5220
has 2.2x better power-performance and has 4.4x better SWaP.
There are no IBM POWER6 results on the SPECweb benchmark.
The Sun SPARC Enterprise T5220 server is 4.7 times faster than the
4-core IBM p550 1.9GHz POWER5+. In addition, the Sun SPARC Enterprise
T5220 has 5.7x better power-performance and has 11.5x better SWaP.
This
world record benchmark result
clearly demonstrates that the Sun SPARC Enterprise T5220 running the
Solaris 10 08/07 and Java System Webserver 7.0 Update 2 can support
thousands of
concurrent secure and non secure web server sessions while allowing
larger and more complex
Java applications to be run and is an industry leader in web
serving.
Cryptography performance is enhanced on the Sun SPARC Enterprise
T5220 by using UltraSPARC T2's enhanced
on-chip cryptographic hardware with Solaris 10's secured web service
software feature. SPECweb2005's banking workload
highlights the server's secure web server performance. The Sun
SPARC Enterprise T5220 (63,000
SPECweb2005_Banking) performance was 21% greater than the 2.9 GHz
Quad-Core Xeon HP ProLiant DL580 G5 (52,160
SPECweb2005_Banking).
The SWaP metric is a measure of server efficiency ratio that
includes system performance, power and space consumption on a specific
benchmark. (SWaP = Perf /[ Space (RU) x Watts ] )
One thing you'll note is Sun execs are using the term "power-performance",
maybe they've been getting the word from some of us that it should
be coputed as "watt/perf".
Power-performance is computed as watt/performance. Since
power-performance is related to $/perf they are both
calculated with "performance" in the denominator.
Competitive Landscape
Selected SPECweb2005 benchmark results as of 10/04/2007. Complete
information at: http://www.spec.org
website.
| System |
Chip, Core |
Proc GHz |
OS |
Web Server |
SPEC web 2005 |
Bank |
Ecom |
Supp |
| Sun SE T5220 |
1, 8 |
US T2/1.4 |
Solaris 08/07 |
Sun JSWS 7.0u2 |
37001 |
63000 |
49500 |
36000 |
| HP PL DL580 G5 |
4, 4 |
Xeon QC 2.993GHz |
RedHat Linux |
Rock1.4.0 JRock1.2.0 |
30261 |
52160 |
42048 |
28000 |
| HP PL DL585 G2 |
4, 2 |
Opteron DC 3GHz |
RedHat Linux |
Rock1.4.0 JRock1.2.0 |
22254 |
38400 |
30720 |
20704 |
| HP PL ML370 G5 |
4, 4 |
Xeon QC 2.66GHz |
RedHat Linux |
Rock1.4.0 JRock v1.2.0 |
19661 |
34720 |
27264 |
17792 |
| Sun Fire T2000 |
1, 8 |
US T1 1.4GHz |
Solaris 11/06 |
Sun JSWS 6.1 SP5 64b |
16407 |
25812 |
24048 |
15768 |
| Sun Fire T2000 |
1, 8 |
US T1 1.2GHz |
Solaris |
Sun JSWS 6.1 SP5 64b |
14001 |
21500 |
21500 |
13160 |
| Sun Fire T1000 |
1, 8 |
US T1 1.0 GHz |
Solaris |
Sun JSWS 6.1 SP5 64b |
10466 |
20000 |
16500 |
7700 |
| IBM p5 550 |
2, 2 |
POWER5+ 1.9GHz |
SuSE Linux |
Zeus4.3r1 Tomcat5.5.9 |
7881 |
12240 |
11820 |
7500 |
Sun SPARC Enterprise T5220 results currently under SPEC review.
Benchmark Description
SPECweb2005, is the latest
industry standard benchmark for evaluating Web Server performance
developed by SPEC. The benchmark simulates multiple user sessions
accessing a Web Server and generating static and dynamic HTTP
requests. The major features of SPECweb2005 are:
- Measures simultaneous user sessions
- Dynamic content: currently PHP and JSP implementations
- Page images requested using 2 parallel HTTP connections
- Multiple, standardized workloads: Banking (HTTPS), E-commerce
(HTTP and HTTPS), and Support (HTTP)
- Simulates browser caching effects
- File accesses more accurately simulate today's disk access
patterns
Disclosure Statement:
Sun SPARC Enterprise T5220 (8 cores, 1 chip) 37001 SPECweb2005,
submitted to SPEC for review on October 8, 2007. HP ProLiant
DL580 G5 (16 cores, 4 chips) 30261 SPECweb2005. HP ProLiant DL585 G2 (8 cores, 4 chips) 22254 SPECweb2005.; HP ProLiant ML370 G5 (16 cores, 4 chips) 19661
SPECweb2005. HP ProLiant DL580 G4 (8 cores, 4 chips) 18981
SPECweb2005. Sun Fire T2000 (8 cores, 1 chip) 16407
SPECweb2005. Sun Fire T2000 (8 cores, 1 chip) 14001
SPECweb2005. Sun Fire T1000 (8 cores, 1 chip) 10466
SPECweb2005. IBM p5 550 (4 cores, 2 chips) 7881
SPECweb2005. SPEC, SPECweb reg tm of Standard Performance
Evaluation Corporation. Results from www.spec.org as of Oct 8, 2007.
Sun SPARC Enterprise T5220 server power consumption taken
from measurements made during the benchmark run.
Power is average measured watts during
benchmark run.
HP DL580 power consumption from HP Power Calculator system configured
with 4 x2.93GHz processors, redundant PSU, 16 x 4GB DIMMs, 8 x
36GB SAS drives,1 x PCI card, 80% utilisation on 9/10/07: http://h30099.www3.hp.com/configurator/powercalcs.asp
HP DL385G2 power consumption from HP Power Calculator for system
configured with 2 x AMD 2220 2.8GHz processors, redundant PSU, 8 x 4GB
DIMMs, 2 x HBAs and 2 x 146GB SAS drives, 80% utilisation on 6/4/07: http://h30099.www3.hp.com/configurator/powercalcs.asp
IBM 550 power specifications calculated by applying 70% of the Maximum
Watts published in “Facts and Features Report”, 11/14/06, posted
atftp://ftp.software.ibm.com/common/ssi/rep_sp/n/PSB01628USEN/PSB01628USEN.PDF.
Results Summary
| Certified Results |
37,001 SPECweb2005 |
| Reference Date: |
October 9, 2007 |
| Systems: |
1 x Sun SPARC Enterprise T5220 |
| Total Number Processors: |
1 chip / 8 cores (8 threads/core) |
| CPU/GHz of Server: |
Sun UltraSPARC T2 1.4 GHz |
| Operating System: |
Solaris 10 08/07 + patches
|
| Software: |
Sun Java[TM] System Web Server 7.0 Update 2
|
Tuesday Oct 09, 2007
Earlier today I posted some crypto results, see the crypto doc for with even more details: http://blogs.sun.com/sprack
Tuesday Oct 09, 2007
Best 1 processor, two SAP SD Standard Application Benchmark. This benchmark shows that the UltraSPARC T2 is well-suited as an Oracle 10G OLTP database server.
The Sun SPARC Enterprise T5120 server with a single 1.4 GHz UltraSPARC
T2 processor set a new World Record for single processor systems
achieving 2175 SD benchmark users on the two-tier SAP Sales and
Distribution (SD) standard SAP ERP 2005 application benchmark.
The Sun SPARC Enterprise T5120 server (1.4GHz UltraSPARC T2)
outperformed the 4-core IBM System p570 (4.7 GHz POWER6) by 7%.
The 4RU IBM p570 POWER6 is 4 times larger than the 1RU Sun SPARC
Enterprise T5120 system.
The Sun SPARC Enterprise T5120 server (1.4GHz UltraSPARC T2)
is the first single processor to exceed 10,000 SAPS.
The Sun SPARC Enterprise T5120 server (1.4GHz UltraSPARC T2)
outperformed the HP BL460C with two 3 GHz Xeon quad-core processors
by 5%.
The Sun SPARC Enterprise T5120 server (1.4GHz UltraSPARC T2)
outperformed the HP DL380 G5 with two 3.0 GHz Xeon quad-core processors
by 5%.
The Sun SPARC Enterprise T5120 server (1.4GHz UltraSPARC T2)
outperformed the HP rx6600 with four 1.6 GHz Itanium dual-core processors.
The Sun SPARC Enterprise T5120 server (1.4GHz UltraSPARC T2)
outperformed all 1-chip and 2-chip systems.
SAP wants customers to comput their own perf/watt or SWaP.
The SWaP metric is a measure of server efficiency ratio that
includes system performance, power and space consumption on a
specific benchmark. (SWaP = Perf /[ Space (RU) x Watts ] )
The Sun SPARC Enterprise T5120 server (1.4GHz UltraSPARC T2)
showed a 2x improvement compared to Sun SPARC Enterprise T2000 (1.4 GHz UltraSPARC T1). The UltraSPARC T2 has twice the thread
count of the UltraSPARC T1.
SAP-SD 2-Tier Performance Table (bigger is better, sorted by perf)
| System |
Users |
# Type GHz |
GB |
OS |
DB |
LI/Hr |
SAPS |
BM rev. |
Date |
| Sun T5120 |
2175 |
1 US T2 1.4GHz |
64 GB |
Solaris 10 |
Oracle 10g |
219,000 |
10,950 |
6.0 |
09-Oct-07 |
| HP Integrity rx6600 |
2150 |
4 Itan2 1.6GHz |
48 GB |
HP-UX 11iV3 |
Oracle 10g |
215,670 |
10,780 |
6.0 |
27-Nov-06 |
| HP ProLiant BL685c |
2100 |
4 Opt 3GHz |
32 GB |
Windows 2003 EE |
SQL 2005 |
210,670 |
10,530 |
6.0 |
03-Sep-07 |
| HP ProLiant DL460c |
2080 |
2 Xeon 3GHz |
32 GB |
Windows 2003 EE |
SQL 2005 |
208,000 |
10,400 |
6.0 |
03-Sep-07 |
| HP ProLiant DL380 G5 |
2080 |
2 Xeon 3GHz |
32 GB |
Windows 2003 EE |
SQL 2005 |
208,670 |
10,430 |
6.0 |
03-Sep-07 |
| IBM p 570 |
2035 |
4-core POWER6 4.7GHz |
32 GB |
AIX 5L 5.3 |
Oracle 10g |
203,670 |
10,180 |
6.0 |
21-May-07 |
| Fujitsu BX620 S4 |
1940 |
2 Xeon 3GHz |
32 GB |
Windows 2003 EE |
SQL 2005 |
194,000 |
9,700 |
6.0 |
13-Aug-07 |
| Sun Fire T2000 |
1100 |
1 US T1 1.4GHz |
64 GB |
Solaris 10 |
Oracle 10g |
110,670 |
5,530 |
6.0 |
22-Aug-07 |
| HP Integrity rx2660 |
1090 |
2 Itan2 1.6GHz |
32 GB |
HP-UX 11iV3 |
DB2 9 |
109,670 |
5,480 |
6.0 |
20-Mar-07 |
| HP ProLiant DL365 |
1083 |
2 Opt 2.8GHz |
32 GB |
Windows 2003 EE |
SQL 2005 |
108,670 |
5,430 |
6.0 |
09-Feb-07 |
| Fujitsu BFi20 S2 |
1020 |
2 Xeon 3GHz |
16 GB |
Solaris 10 |
Oracle 10g |
102,330 |
5,120 |
6.0
Uni
code |
04-May-07 |
| IBM x3250 |
850 |
1 Xeon 2.13GHz |
8 GB |
Windows 2003 EE |
DB2 9 |
88,000 |
4,400 |
6.0 |
11-May-07 |
Complete benchmark results may be found at the SAP benchmark website http://www.sap.com/solutions/benchmark.
Benchmark Description
The SAP Standard Application SD (Sales and Distribution) Benchmark is a
two-tier ERP business test that is indicative of full business workloads
of complete order processing and invoice processing, and demonstrates the
ability to run both the application and database software on a single
system. The SAP Standard Application SD Benchmark represents the critical
tasks performed in real-world ERP business environments.
SAP is one of the premier world-wide ERP application providers, and maintains
a suite of benchmark tests to demonstrate the performance of competetive
systems on the various SAP products.
Disclosure Statement:
Two-tier SAP Standard Sales and Distribution (SD) standard SAP ERP 2005 application benchmark: SPARC Enterprise Model T5120 (1-way, 1 proc, 8 cores, 64 threads) 1 x 1.4 GHz UltraSPARC T2, 64GB memory, 2175 SD Benchmark users, 1.91 sec avg response time, Cert#2007059, Oracle 10g, Solaris 10; SPARC Enterprise Model T2000 | Sun Fire T2000 (1-way, 1 proc, 8 cores, 32 threads) 1 x 1.4 GHz UltraSPARC T1, 64GB memory, 1100 SD Benchmark users, 1.91 sec avg response time, Cert#2007051, Oracle 10g, Solaris 10; HP ProLiant BL460c (2-way, 2 processors, 8 cores, 8 threads) 2 x 3.0 GHz Quad-Core Intel Xeon, 32GB memory, 2080 SAP SD Benchmark users, 1.99 sec avg response time, Cert#2007054, SQL Server 2005, Windows Server 2003 Enterprise Edition; HP ProLiant DL380 G5 (2-way, 2 processors, 4 cores, 4 threads) 2 x 3.0 GHz Quad-Core Intel Xeon, 32GB memory, 2080 SAP SD Benchmark users, 1.95 sec avg response time, Cert#2007057, SQL Server 2005, Windows Server 2003 Enterprise Edition; HP Integrity rx6600 (4-way, 4 processors, 8 cores, 16 threads) 4 x 1.6 GHz Dual-Core Intel Itanium, 48GB memory, 2150 SAP SD Benchmark users, 1.97 sec avg response time, Cert#2006083, Oracle 10g, HP-UX 11iV3; IBM System p 570 (2-way, 2 processors, 4 cores, 8 threads) 2 x 4.7 GHz POWER6+, 32GB memory, 2035 SD Benchmark users, 1.99s avg resp time, Cert#2007037, Oracle 10g, AIX 5L Version 5.3;
SAP, R/3, mySAP reg TM of SAP AG in Germany and other countries. More info www.sap.com/solutions/benchmark.
Submitted results for the SAP-SD 2-Tier benchmark
| Certified Results |
|
Performance: |
|
2175 benchmark users |
|
Server: |
|
Sun SPARC Enterprise |
|
Processors: |
|
1 x 1.4 GHz UltraSPARC T2 |
|
Memory: |
|
64 GB |
|
Operating system: |
|
Solaris 10 |
|
Database S/W: |
|
Oracle 10g |
|
SAP S/W: |
|
SAP ECC 6.0 |
|
SAP Certification: |
|
2007059 |
|
Storage: |
|
2 x Sun StorEdge(tm) 3510 FC Array Rack Mounted |
Tuesday Oct 09, 2007
The Sun SPARC Enterprise T5220 (one UltraSPARC T2), using Lotus
Domino 7.0.1 mail server delivered industry-leading results with
best per-socket performance and best power-performance for the Lotus[R]
R6iNotes on Domino mail server benchmark. The Sun SPARC Enterprise
T5220 has better $/performance than all IBM and HP servers on this
benchmark.
The Sun SPARC Enterprise T5220
server achieved 43,000 users on the Lotus Domino 7.0.1
Messaging server running the HTTP based R6iNotes benchmark.
The Sun SPARC Enterprise T5220 is 35% faster than the 4-core IBM P550Q 1.5GHz
POWER5+ server at 55% less price/performance. In addition, the Sun
SPARC Enterprise T5220 server has 2.9x better power-performance and
has 5.7x better SWaP.
The Sun SPARC Enterprise T5220
performed 2.3x (!) faster than the HP Proliant DL580 and achieved 30%
less price/performance. In addition, the Sun SPARC Enterprise T5220
R6iNotes has 4.3x better power-performance and has 8.6x better SWaP.
The Sun SPARC Enterprise T5220
server using a single 1.4GHz UltraSPARC T2 achieved only 22% less
performance than 16-core IBM P560Q but Sun has 46% better $/perf. In
addition, the Sun SPARC Enterprise T5220 has 2.9x better
power-performance and 12x better SWaP.
The
SWaP metric is a measure of Server effeciency ratio that includes
System performance, power and space consumption on a specific
benchmark (SWaP = Performance/[Space(RU)xWatts])
power-performance
is computed as Watts/performance. Since power-performance is related
to price/performance they are both calculated with performance in
the denominator
Lotus Domino 7.0.1 NotesBench R6iNotes Performance Chart (in
increasing $/User order)
Users = number of users supported (bigger is better)
NotesMark
= the benchmark metric (bigger is better)
$/User = cost per user
(smaller is better)
| System |
# Type GHz |
OS |
$/User |
Users |
Notes
Mark |
#Ptn |
Resp |
Sun Fire
X4200 M2 |
2 Opt DC 2.8GHz |
RedHat Linux4 |
$2.66 |
17000 |
14347 |
3 |
496ms |
| Sun SE T5220 |
1 US T2 1.4GHz |
Solaris10 |
$2.89 |
43000 |
36240 |
6 |
584ms |
| HP DL380G5 |
2 Xeon DC 3GHz |
Windows 2003 |
$3.15 |
19000 |
15750 |
3 |
868 ms |
| IBM X3650 |
2 Xeon DC 3GHz |
SUSE9 Linux |
$3.47 |
22000 |
18989 |
3 |
3056ms |
| Sun Fire
T2000 |
1 UST1 1.2GHz |
Solaris10 |
$3.94 |
19000 |
16061 |
4 |
400ms |
| HP Proliant
DL580 G3 |
4xXeon DC 3GHz |
Windows 2003 |
$4.15 |
18500 |
15953 |
4 |
434ms |
| Sun Fire
T2000 |
1 UST1 1.4GHz |
Solaris10 |
$4.48 |
23200 |
19518 |
4 |
692ms |
| IBM eServer 560Q |
4 POWER5+ QC 1.8GHz |
AIX5L V5.3 |
$4.89 |
55000 |
46193 |
6 |
848ms |
| IBM 550Q |
2 POWER5 QC 1.5GHz |
AIX5L V5.3 |
$5.97 |
24000 |
20108 |
4 |
932ms |
| Sun Fire V890 |
8 US IV+ DC 1.8GHz |
Solaris10 |
$7.19 |
40000 |
33862 |
4 |
324ms |
Complete benchmark results may be found at the Lotus NotesBench
website http://www.notesbench.org.
Benchmark Description
The benchmark simulates active users accessing their Domino[R]
R6iNotes mail files via standard Web browser. Each simulated user
periodically sends, retrieves, and deletes a specified number of
e-mail messages from a browser. An average user runs this script four
times per hour.
The R5iNotes and R6iNotes workloads, using the Lotus Domino Mail
server (R5 or R6) are both HTTP based workloads. R6iNotes is heavier
with added features and larger mail files using the MIME format.
The Lotus Webmail and iNotes workloads are NOT comparable.
Disclosure Statement:
NotesBench R6iNotes Sun SPARC Enterprise T5220 (1chip,
8cores/chip@1.4GHz UltraSPARC T2, 8threads/core, 64GB), 6
partitions, Solaris[TM] 10 , Lotus[R] Domino 7.0.1, 43000 users,
$2.89per user, 36240 NotesMark tpm, 584ms avg rt. , IBM eServer
550Q, 8x1.5GHz POWER5, 32GB, 4 partitions, AIX 5L V5.3, Lotus Domino
7.0, 24000 users, $5.97 per user, 20108 NotesMark tpm, 932 ms avg
rt., HP DL380G5, 2x3.0GHz, Intel Xeon 5160, 6GB, 3 partitions,
Windows Server 2003, Lotus[R] Domino 7.0.1, 19000 users, $3.15 per
user, 15750 NotesMark tpm, 868ms avg rt.,
IBM p5 560Q POWER5+ (16x1800 MHz POWER5+),
6 partitions, AIX 5L V5.3, Lotus[R] Domino 7.0.1, 55000 users, $4.89
per user, 46193 NotesMark tpm, 848 ms avg rt.
More info: www.notesbench.org
HP DL380G5 power consumption estimated by taking 70% of the
maximum input wattage rating of 1193W reported
here on 11/14/06.
IBM p5 550Q power specifications calculated by applying 70% of the
maximum Watts published in "Facts and Features Report",
11/14/06, posted
here. Sun SPARC Enterprise T5220 server
Power consumption has been taken during the full benchmark
execution.
Results Summary
| Audited Results |
| |
Users: |
| 43000 |
| |
NotesMark: |
|
36240 |
| |
Price Performance: |
|
$2.89 $/User |
| |
Price Performance: |
|
$1.186 $ /NotesMark |
| |
Response: |
|
584 ms |
| Systems: |
|
One Sun SPARC Enterprise T5220 |
| Number Processors: |
|
1 UltraSPARC T2 |
| Processor GHz: |
|
1.4GHz |
| Storage: |
|
4xSTK2540, 3xSTK2501 (12x73GB) |
| Notes Version: |
|
Lotus Domino 7.0.1 |
| |
#Domino Partition |
|
6 |
| Operating System: |
|
Solaris 10 |
| Cost: |
|
$124,275.44 |
| Other Performance Metrics |
|
| |
Users/CPU: |
|
43000 |
| |
Users/Core |
|
5375 |
Tuesday Oct 09, 2007
The Sun SPARC Enterprise T5220 server
delivers the best performance on the SPEC OMPM2001
benchmark for a single chip.
These results were run on the Sun SPARC Enterprise T5220 server
using the 1.4GHz UltraSPARC T2 processor.
These results also apply to the electronically equivalent
Sun SPARC Enterprise T5120 server.
The Sun SPARC Enterprise T5220 server
running the UltraSPARC T2 at 1.4 GHz,
beat all single chip scores running SPECompM2001 with
a score of 16208.
The Sun SPARC Enterprise T5220 running at 1.4 GHz beat the best
IBM single chip result (POWER5+) by 98%. Oh but what about IBM
POWER6??? IBM has not published any POWER6 based results in this price range.
Given Sun's results will they every publish?
The Sun SPARC Enterprise T5220 server, powered by a single UltraSPARC T2
processor, topped the result of the two-socket AMD quad-core
2 GHz processor result running
SPECompM2001.
SPECompM2001 Performance (ordered by peak, bigger is better)
| Result |
Chips |
Cores |
OpenMP
Thrds |
System |
| Peak |
Base |
| 19653 |
18949 |
4 |
8 |
8 |
Sun Blade X8400, Opt885, 2.6 GHz |
| 16208 |
14399 |
1 |
8 |
63 |
Sun SE T5120/T5220, US T2, 1.4 GHz |
| 16117 |
15530 |
2 |
8 |
8 |
Tyan n4250QE, Opt2350, 2.0 GHz |
| 16096 |
14335 |
2 |
4 |
8 |
IBM p5 570, POWER5, 1.9 GHz |
| 8174 |
8141 |
1 |
2 |
4 |
IBM p5 520, POWER5+, 1.9 GHz |
| 6837 |
6573 |
1 |
2 |
2 |
Sun Fire X2100 M2, Opteron 1218, 2.6 GHz |
Select results from www.spec.org
Benchmark Description
The SPEC OMPM2001 Benchmark Suite was released in June 2001 and
tests HPC performance using OpenMP for parallelism.
-
11 programs (3 in C and 8 in Fortran)
parallelized using OpenMP API
Goals of suite:
- Targeted to mid-range (4-32 processor) parallel systems
- Run rules, tools and reporting similar to SPEC CPU2000
- Programs representative of HPC and Scientific Applications
Disclosure Statement:
SPEC, SPEComp reg tm of Standard Performance Evaluation Corporation.
Sun result submitted to SPEC. Other results fromwww.spec.org as of 10/01/07.
Sun SPARC Enterprise T5220 (1 chip, 8 cores, 64 threads, 1.4 GHz)
16208 SPECompM2001,
IBM p5 520 (1 chip, 2 cores, 4 threads, 1.9 GHz) 8174 SPECompM2001,
AMD Tyan Thunder N4250QE (2 chips, 8 cores, 8 threads, 2.0 GHz)
16117 SPECompM2001.
Results Summary
SAE (Strategic Applications Engineering) has submitted results
for the SPEComp2001 benchmark.
| Result |
|
Sun SPARC Enterprise T5120/T5220: |
|
16208 SPECompM2001 |
| Reference Date: |
|
Oct 09, 2007 |
| Operating System: |
|
Solaris 10 8/07 |
| Compiler: |
|
Sun Studio 12 |
Tuesday Oct 09, 2007
Today, Sun submitted the SPECint_rate2006 and SPECfp_rate2006
Single-Chip World Records on the Sun SPARC Enterprise T5120/T5220.
What are these servers? UltraSPARC T2 1.4GHz servers that you will
hear loads more on today.
The Sun SPARC Enterprise T5120 is the 1RU version, and the
Sun SPARC Enterprise T5220 is the 2RU version, both of these
servers are electronically equivalent with the 2RU having a bit more
connectivity and storage if you need.
The Sun SPARC Enterprise T5220 server, running at 1.4 GHz, beat all single-chip results running SPECint_rate2006 with a result of 78.5.
The Sun SPARC Enterprise T5220 server beats the best single IBM 4.7 GHz dual-core POWER6 processor result by 29% and beat the best published single
3 GHz Xeon quad-core by 28% on SPECint_rate2006. There are no single quad-core Opteron results published for SPECint_rate2006.
"but I've heard there is no floating point on Niagara processors 
Nay, the 1.4GHz UltraSPARC T2 in the Sun SPARC Enterprise T5220 server, beat
all single-chip results running SPECfp_rate2006 with a result of 62.3.
The Sun SPARC Enterprise T5220 server beat the best single IBM 4.7 GHz
POWER6 processor based system result by 7% and beats the best published
single 3 GHz quad-core Intel Xeon by 61% for SPECfp_rate2006.
There are no single quad-core Opteron results published for SPECfp_rate2006.
SPEC CPU2006 Performance Charts -
bigger is better, selected recent results,
please see
www.spec.org for complete results.
SPECint_rate2006
| System |
Procs |
Perf Results |
| Type |
GHz |
Chips
Cores |
Threads |
Peak |
Base |
| T5120/T5220 |
UltraSPARC T2 |
1.4 |
1, 8 |
64 |
78.5 |
73.0 |
| HP DL380 G5 |
Intel X5365 |
3.0 |
1, 4 |
4 |
61.3 |
53.8 |
| IBM p 570 |
Power6 |
4.7 |
1, 2 |
4 |
60.9 |
53.2 |
| Fujitsu RX300 |
Intel X5355 |
2.66 |
1,4 |
4 |
52.8 |
50.5 |
SPECfp_rate2006
| System |
Processors |
Performance Results |
| Type |
GHz |
Chips, Cores |
Threads |
Peak |
Base |
| T5120/T5220 |
UltraSPARC T2 |
1.4 |
1, 8 |
64 |
62.3 |
57.9 |
| IBM p 570 |
Power6 |
4.7 |
1, 2 |
4 |
58.0 |
51.5 |
| HP DL380 G5 |
Intel X5365 |
3.0 |
1, 4 |
4 |
38.8 |
36.4 |
| Fujitsu RX300 |
Intel X5355 |
2.66 |
1, 4 |
4 |
37.5 |
36.2 |
Results as of 27 Sep 2007 from www.spec.org.
Benchmark Description
SPEC CPU2006 is made up of two suites of benchmarks, CFP2006 and
CINT2006. CFP2006 targets floating-point performance, while CINT2006
targets integer performance.
Each suite has two different measures. First is the CPU measure, which
is the performance on the suite as a single stream. This can be either
a single thread or automatic compiled parallel run. This measure is
further defined by base and optimized runs. Base uses the same compiler
flags for all kernels, where optimized is allowed to use different
compiler flags for each kernel. Results are compared against a baseline
system run that was standardized by SPEC.
The second measure is Rate. It is a measure of how many CPU measures
can be run at a time. Typically, it is run as n processes on n
processors. It shows how well the same job mix can run on a system
under some load. It also is run as a base and optimized set of
results.
Disclosure Statement:
SPEC, SPECint reg tm of Standard Performance Evaluation Corporation.
Sun result submitted to SPEC, other results from www.spec.org as of 9/27/07.
Sun SPARC Enterprise T5220/T5120 (UltraSPARC T2, 1 chip, 8 cores),
78.5 SPECint_rate2006, IBM p570 (POWER6, 1 chip, 2 cores), 60.9 SPECint_rate2006, HP DL380 G5 (X5365, 1 chip, 4 cores), 61.3 SPECint_rate2006,
Sun SPARC Enterprise T5220 (UltraSPARC T2, 1 chip, 8 cores),
62.3 SPECfp_rate2006.
SPEC, SPECfp reg tm of Standard Performance Evaluation Corporation.
Sun result submitted to SPEC, other results from www.spec.org as of 9/27/07.
Sun SPARC Enterprise T5220/T5120 (UltraSPARC T2, 1 chip, 8 cores),
62.3 SPECfp_rate2006.
IBM p570 (POWER6, 1 chip, 2 cores), 58.0 SPECfp_rate2006,
Sun SPARC Enterprise T5220 (UltraSPARC T2, 1 chip, 8 cores),
62.3 SPECfp_rate2006.
HP DL380 G5 (X5365, 1 chip, 4 cores), 38.8 SPECfp_rate2006.
System Configuration
| Results |
| Reference Date: |
|
Oct 09, 2007 |
| System: |
|
Sun SPARC Enterprise T5120/T5220 |
| Processor: |
|
Sun UltraSPARC T2, 1.4 GHz |
|
|
|
78.5 SPECint_rate2006 |
|
|
|
62.3 SPECfp_rate2006 |
| Software: |
|
Solaris 10, Sun Studio 12 Compiler |
Friday Oct 05, 2007
First:
"First of all, the math is really simple. 4.7 is greater than 1.4. IBM's POWER6 4.7 GHz chip is faster than Sun's 1.4 GHz UltraSPARC T1 chip. And second of all, the IBM System p 570 remains the #1 SPECjbb2005 2-core result (1)."
- Elisabeth Stahl, program manager of IBM performance marketing, 20 years experience, Jun07
Issues:
Did not compare system or chip performance but only quoted GHz of a chip.
Made a true statement about core count but ignored that that IBM core costs an order of magnitude more than Sun T1 on a per core basis
Next:
"Even more impressive, the processor bandwidth of the POWER6 chip – 300 gigabytes per second -- could download the entire iTunes catalog in about 60 seconds" - IBM Press Release http://www-03.ibm.com/press/us/en/pressrelease/21580.wss
Issues:
Added every bandwidth (L3 cache, address bandwidth?!?,...) in a chip,
even though peak memory bandwidth is limited to at least a 10th of that, delivered is a lot less.
stated "processor bandwidth", even though "delivered" system bandwidth would actually be required to move the data (not address ).
Next:
"IBM calculates that 30 SunFire v890s can be consolidated into a single rack of the new IBM machine, saving more than $100,000 per year on energy costs (3)." - IBM Press Release http://www-03.ibm.com/press/us/en/pressrelease/21580.wss
Issues:
used 2 year old sun result compared to power6 yet to be shipped as of may press release
implied V890, so that people think it is a current comparison, had to read in the footnotes that it was 1.5 GHz slower CPU. Sun has introduced 1.8GHz, and 2.1GHz since.
made a "conservative" comparisons by giving IBM another 15% in performance
claimed Sun at 20% util and IBM at 60% util to get bogus 3x factor
never showed exactly what power was drawn by a 4.7GHz, 64GB memory system,
at ??MHz DDR2 used in the comparison, etc.
...and many more.
Next:
"...And the good news is that about 40-70% of the
stuff we do in performance tuning actually ends up helping end users,"
-- Bruce Lindsay(IBM Fellow), May 06, http://www.sigmod.org/sigmod/record/issues/0506/p71-column-winslet.pdf
"This is feasible in the TPC-C benchmark because there
are only five tables and only ten to fifteen columns in each table.
In a more realistic application, where there are many more queries
to be considered, the tables are typically much, much wider, in
the 80 to 100 column range; and there are dozens if not thousands
of tables. Then this kind of analysis(ed note: tuning) is no longer
practical." -- Bruce Lindsay(IBM Fellow since '96), May 06, http://www.sigmod.org/sigmod/record/issues/0506/p71-column-winslet.pdf
"The idea is to get the numbers by hook and by crook." -- Bruce Lindsay(IBM Fellow since '96), May 06, http://www.sigmod.org/sigmod/record/issues/0506/p71-column-winslet.pdf
The TPC-C benchmark is an industry standard for measuring the ability of a system to process complex online transactions and large volumes of business data. The TPC-C benchmark is unique in the way it exercises all components of a system, including processors, memory, networking, storage, operating system and database software, demonstrating total system performance in a way that many of the other benchmarks touted by some competitors do not. -- Bruce Lindsay(IBM Fellow since '96), July 25, 2006, http://www-03.ibm.com/solutions/sap/doc/content/news/pressrelease/1623288130.html
Issues:
This means that 30% to 60% of IBM's TPC-C tuning is useless for customers.
IBM clearly over-hyped TPC-C, just 2-3 months after they publicly showed all of its problems and "optimizations" they used.
Next:
"Significantly, the high utilization rate of the System z9 mainframes -- systems can and do operate at 80 to 100 percent utilization -- combined with its ability to "virtualize" workloads, can enable a single mainframe processor to perform far more work than a single x86 processor running Microsoft Windows. The latter may run as low as 5 percent utilization." - IBM Press Release http://www-03.ibm.com/press/us/en/pressrelease/19577.wss
Issues:
very convenient to use different work for mainframe and for its competitor.
"mainframes do operate at 80-100%", "x86 processor running Microsoft Windows. The latter may run as low as 5%". So it is a valid but totally useless statement.
"do" and "may" mean very different things
An equally invalid statement: x86 do operate at 80-100% and
mainframes may run as low as 5%.
Moral: Be VERY VERY CAREFUL when you read big blue.
Disclosure statement:
TPC-C is a trademark of Transaction Processing Performance Council (TPC). More info www.tpc.org.
Thursday Sep 20, 2007
In a video, Prof. David Patterson opines on UltraSPARC T2 and how Sun's CMT
has some very fresh ideas to move the industry forward on practical
computing. He talks about the Old-fashioned and out-dated concepts of "peak" or "clock speed" and the need to look at delivered performance.
here, here!!!
He shows that the UltraSPARC T2 out of box is almost 1.5x to 2x faster
than Clovertown(quad-core) & Opteron and three to four times the
watt/performance advantage. In addition, he says the UltraSPARC T2 is
the easiest to program and auto-tune.
He did conceded that if you look at the archaic (he used the word
"old-fashioned") 20th century metrics of peak and clock that the
UltraSPARC T2 is 2x to 7x slower -- but he (like I) focus on delivered
performance.
David Patterson is a Professor in Computer Science at Univ of
California Berkeley. David and John Hennessy (Stanford University)
wrote the textbook "Computer Architecture: A Quantitative Approach Fourth Edition"
AFTERNOTE #1
To respond the the comment below (comments are now closed). I'm sure the professor will give us more details and comparison of floating-point performance on important applications between the UltraSPARC T2 and the various X64 architectures, he's very complete and thoughtful.
In terms of other comparisons. There are cpu benchmarks (int & fp) comparisons that were done at UltraSPARC T2 launch, best chip in several comparisons. There will probably be more
even results before long on commercial benchmarks.
AFTERNOTE #2
Wednesday Aug 29, 2007
There is more preliminary UltraSPARC T2 performance is blogged about at:
http://blogs.sun.com/jmeyer/entry/power6_goes_thud_part_v
Where John states:
And IBM knows that next quarter, Sun will be introducing systems based on the new UltraSPARC T2, the world's first true system-on-a-chip and the world's fastest microprocessor. Preliminary estimates on one popular benchmark show that a single rack of UltraSPARC T2-based systems will outperform four racks of 4.7GHz POWER6-based p5 570s (more on that as we get closer to system announcement). No kidding.
I haven't seen this internal info yet, but I'll try to dig it up. Looking
at other tests, I believe this one.
...John also talks more about the lagging IBM POWER6 rollout.
Thursday Aug 23, 2007
In the last posting we showed Oracle Database with SAP-SD benchmarks all
running on a Sun Fire T2000. As Sun has been saying since Day one of CMT.
Major databases are perfectly matched for UltraSPARC T1. By the way Sun
has also used Open source databases on benchmarks as well.
We have lots of customers deploying RDBMS on UltraSPARC T1 and planning
on UltraSPARC T2 servers. It really works well even though competitors
and doubters want to try to say it is special purpose, sorry it isn't.
Here is an opinion:
"Now Sun's T2 is out and it's pretty much the world beater they promised -
30% faster on SPEC throughput than IBM's 4.7 Ghz Dual core Power6 and,
more significantly, one third the cost and somewhere between two and three
times the throughput of the Itanium. ... anyone still buying HP-UX and
Itanium after Rock comes out will be doing it because they hate Sun and are
quietly hoping for a miracle, just as DEC's partisans (and HP's own MPE
customer base) did before them." -- zdnet's Paul Murphy
Source: "A Dumb prediction: IBM will Buy HP's Unix Customers," By Paul Murphy, zdnet, 08/17/07,
http://blogs.zdnet.com/Murphy/?p=941
Thursday Aug 23, 2007
The SPARC Enterprise Model T2000 | Sun Fire Model T2000 is the performance leader in Two-Tier SAP-SD Standard Application Benchmarks on single processor systems as of August 22nd, 2007. This result used the Oracle database on the UltraSPARC T1. Again as Sun has always maintained the UltraSPARC T1 is good at database-tier, application tier, and web tier!
- Sun Fire Model T2000 supported 1100 SD Benchmark Users, 5530 SAPS, using Oracle 10g is the fastest single-processor systems.
- Sun Fire Model T2000 beats a 2-chip dual-core Itanium2-based HP Integrity rx2660.
- Sun Fire Model T2000 beats a 2-chip dual-core Opteron-based HP ProLiant DL365.
- Sun Fire Model T2000 beats a 2-chip dual-core Xeon-based Fujitsu BFi20 S2 (Unicode).
- The Fujitsu BX620 S4 that uses two-chip 3GHz Xeon Quad-cores is only 1.8x faster than a single chip Sun Fire Model T2000 using UltraSPARC T1.
- The IBM p570 that uses two-chip 4.7GHz POWER6 is only 1.8x faster than a single chip Sun Fire Model T2000 using UltraSPARC T1.
- The just-announced UltraSPARC T2 has twice the thread count of the
UltraSPARC T1.
SAP-SD 2-Tier Performance, Benchmark Users (bigger is better)
| Sys |
Users |
# / GHz / Type |
Mem |
OS |
DB |
LI/Hr |
SAPS |
BM rev |
Date |
| IBM p570 |
2035 |
two 4.7 POWER6+ DC |
32 GB |
AIX 5L 5.3 |
Oracle 10g |
203,670 |
10,180 |
6.0 |
5/21/07 |
| Fujitsu BX620 S4 |
1940 |
two 3.0 Xeon QC |
32 GB |
Windows Srvr 2003 EE |
SQL Server 2005 |
194,000 |
9,700 |
6.0 |
8/13/07 |
| Sun Fire T2000 |
1100 |
one 1.4 US T1 |
64 GB |
Solaris 10 |
Oracle 10g |
110,670 |
5,530 |
6.0 |
8/22/07 |
| HP Integrity rx2660 |
1090 |
two 1.6 Itan2 DC |
32 GB |
HP-UX 11iV3 |
DB2 9 |
109,670 |
5,480 |
6.0 |
3/20/07 |
| HP ProLiant DL365 |
1083 |
two 2.8 Opt DC |
32 GB |
Windows Srvr 2003 EE |
SQL Srvr 2005 |
108,670 |
5,430 |
6.0 |
2/9/07 |
| Fujitsu BFi20 S2 Unicode |
1020 |
two 3 Xeon 5160 DC |
16 GB |
Solaris 10 |
Oracle 10g |
102,330 |
5,120 |
6.0 |
5/4/07 |
| IBM p550 |
1000 |
four 1.9 POWER5+ DC |
32 GB |
SuSE Linux ES9 |
DB2 UDB 8.2.2 |
100,330 |
5,020 |
5.0 |
10/04/05 |
| Sun Fire T2000 |
950 |
one 1.2 US T1 |
32 GB |
Solaris 10 |
MaxDB 7.5 |
95,670 |
4,780 |
5.0 |
11/17/05 |
| IBM x3250 |
850 |
one 2.13 Xeon |
8 GB |
Windows SrVr 2003 EE |
DB2 9 |
88,000 |
4,400 |
6.0 |
5/11/07 |
Complete benchmark results may be found at the SAP benchmark website http://www.sap.com/benchmark.
Benchmark Description
The SAP Standard Application SD (Sales and Distribution) Benchmark is a
two-tier ERP business test that is indicative of full business workloads
of complete order processing and invoice processing, and demonstrates the
ability to run both the application and database software on a single
system. The SAP Standard Application SD Benchmark represents the critical
tasks performed in real-world ERP business environments.
SAP is one of the premier world-wide ERP application providers, and maintains
a suite of benchmark tests to demonstrate the performance of competetive
systems on the various SAP products.
SAP has specified that the Benchmark Users metric is the only metric to be used
for public comparisons.
However, Benchmark Users can be traded off with response time in performance
tuning, and so comparing Line Items per Hour or SAPS
may be a different way to compare the actual power of systems.
Funny that Sun compares against current IBM results, IBM bloggers
decide to do funny comparisons on a different SAP benchmark, but
compared their latest system to a 16-month old result on a US-IV system
that is 2 processor GHz upgrades behind. I guess that is one way to win...
Disclosure Statement:
Two-tier SAP Standard Sales and Distribution (SD) standard SAP ERP 2004/2005 application benchmark:
SPARC Enterprise Model T2000 | Sun Fire T2000 (1-way, 1 proc, 8 cores, 32 threads) 1 x 1.4 GHz
UltraSPARC T1, 64GB memory, 1100 SD Benchmark users, 1.91 sec avg response time,
Cert#2007051, Oracle 10g, Solaris 10;
Sun Fire T2000 (1-way, 1 proc, 8 cores, 32 threads) 1 x 1.2 GHz
UltraSPARC T1, 32GB memory, 950 SD Benchmark users, 1.91 sec avg response time,
Cert#2005047., MaxDB 7.5 database, Solaris 10;
Fujitsu Siemens Computers PRIMERGY MOdel BX620 S4
(2-way, 2 procs, 8 cores, 8 threads), 2 x 3.0 GHz Quad-Core Intel Xeon,
32 GB memory, 1940 SD Benchmark users, 1.99 sec avg response time,
Cert#2007049, SQL Server 2005, Windows Server 2003 Enterprise Edition;
HP ProLiant DL365 (2-way, 2 procs, 4 cores, 4 threads)
2 x 2.8 GHz Opteron, 32GB memory, 1083 SAP SD Benchmark users,
1.98 sec avg response time, Cert#2007006, SQL Server 2005,
Windows Server 2003 Enterprise Edition;
HP Integrity rx2660 (2-way, 2 procs, 4 cores, 8 threads)
2 x 1.6 GHz Itanium, 32GB memory, 1090 SAP SD Benchmark users,
1.93 sec avg response time, Cert#2007016, DB2 9, HP-UX 11iV3;
IBM System p 570 (2-way, 2 procs, 4 cores, 8 threads) 2 x 4.7 GHz
POWER6+, 32GB memory, 2035 SD Benchmark users, 1.99s avg resp time, Cert#2007037, Oracle 10g, AIX 5L Version 5.3;
Fujitsu Siemens Computers PRIMERGY Model BFi20 S2 (2-way, 2 procs, 4 cores, 4 threads)
2 x 3GHz Intel Xeon 5160 dual-core, 16GB memory,(Unicode) 1020 SAP SD Benchmark users,
1.94 sec avg response time, Cert#2007031, Oracle 10g, Solaris 10;
IBM System x3250 (1-way, 1 proc, 4 cores, 4 threads) 1 x 2.13 GHz
Xeon, 8GB memory, 850 SD Benchmark users, 1.59s avg resp time, Cert#2007036,
DB2 9, Windows Server 2003 Enterprise Edition;
IBM System eServer p5 550 (4-way, 4 procs, 4 cores, 8 threads) 4 x 1.9 GHz
POWER5+, 32GB memory, 1000 SD Benchmark users, 1.97s avg resp time, Cert#2005040,
IBM DB2 Universal Database 8.2.2, SuSE Linux Enterprise Server 9;
SAP, R/3, mySAP reg TM of SAP AG in Germany and other countries.
More info http://www.sap.com/benchmark.
| Certified Results |
|
Performance: |
|
1100 benchmark users |
|
Server: |
|
Sun Fire |
|
Processors: |
|
1 1.4 GHz UltraSPARC T1 |
|
Memory: |
|
64 GB |
|
Operating system: |
|
Solaris 10 |
|
Database S/W: |
|
Oracle 10g |
|
SAP S/W: |
|
SAP ECC 6.0 |
|
SAP Certification: |
|
2007051 |
|
Storage: |
|
Sun StorEdge 6020 |
Thursday Aug 09, 2007
Postscript:
Be careful when comparing performance results, as an example look at
a comment in yesterday's
"Can I use 64 threads in a chip?" posting. At
least this comment pointed out that you can use 4-8 threads in 2 chip Intel-based systems, but it was really trying to
be a stab at UltraSPARC Performance. Here was the comment:
One really needs to look at the complete data on those .pdf's
to make a fair comparison (also in the disclosure statement
below).
First: The T2000 SAP-SD used a 1.2GHz UltraSPARC T1, Sun now ships faster 1.4GHz UltraSPARC T1, and has announced 1.4GHz UltraSPARC T2. The 1.4GHz T2 has double the threads of that 1.4GHz (double the computational power).
Second: The T2000 SAP-SD result was submitted in Dec 2005, at that time it
was near the performance of the expensive 4-way POWER5 IBM p550.
Third: The 2-chip Dual-core Xeon SAP-SD result above was
submitted 18 months after the T2000 SAP-SD result.
Fourth: Different versions of the benchmark. The 2-chip
Dual-core Xeon was run with ECC 6.0 (not SAP 5.0). The a newer version
of the benchmark takes more computational work to produce the same results.
Dual-core SAP-SD result was also run with Solaris 10 on Xeon, how cool is that!
Fifth: The 2-chip quad-core Xeon SAP-SD result above was
submitted 19 months after the T2000 SAP-SD result.
Sixth: The Sun result used open-source MySQL MaxDB database,
how cool is that! The Xeon results used Oracle or MicroSoft SQL Server.
postscript:
Sun latter used Oracle, others suggested US T1 has some sort of silly database limitation - NOT TRUE!
You'll see more results soon.
Triffids, as a reminder if you work for a partner company of SAP you must
put the following disclosures when you post results. If you are not
they you don't need to put this in, but as you can see the data in
it would have allowed you to make a better comparison of systems.
Don't worry I'm not asking you to identify yourself at all.
Disclosure Statement:
Two-tier SAP ECC 5.0 Standard Sales and Distribution (SD) benchmark Sun Fire T2000 (1-way, 1 proc, 8 cores, 32 threads) 1x 1.2 GHz UltraSPARC T1, 32 GB mem, 950 SD benchmark users, 1.91 sec avg response time, Cert#2005047., MaxDB 7.5 database, Solaris 10; Two-tier SAP ECC 5.0 Standard Sales and Distribution (SD) benchmark IBM System eServer p5 550 (4-way, 4 procs, 4 cores, 8 threads) 4x 1.9 GHz POWER5+, 32GB mem, 1,000 SD benchmark users, 1.97s avg resp time, Cert#2005040, IBM DB2 Universal Database 8.2.2, SuSE Linux Enterprise Server 9;
Two-tier SAP ECC 6.0 Standard Sales and Distribution (SD) benchmark Fujitsu Siemens Computers PRIMERGY Model BFi20 S2 (2 procs, 4 cores, 4 threads) 2x Intel Xeon 5160, 3.0 GHz, 16GB mem, 1,020 SD benchmark users, 1.94s avg resp time, Cert#2007031, Oracle 10g, Solaris 10;
Two-tier SAP ECC 6.0 Standard Sales and Distribution (SD) benchmark Fujitsu Siemens Computers PRIMERGY Model TX300 S3 (2 procs, 8 cores, 8 threads) 4x Quad-Core Intel Xeon Processor X5355 2.66 GHz, 32GB mem, 1865 SD benchmark users, 1.99s avg resp time, Cert#2007025, SQL Server 2005, Windows Server 2003 Enterprise Edition; SAP, R/3, mySAP reg TM of SAP AG in Germany and other countries. More info www.sap.com/benchmark.
I edited in:
2 processors into Quad-Core Intel Xeon Processor X5355 2.66 GHz
...and..
32 threads to the Sun Fire T2000, 1 processor / 8 cores
...in order to make the comparisons more consistent.
Wednesday Aug 08, 2007
Can someone really use 64-threads in a chip? The answer is simple,
when you look out into your datacenter do you see racks of servers
or just a single naked core sitting alone in the back corner?
If you see racks of server you are running lots and lots of threads.
Think of it his way, if you have a bunch of dual-core single-socket
1RU servers filling a rack you have around 80 threads in a rack, or
2-socket you have 160, or quad-core 2-socket you have 320 threads.
Now how would you judge performance of a single rack (with 80-320 threads)?
Would you run one copy of "gzip" or "tar" and compare that to your laptop and say that rack is slow, of course not., You'd run a whole bunch of them.
So when you are performance testing an UltraSPARC T1 or UltraSPARC T2
server throw lots of work at it and it will have no problem. There
is massive parallelism in every datacenter with racks of servers. Perfect for UltraSPARC T1/T2. Every datacenter with web-tiers, application-tiers,
and database behind those tiers runs tons of threads. And remember the
UltraSPARC T1 and introduction and even last week continues to set leading performance records at every tier.
Intelligence test Would you judge performance of an UltraSPARC T2 by running a single "gzip" or "tar"?
|
|
|
|
There is a typo in your IBM p5 550 result. The p5...
Disregard my post. I thought your core informatio...