Tuesday Oct 09, 2007
The Sun SPARC Enterprise T5120 and Sun SPARC Enterprise T5220 each with
the 1.4 GHz UltraSPARC T2
processor obtained the best multi-JVM single chip results on the
SPECjbb2005 server-side Java benchmark.
The Sun SPARC Enterprise T5120 and Sun SPARC Enterprise T5220 servers
each equipped with a single UltraSPARC T2 processor at 1.4 GHz,
delivered a World Record single-chip result of 192055 SPECjbb2005 bops,
24007 SPECjbb2005 bops/JVM.
The Sun T5220 server (single UltraSPARC T2) demonstrated 9% better
performance than the 4-core 4.7GHz IBM p570 (Power6) result of 175,474
SPECjbb2005 bops 87737 SPECjbb2005 bops/JVM.
The Sun T5220 server has 2.5x better power-performance and has 4.9x
better SWaP than the IBM 4-core p570.
The Sun T5220 server (single UltraSPARC T2) demonstrated 20% better
performance than the Dell PowerEdge 6950
result of 159,382 SPECjbb2005 bops,
39846 SPECjbb2005 bops/JVM which used four 2.8GHz dual-core Opteron
processors. The Sun T5220 server has 1.6x better power-performance
and has 3.2x better SWaP.
The Sun T5120 server (single UltraSPARC T2) demonstrated 21% better
performance than the 4-socket HP rx6600
(2.8 GHz Xeon DC) result of 158174 SPECjbb2005 bops,
39544 SPECjbb2005 bops/JVM. The Sun T5120 server
has 3x better power-performance and has 21x better SWaP than the
HP rx6600.
The Sun T5120 server (single UltraSPARC T2) demonstrated 3x better
performance over the 2-socket IBM p505Q
result of 63,544 SPECjbb2005 bops,
31772 SPECjbb2005 bops/JVM. The Sun T5120
server has 2x better power-performance and has 2x better SWaP.
The SWaP metric is a measure of server efficiency ratio that
includes system performance, power and space consumption on a
specific benchmark. (SWaP = Perf /[ Space (RU) x Watts ] )
Power-performance is computed as watt/performance. Since
power-performance is related to price/performance they are
both calculated with performance in the denominator.
SPECjbb2005 Performance Chart (ordered by performance)
bops : SPECjbb2005 Business Operations per Second (bigger is better)
| System |
Date |
Processors |
Performance |
| (Chips, Cores, Threads) |
GHz CPU |
bops |
JVMs |
bops/JVM |
| Fujitsu PRIMERGY RX200 S3 |
7/07 |
(2, 8, 8) |
3GHz Xeon QC |
236416 |
4 |
59104 |
| Sun SPARC Enterprise T5120 |
10/07 |
(1, 8, 64) |
1.4GHz US T2 |
192055 |
8 |
24007 |
| Sun SPARC Enterprise T5220 |
10/07 |
(1, 8, 64) |
1.4GHz US T2 |
192055 |
8 |
24007 |
| IBM p570 |
6/07 |
(2, 4, 8) |
4.7 GHz POWER6 |
175474 |
2 |
87737 |
| HP rx6600 |
11/06 |
(4, 8, 16) |
1.6GHz Itanium2 DC |
158174 |
4 |
39544 |
| Dell PowerEdge 6950 |
1/07 |
(4, 4, 8) |
2.8GHz Opteron DC |
159382 |
4 |
39846 |
| Dell PowerEdge 860 |
1/07 |
(1, 2, 4) |
2.4GHz Xeon |
112092 |
1 |
112092 |
| IBM p570 |
6/07 |
(1, 2, 4) |
4.7GHz POWER6 |
88089 |
1 |
88089 |
| HP rx2660 |
1/07 |
(2, 4, 4) |
1.6GHz Itanium2 |
80884 |
1 |
80884 |
Complete benchmark results may be found at the SPEC benchmark website
http://www.spec.org.
Benchmark Description
SPECjbb2005 (Java Business Benchmark) measures the performance of a
Java implemented application tier (server-side Java). The benchmark is
based on the order processing in a wholesale supplier application. The
performance of the user tier and the
database tier are not measured in this test. The metrics given are
number of SPECjbb2005 bops (Business Operations per Second) and
SPECjbb2005 bops/JVM (bops per JVM instance).
Disclosure Statement:
SPECjbb2005 Sun SPARC Enterprise T5120 (1 chip, 8 cores) 192055
SPECjbb2005 bops, 24007 SPECjbb2005 bops/JVM, Sun SPARC Enterprise
T5220 (1 chip, 8 cores) 192055 SPECjbb2005 bops, 24007 SPECjbb2005
bops/JVM, Sun SPARC Enterprise T5120/T5220 results submitted to SPEC
for review, Dell PowerEdge 860 (1 chip, 4 cores) 112092 SPECjbb2005
bops, 112092 SPECjbb2005 bops/JVM, Dell PowerEdge 6950 (4 chips, 8
cores) 159382 SPECjbb2005 bops, 39846 SPECjbb2005 bops/JVM, HP rx2660
(2 chip, 4 cores) 80884 SPECjbb2005 bops, 80884 SPECjbb2005 bops/JVM,
HP rx6600 (4 chips 8 cores) 158174 SPECjbb2005 bops, 39544 SPECjbb2005
bops/JVM, IBM p570 (1 chip, 2 cores) 88089 SPECjbb2005 bops, 88089
SPECjbb2005 bops/JVM, IBM p570 (2 chips, 4 cores) 175474 SPECjbb2005
bops, 87737 SPECjbb2005 bops/JVM, IBM p505Q (2 chips, 4 cores) 63544
SPECjbb2005 bops, 31772 SPECjbb2005 bops/JVM, Fujitsu PRIMERGY RX200 S3
(2 chips, 8 cores) 236416 SPECjbb2005 bops, 59104 SPECjbb2005
bops/JVM, SPEC, SPECjbb reg tm of Standard Performance Evaluation
Corporation. Results as of 10/08/2007 on www.spec.org.
Power References:
The 2-core IBM p570 POWER6 system requires 4 RU or 4 times the rack
space of a Sun T5120 and consumes on
average 1040 Watts of power.
The 4-core IBM p570 POWER6 system requires 4 RU or twice the rack
space of a Sun T5220 and consumes on average 1040 Watts of power.
IBM p6 570 2-core & 4-core power specifications from 80% of maximum
report power consumption published here, 06/07/07, posted
here.
The IBM p505Q POWER5+ system requires 1 RU
of rack space and consumes on average 320 Watts of power. IBM p505
power specifications from 80% of maximum report power consumption
published in ?Facts and Features Report?, 03/27/06, posted
here.
The HP rx2600 server requires 2 RU of rack space and consumes on
average 563+ Watts of power. HP rx2600 power consumption estimated by
taking 70% of the maximum reported power dissipation, documented here
on 03/23/07: Actual HP power specs
here.
The HP rx6600 server requires 7 RU of rack
space and consumes on averge 1163 Watts of power. HP rx6600 power
consumption estimated by taking 70% of the maximum reported power
dissipation, documented
here on 03/23/07. The Dell PowerEdge 6950 requires 4 RU or twice the rack space
of a Sun T5220. The Dell PowerEdge 6950 power consumption from
here.
Prices based on publicly documented list prices.
Results Summary
| Results |
| |
SPECjbb2005 bops: |
|
192055 |
| |
SPECjbb2005 bops/JVM: |
|
24007 |
| |
Reference Date: |
|
Oct 9, 2007 |
| Systems: |
|
Sun SPARC Enterprise T5120, T5220 |
| Total Number Processors: |
|
1 |
| Processor/GHz of Server: |
|
UltraSPARC T2 1.4 GHz |
| Operating System: |
|
Solaris 10 8/07 |
| JVM: |
|
Java HotSpot(TM) 32-Bit Server, Version 1.6.0_04-p |
Wednesday Jul 25, 2007
Two Sun Fire X4200's each equipped with 2 2.8 GHz Opteron processors
running the Sun Java System Application Server 9.1 and one Sun Fire T2000
equipped with 1 UltraSPARC 1.2 GHz T1 processor running PostgreSQL 8.2
database obtained a score of 813.73 SPECjAppServer2004 JOPS@Standard on the SPECjAppServer2004 benchmark. This result is 3 times better price/performance than the latest HP dual-core Itanium2 results with Oracle (note3).
Benchmark was run entirely on Open Source software: GlassFish, PostgreSQL
and Solaris.
Sun is the only vendor that has published results using
Open Source databases (MySQL and PostgreSQL), demonstrating
full commitment to these price-efficient database
alternatives.
Sun Fire T2000 shows it stregths as a database server using PostgresSQL.
Competitive Landscape
SPECjAppServer2004 Results Page
SPECjAppServer2004 JOPS@Standard (bigger is better), $/SPECjAppServer2004 JOPS@Standard (smaller is better)
| |
SPECjAppServer2004 JOPS@Standard |
J2EE Server |
DB Server |
$/JOPS |
| Sun |
813.73 |
2x Sun Fire X4200
8 cores, 4 chips @ 2.8 GHz Opteron 2220SE
SJSAS 9.1 |
1x Sun Fire T2000
8 cores, 1 chip @ 1.2 GHz US-T1
PostgreSQL 8.2 |
$71 (1) |
| HP |
874.17 |
1x HP rx2660
4 cores, 2 chips @ 1.6 GHz Itanium 2
Oracle Application Server 10g Release 10.1.3.2 |
1x HP rx2660
4 cores, 2 chips @ 1.6 GHz Itanium 2
Oracle 10g |
$211 (2) |
Benchmark Description
SPECjAppServer2004 (Java Application Server) is a multi-tier benchmark for
measuring the performance of Java 2 Enterprise Edition (J2EE) technology-based
application servers. SPECjAppServer2004 is an end-to-end application which
exercises all major J2EE technologies implemented by compliant application
servers as follows:
-
The web container, including servlets and JSPs
-
The EJB container
-
EJB2.0 Container Managed Persistence
-
JMS and Message Driven Beans
-
Transaction management
-
Database connectivity
Moreover, SPECjAppServer2004 also heavily exercises all parts of the underlying
infrastructure that make up the application environment, including hardware,
JVM software, database software, JDBC drivers, and the system network.
The primary metric of the SPECjAppServer2004 benchmark is jAppServer Operations
Per Second (JOPS) which is calculated by adding the metrics of the
Dealership Management Application in the Dealer Domain and the Manufacturing
Application in the Manufacturing Domain. There is NO price/performance
metric in this benchmark.
Disclosure Statement:
SPECjAppServer2004:
1 Sun Fire T2000 (8 cores, 1 chip) and 2 Sun Fire X4200 (8 cores, 4 chips)
813.73 SPECjAppServer2004 JOPS@Standard;
1 HP rx2660 (4 cores, 2 chips) and 1 HP rx2660 (4 cores, 2 chips)
874.17 SPECjAppServer2004 JOPS@Standard;
SPEC, SPECjAppServer reg tm of Standard Performance Evaluation Corporation.
Results from www.spec.org as of 07/23/2007.
Pricing obtained from publicly available sources.
Results Summary
| Certified Results |
|
813.73 SPECjAppServer2004 JOPS@Standard |
| Reference Date: |
|
July 23, 2007 |
| Systems: |
|
1 x Sun Fire T2000, 16GB |
|
|
2 x Sun Fire X4200, 8GB |
| Total Number Processors: |
|
1, 4 |
| Processor/GHz of Server: |
|
UltraSPARC T1 1.2 GHz |
|
|
Opteron 2220SE 2.8 GHz |
| Operating System: |
|
Solaris 10 11/06 |
| Software: |
|
Sun Java System Application Server 9.1 Platform Edition |
|
|
PostgreSQL 8.2 |
| JVM: |
|
J2SE 6.0 update 02 |
Pricing Substantiation
(note1) Sun ... all prices from www.sun.com
- App server X4200 -- # of units:2 -- $16,290.00
- DB server T2000 -- # of units: 1 -- $21,495.00
- 4 GB dual FC adapter -- # of units: 1 -- $2,530.00
- StorageTek 2540 -- # of units:1 -- $17,110
- Postgres -- $0
- Glassfish -- $0
- Total: $57,425
- $/JOPS: $70.57
(note2) HP ... prices from URL's indicated below
- rx2660 w/16GB -- #of units: 2 -- $37990.00
http://h71028.www7.hp.com/ERC/cache/251028-0-0-0-121.html?ERL=true
- 8GB DDR2 (AD276A) -- # of units:1 -- $3273.00
http://www.needthese.com/DATARAM_DRH2660/8GB_513305.htm
- Dual port 4GB FC adapter (AB379A) -- #of units: 2 -- see... www.hp.com (HP online store)
- Modular SAN Array 1000 (201723-B22) -- #of units:2 -- $12998.00
www.hp.com (HP online store)
- 72GB 15k driver (286778-B22) -- #of units:28 -- $12292.00
www.hp.com (HP online store)
- Oracle DB 10g Enterprise Edition -- # of units:2 -- see...
http://www.oracle.com/corporate/pricing/pricelists.html
- Oracle DB Horizontal Partition option -- # of units:2 -- see...
http://www.oracle.com/corporate/pricing/pricelists.html
- Oracle App server 10g Java edition, see...
http://www.oracle.com/corporate/pricing/pricelists.html
- Total: $184,543.00
- $/JOPS: $211.10
(note3) Sun to HP $/JOPS: 211.10 / 70.57 = 2.99x -> 3x
Thursday Jul 19, 2007
World Record UltraSPARC T1 SPECjAppServer2004 benchmark. The Sun Blade 6000 systems extremely
flexible you can have SPARC, AMD Opteron, and Intel Xeon processor-based
server modules, as well as the Solaris, Linux, and Windows operating systems.
Wow!
Ten Sun Blade T6300 Server Modules delivered a World Record result of
8253.21 SPECjAppServer2004 JOPS@Standard, this result use (1x
UltraSPARC T1 1.4GHz) and connected to a Sun Fire E6900 Database System
(24x UltraSPARC IV+ 1.95 GHz).
The ten Sun Blade T6300 Server Modules (10 US T1 chips total) demonstrated
8% better performance over the best HP result of 7629.45 SPECjAppServer2004
JOPS@Standard which used 6 rx6600 servers (24 Itanium2 chips total).
Sun's benchmark used IBM DB2 9.1 on the Sun Fire E6900 equipped with
1.95GHz UltraSPARC IV+ to deliver this world record result.
By comparison the HP result used 32 dual-core 1.6GHz Itanium2 Superdome.
There are no IBM POWER6 results on the SPECjAppServer2004 benchmark.
This result shows the Sun Blade 6000 Modular Server (10 US T1 chips total)
with 89% better performance over the IBM result of
4368.02 SPECjAppServer2004 JOPS@Standard using 20 IBM XSeries
BladeCenter HS20 blades (40 Xeon chips total) for the application servers
and eServer p5 570 for the database.
Sun's benchmark result demonstrates that the Sun Blade T6300 and
Sun Fire E6900 running the Solaris 10 Operating system can support
50,000 concurrent users accessing J2EE applications.
Sun's result highlights the performance benefits of the latest BEA Weblogic
Server release 10.0 on Sun Blade T6300 Server Modules.
The Sun Fire T6300 result is also an example of J2EE Server Consolidation.
The result was obtained using 2 BEA Weblogic application server instances
per blade, with each instance running in a separate Solaris Container.
SPECjAppServer2004 top results (bigger is better)
| |
SPECjAppServer2004 JOPS@Standard |
J2EE Server |
DB Server |
| Sun |
8253.21 |
1x Sun Blade 6000 (10 x T6300)
80 cores, 10 chips @ 1.4 GHz US-T1
BEA WebLogic 10.0 |
1 x Sun Fire E6900
48 cores, 24 chips @ 1.95 GHz US-IV+
IBM DB2 9.1 |
| HP |
7629.45 |
6x HP rx6600
48 cores, 24 chips @ 1.6 GHz Itaniun2
BEA WebLogic 9.2 |
1 x 9000 Superdome
64 cores, 32 chips @ 1.6 GHz Itanium 2
Oracle 10g 10.2.0.2 |
| Sun |
7174.56 |
1x Sun Blade 8000 (10 x X8420)
80 cores, 40 chips @ 2.8 GHz AMD 8220
BEA WebLogic 9.2 |
1 x Sun Fire E6900
48 cores, 24 chips @ 1.8 GHz US-IV+
IBM DB2 8.2.6 |
| HP |
6812.79 |
11 x HP rx3600
44 cores, 22 chips @ 1.6 GHz Itanium 2
Oracle OC4J 10.1.3.2 |
1 x 9000 Superdome
64 cores, 32 chips @ 1.6 GHz Itanium 2
Oracle 10g 10.2.0.2 |
| IBM |
4368.02 |
2x IBM HS20
40 cores, 40 chips @ 3.6 GHz Intel Xeon
WebSphere 6.1 |
1 x IBM p570
16 cores, 8 chips @ 1.9 GHz IBM Power5
IBM DB2 v9.1 |
Benchmark Description
SPECjAppServer2004 (Java Application Server) is a multi-tier benchmark for
measuring the performance of Java 2 Enterprise Edition (J2EE) technology-based
application servers. SPECjAppServer2004 is an end-to-end application which
exercises all major J2EE technologies implemented by compliant application
servers as follows:
-
The web container, including servlets and JSPs
-
The EJB container
-
EJB2.0 Container Managed Persistence
-
JMS and Message Driven Beans
-
Transaction management
-
Database connectivity
Moreover, SPECjAppServer2004 also heavily exercises all parts of the underlying
infrastructure that make up the application environment, including hardware,
JVM software, database software, JDBC drivers, and the system network.
The primary metric of the SPECjAppServer2004 benchmark is jAppServer Operations
Per Second (JOPS) which is calculated by adding the metrics of the
Dealership Management Application in the Dealer Domain and the Manufacturing
Application in the Manufacturing Domain. There is NO price/performance
metric in this benchmark.
Disclosure Statement:
SPEC, SPECjAppServer reg tm of Standard Performance Evaluation Corporation.
Results from www.spec.org as of 07/18/2007.
SPECjAppServer2004 10 Sun Fire T6300 (80 cores, 10 chips) and 1 Sun Fire
E6900 (48 cores, 24 chips) 8253.21 SPECjAppServer2004 JOPS@Standard.
SPECjAppServer2004 6 HP rx6600 (48 cores, 24 chips) and HP 9000 Superdome (64 cores, 32 chips) 7629.45 SPECjAppServer2004 JOPS@Standard.
SPECjAppServer2004 10 Sun Fire X8420 (80 cores, 40 chips) and 1 Sun Fire
E6900 (48 cores, 24 chips) 7174.56 SPECjAppServer2004 JOPS@Standard.
SPECjAppServer2004 11 HP rx3600 (44 cores, 22 chips) and HP 9000 Superdome (64 cores, 32 chips) 6812.79 SPECjAppServer2004 JOPS@Standard.
SPECjAppServer2004 20 IBM xSeries BladeCenter HS20 (40 cores, 40 chips) and IBM eServer p5 570 (16 cores, 8 chips) 4368.02 SPECjAppServer2004 JOPS@Standard.
| Certified Results |
|
8253.21 SPECjAppServer2004 JOPS@Standard |
| Reference Date: |
|
Jul 18, 2007 |
| Systems: |
|
10 x Sun Blade T6300 Server Modules |
|
|
1 x Sun Fire E6900, 96GB
4 x Sun StorageTek SE3510 FC Array
|
| Processor/GHz of Server: |
|
10 x UltraSPARC T1 1.4 GHz |
|
|
24 x UltraSPARC IV+ 1.95 GHz |
| Operating System: |
|
Solaris 10 8/07, Solaris Containers |
| Software: |
|
BEA WebLogic 10.0 Advantage Edition |
|
|
IBM DB2 9.1 Enterprise Edition |
| JVM: |
|
J2SE 5.0 update 12 |
Friday Jul 13, 2007
A Sun Fire T2000 equipped with one UltraSPARC T1 processor at 1.4 GHz
running the Sun Java System Application Server 9.1 and one Sun Fire T2000
equipped with 1 UltraSPARC T1 processor at 1.0 GHz running the DB2 9.1
Univeral Database obtained a score of
883.66 SPECjAppServer2004 JOPS@Standard on the SPECjAppServer2004
benchmark. This also demonstrates the power of the Sun Fire T2000 as a
database server.
The Sun Java Systems Application Server 9.1 established a new World Record
on a single-socket application server machine.
This is the highest ever SPECjAppServer score by any application server
running on a single Sun appserver machine, beating BEA's score on the same
appserver machine by 10%.
Sun's open-source application server gives you 10% better performance than
BEA at a fraction of the licensing and support cost.
This result demonstrates the superior performance of Sun's open-source
application server with a result that is 10% higher than Weblogic on
identical hardware, and substantially higher than other application server
vendors on T2000 hardware.
This result also demonstrates the superior performance of the Sun Fire T2000
as a database server, using IBM DB2 Universal Database software.
SPECjAppServer2004 JOPS@Standard (bigger is better)
| |
SPECjAppServer2004 JOPS@Standard |
J2EE Server |
DB Server |
| Sun |
883.66 |
1x Sun Fire T2000
8 cores, 1 chip @ 1.4 GHz US-T1
SJSAS 9.1 |
1x Sun Fire T2000
6 cores, 1 chip @ 1.0 GHz US-T1
IBM DB2 9.1 |
| Sun |
801.70 |
1x Sun Fire T2000
8 cores, 1 chip @ 1.4 GHz US-T1
BEA WebLogic 9.2 |
1x Sun Fire T2000
6 cores, 1 chip @ 1.0 GHz US-T1
IBM DB2 8.2.6 |
| Oracle |
733.22 |
1x Sun Fire T2000
8 cores, 1 chip @ 1.2 GHz US-T1
Oracle AS 10g Release 10.1.3.2 |
1x Sun Fire T2000
8 cores, 1 chip @ 1.2 GHz US-T1
Oracle Database Enterprise Edition Release 10.2.0.2 |
Benchmark Description
SPECjAppServer2004 (Java Application Server) is a multi-tier benchmark for
measuring the performance of Java 2 Enterprise Edition (J2EE) technology-based
application servers. SPECjAppServer2004 is an end-to-end application which
exercises all major J2EE technologies implemented by compliant application
servers as follows:
-
The web container, including servlets and JSPs
-
The EJB container
-
EJB2.0 Container Managed Persistence
-
JMS and Message Driven Beans
-
Transaction management
-
Database connectivity
Moreover, SPECjAppServer2004 also heavily exercises all parts of the underlying
infrastructure that make up the application environment, including hardware,
JVM software, database software, JDBC drivers, and the system network.
The primary metric of the SPECjAppServer2004 benchmark is jAppServer Operations
Per Second (JOPS) which is calculated by adding the metrics of the
Dealership Management Application in the Dealer Domain and the Manufacturing
Application in the Manufacturing Domain. There is NO price/performance
metric in this benchmark.
Example Disclosure Statement:
SPECjAppServer2004:
1 Sun Fire T2000 (8 cores, 1 chip) and 1 Sun Fire T2000 (6 cores, 1 chip)
883.66 SPECjAppServer2004 JOPS@Standard;
1 Sun Fire T2000 (8 cores, 1 chip) and 1 Sun Fire T2000 (6 cores, 1 chip)
801.70 SPECjAppServer2004 JOPS@Standard;
1 Sun Fire T2000 (8 cores, 1 chip) and 1 Sun Fire T2000 (8 cores, 1 chip)
733.22 SPECjAppServer2004 JOPS@Standard.
SPEC, SPECjAppServer reg tm of Standard Performance Evaluation Corporation.
Results from
www.spec.org as of 07/10/2007.
| Certified Results |
|
883.66 SPECjAppServer2004 JOPS@Standard |
| Reference Date: |
|
Jul 10, 2007 |
| Systems: |
|
1 x Sun Fire T2000, 64GB |
|
|
1 x Sun Fire T1000, 8GB, 2 x Sun StorEdge 3320 FC Array |
| Total Number Processors: |
|
1, 1 |
| Processor/GHz of Server: |
|
UltraSPARC T1 1.4 GHz |
|
|
UltraSPARC T1 1 GHz |
| Operating System: |
|
Solaris 10 8/07 |
| Software: |
|
Sun Java System Application Server 9.1 Platform Edition |
|
|
IBM DB2 9.1 Enterprise Edition |
| JVM: |
|
J2SE 6.0 update 02 |
Thursday Dec 14, 2006
In case you missed it: "Java 6 Leads Out-of-the-Box Server Performance"
Dave Dagastine's blog this week goes into the advances of Java 6.
Java6 is Sun's fastest most-reliable release and specifically targets out-of-the-box performance. link:
http://blogs.sun.com/dagastine/entry/java_6_leads_out_of
Bottom line: It means no tuning options are needed for the JVM to achieve optimal performance. YEAH! Lots of great details in the blog.