BM Seer Facts & Questions from an Anonymous Sun Source

Performance per core is very misleading & more on SPECjAppServer World Record

Friday Jul 20, 2007

SPARC is leading the world: World Record UltraSPARC T1 (Niagara) and UltraSPARC IV+ on SPECjAppServer. I had all of the details in yesterday's posting. But I quickly skimmed over a couple of important details that I'll talk a bit more about in this posting.

To keep all of the application servers fully supported one requires a fast database server and efficient database software. For this benchmark Sun used IBM DB2 9.1 database. In the past Sun has set many world records with this database software on a variety of benchmarks.

Another thing of note is that Sun only used 24 dual-core UltraSPARC IV+ chips in comparison to 32 dual-core Itanium2 chips. That means a lot less SPARC chips than Itanium chips and Sun gives more performance.

Also note I only use chips and cores to denote the configuration. Performance per core is very misleading in every comparison between vendors.

In the application tier sun used ten Sun Blade T6300 Server Modules (10 US T1 chips total) to get 8% better performance than HP's 6 rx6600 servers (24 Itanium2 chips total). Sun fits 10 blades in 10RU versus HP's 42RU (6x Four dual-core Itanic2 in 7RU), Sun uses a lot less hardware and a FOURTH less space!

See how totally misleading if we compared cores thinking cores were equivalent. Sun has 80 cores in the appl tier in this config versus HP's 48 cores in the application tier. Price/core is very different in EVERY vendor. Performance per core a smoke and mirrors marketing trick that should not be used by any honorable vendor.

World Record UltraSPARC T1 SPECjAppServer2004 benchmark. The Sun Blade 6000 systems extremely flexible you can have SPARC, AMD Opteron, and Intel Xeon processor-based server modules, as well as the Solaris, Linux, and Windows operating systems. Wow!

Ten Sun Blade T6300 Server Modules delivered a World Record result of 8253.21 SPECjAppServer2004 JOPS@Standard, this result use (1x UltraSPARC T1 1.4GHz) and connected to a Sun Fire E6900 Database System (24x UltraSPARC IV+ 1.95 GHz).

For more info and yesterday's posting see http://blogs.sun.com/bmseer/entry/world_record_ultrasparc_t1_specjappserver2004

Disclosure Statement:

SPEC, SPECjAppServer reg tm of Standard Performance Evaluation Corporation. Results from www.spec.org as of 07/18/2007. SPECjAppServer2004 10 Sun Fire T6300 (80 cores, 10 chips) and 1 Sun Fire E6900 (48 cores, 24 chips) 8253.21 SPECjAppServer2004 JOPS@Standard. SPECjAppServer2004 6 HP rx6600 (48 cores, 24 chips) and HP 9000 Superdome (64 cores, 32 chips) 7629.45 SPECjAppServer2004 JOPS@Standard. SPECjAppServer2004 10 Sun Fire X8420 (80 cores, 40 chips) and 1 Sun Fire E6900 (48 cores, 24 chips) 7174.56 SPECjAppServer2004 JOPS@Standard. SPECjAppServer2004 11 HP rx3600 (44 cores, 22 chips) and HP 9000 Superdome (64 cores, 32 chips) 6812.79 SPECjAppServer2004 JOPS@Standard. SPECjAppServer2004 20 IBM xSeries BladeCenter HS20 (40 cores, 40 chips) and IBM eServer p5 570 (16 cores, 8 chips) 4368.02 SPECjAppServer2004 JOPS@Standard.

Certified Results 8253.21 SPECjAppServer2004 JOPS@Standard
Reference Date: Jul 18, 2007
Systems: 10 x Sun Blade T6300 Server Modules
1 x Sun Fire E6900, 96GB
4 x Sun StorageTek SE3510 FC Array
Processor/GHz of Server: 10 x UltraSPARC T1 1.4 GHz
24 x UltraSPARC IV+ 1.95 GHz
Operating System: Solaris 10 8/07, Solaris Containers
Software: BEA WebLogic 10.0 Advantage Edition
IBM DB2 9.1 Enterprise Edition
JVM: J2SE 5.0 update 12

Like this post? del.icio.us | furl | slashdot | technorati | digg
Posted at 04:02PM Jul 20, 2007 by BM Seer in Benchmarks
Tags:

World Record UltraSPARC T1 SPECjAppServer2004 Sun Blade 6000 & Sun Fire E6900

Thursday Jul 19, 2007

World Record UltraSPARC T1 SPECjAppServer2004 benchmark. The Sun Blade 6000 systems extremely flexible you can have SPARC, AMD Opteron, and Intel Xeon processor-based server modules, as well as the Solaris, Linux, and Windows operating systems. Wow!

Ten Sun Blade T6300 Server Modules delivered a World Record result of 8253.21 SPECjAppServer2004 JOPS@Standard, this result use (1x UltraSPARC T1 1.4GHz) and connected to a Sun Fire E6900 Database System (24x UltraSPARC IV+ 1.95 GHz).

The ten Sun Blade T6300 Server Modules (10 US T1 chips total) demonstrated 8% better performance over the best HP result of 7629.45 SPECjAppServer2004 JOPS@Standard which used 6 rx6600 servers (24 Itanium2 chips total).

Sun's benchmark used IBM DB2 9.1 on the Sun Fire E6900 equipped with 1.95GHz UltraSPARC IV+ to deliver this world record result. By comparison the HP result used 32 dual-core 1.6GHz Itanium2 Superdome.

There are no IBM POWER6 results on the SPECjAppServer2004 benchmark.

This result shows the Sun Blade 6000 Modular Server (10 US T1 chips total) with 89% better performance over the IBM result of 4368.02 SPECjAppServer2004 JOPS@Standard using 20 IBM XSeries BladeCenter HS20 blades (40 Xeon chips total) for the application servers and eServer p5 570 for the database.

Sun's benchmark result demonstrates that the Sun Blade T6300 and Sun Fire E6900 running the Solaris 10 Operating system can support 50,000 concurrent users accessing J2EE applications.

Sun's result highlights the performance benefits of the latest BEA Weblogic Server release 10.0 on Sun Blade T6300 Server Modules.

The Sun Fire T6300 result is also an example of J2EE Server Consolidation. The result was obtained using 2 BEA Weblogic application server instances per blade, with each instance running in a separate Solaris Container.

SPECjAppServer2004 top results (bigger is better)

  SPECjAppServer2004
JOPS@Standard		 J2EE Server DB Server
Sun 8253.21 1x Sun Blade 6000 (10 x T6300)
80 cores, 10 chips @ 1.4 GHz US-T1
BEA WebLogic 10.0		 1 x Sun Fire E6900
48 cores, 24 chips @ 1.95 GHz US-IV+
IBM DB2 9.1
HP 7629.45 6x HP rx6600
48 cores, 24 chips @ 1.6 GHz Itaniun2
BEA WebLogic 9.2		 1 x 9000 Superdome
64 cores, 32 chips @ 1.6 GHz Itanium 2
Oracle 10g 10.2.0.2
Sun 7174.56 1x Sun Blade 8000 (10 x X8420)
80 cores, 40 chips @ 2.8 GHz AMD 8220
BEA WebLogic 9.2		 1 x Sun Fire E6900
48 cores, 24 chips @ 1.8 GHz US-IV+
IBM DB2 8.2.6
HP 6812.79 11 x HP rx3600
44 cores, 22 chips @ 1.6 GHz Itanium 2
Oracle OC4J 10.1.3.2		 1 x 9000 Superdome
64 cores, 32 chips @ 1.6 GHz Itanium 2
Oracle 10g 10.2.0.2
IBM 4368.02 2x IBM HS20
40 cores, 40 chips @ 3.6 GHz Intel Xeon
WebSphere 6.1		 1 x IBM p570
16 cores, 8 chips @ 1.9 GHz IBM Power5
IBM DB2 v9.1

Benchmark Description

SPECjAppServer2004 (Java Application Server) is a multi-tier benchmark for measuring the performance of Java 2 Enterprise Edition (J2EE) technology-based application servers. SPECjAppServer2004 is an end-to-end application which exercises all major J2EE technologies implemented by compliant application servers as follows:

  • The web container, including servlets and JSPs
  • The EJB container
  • EJB2.0 Container Managed Persistence
  • JMS and Message Driven Beans
  • Transaction management
  • Database connectivity
Moreover, SPECjAppServer2004 also heavily exercises all parts of the underlying infrastructure that make up the application environment, including hardware, JVM software, database software, JDBC drivers, and the system network.

The primary metric of the SPECjAppServer2004 benchmark is jAppServer Operations Per Second (JOPS) which is calculated by adding the metrics of the Dealership Management Application in the Dealer Domain and the Manufacturing Application in the Manufacturing Domain. There is NO price/performance metric in this benchmark.

Disclosure Statement:

SPEC, SPECjAppServer reg tm of Standard Performance Evaluation Corporation. Results from www.spec.org as of 07/18/2007. SPECjAppServer2004 10 Sun Fire T6300 (80 cores, 10 chips) and 1 Sun Fire E6900 (48 cores, 24 chips) 8253.21 SPECjAppServer2004 JOPS@Standard. SPECjAppServer2004 6 HP rx6600 (48 cores, 24 chips) and HP 9000 Superdome (64 cores, 32 chips) 7629.45 SPECjAppServer2004 JOPS@Standard. SPECjAppServer2004 10 Sun Fire X8420 (80 cores, 40 chips) and 1 Sun Fire E6900 (48 cores, 24 chips) 7174.56 SPECjAppServer2004 JOPS@Standard. SPECjAppServer2004 11 HP rx3600 (44 cores, 22 chips) and HP 9000 Superdome (64 cores, 32 chips) 6812.79 SPECjAppServer2004 JOPS@Standard. SPECjAppServer2004 20 IBM xSeries BladeCenter HS20 (40 cores, 40 chips) and IBM eServer p5 570 (16 cores, 8 chips) 4368.02 SPECjAppServer2004 JOPS@Standard.

Certified Results 8253.21 SPECjAppServer2004 JOPS@Standard
Reference Date: Jul 18, 2007
Systems: 10 x Sun Blade T6300 Server Modules
1 x Sun Fire E6900, 96GB
4 x Sun StorageTek SE3510 FC Array
Processor/GHz of Server: 10 x UltraSPARC T1 1.4 GHz
24 x UltraSPARC IV+ 1.95 GHz
Operating System: Solaris 10 8/07, Solaris Containers
Software: BEA WebLogic 10.0 Advantage Edition
IBM DB2 9.1 Enterprise Edition
JVM: J2SE 5.0 update 12

Like this post? del.icio.us | furl | slashdot | technorati | digg
Posted at 01:52PM Jul 19, 2007 by BM Seer in Benchmark Issues
Tags:

World Record Sun Fire T2000 for 2-node configuration with 1-Socket Application Server

Friday Jul 13, 2007

A Sun Fire T2000 equipped with one UltraSPARC T1 processor at 1.4 GHz running the Sun Java System Application Server 9.1 and one Sun Fire T2000 equipped with 1 UltraSPARC T1 processor at 1.0 GHz running the DB2 9.1 Univeral Database obtained a score of 883.66 SPECjAppServer2004 JOPS@Standard on the SPECjAppServer2004 benchmark. This also demonstrates the power of the Sun Fire T2000 as a database server.

The Sun Java Systems Application Server 9.1 established a new World Record on a single-socket application server machine.

This is the highest ever SPECjAppServer score by any application server running on a single Sun appserver machine, beating BEA's score on the same appserver machine by 10%.

Sun's open-source application server gives you 10% better performance than BEA at a fraction of the licensing and support cost.

This result demonstrates the superior performance of Sun's open-source application server with a result that is 10% higher than Weblogic on identical hardware, and substantially higher than other application server vendors on T2000 hardware.

This result also demonstrates the superior performance of the Sun Fire T2000 as a database server, using IBM DB2 Universal Database software.

SPECjAppServer2004 JOPS@Standard (bigger is better)

  SPECjAppServer2004
JOPS@Standard		 J2EE Server DB Server
Sun 883.66 1x Sun Fire T2000
8 cores, 1 chip @ 1.4 GHz US-T1
SJSAS 9.1		 1x Sun Fire T2000
6 cores, 1 chip @ 1.0 GHz US-T1
IBM DB2 9.1
Sun 801.70 1x Sun Fire T2000
8 cores, 1 chip @ 1.4 GHz US-T1
BEA WebLogic 9.2		 1x Sun Fire T2000
6 cores, 1 chip @ 1.0 GHz US-T1
IBM DB2 8.2.6
Oracle 733.22 1x Sun Fire T2000
8 cores, 1 chip @ 1.2 GHz US-T1
Oracle AS 10g Release 10.1.3.2		 1x Sun Fire T2000
8 cores, 1 chip @ 1.2 GHz US-T1
Oracle Database Enterprise Edition Release 10.2.0.2

Benchmark Description

SPECjAppServer2004 (Java Application Server) is a multi-tier benchmark for measuring the performance of Java 2 Enterprise Edition (J2EE) technology-based application servers. SPECjAppServer2004 is an end-to-end application which exercises all major J2EE technologies implemented by compliant application servers as follows:

  • The web container, including servlets and JSPs
  • The EJB container
  • EJB2.0 Container Managed Persistence
  • JMS and Message Driven Beans
  • Transaction management
  • Database connectivity

Moreover, SPECjAppServer2004 also heavily exercises all parts of the underlying infrastructure that make up the application environment, including hardware, JVM software, database software, JDBC drivers, and the system network.

The primary metric of the SPECjAppServer2004 benchmark is jAppServer Operations Per Second (JOPS) which is calculated by adding the metrics of the Dealership Management Application in the Dealer Domain and the Manufacturing Application in the Manufacturing Domain. There is NO price/performance metric in this benchmark.

Example Disclosure Statement:

SPECjAppServer2004: 1 Sun Fire T2000 (8 cores, 1 chip) and 1 Sun Fire T2000 (6 cores, 1 chip) 883.66 SPECjAppServer2004 JOPS@Standard; 1 Sun Fire T2000 (8 cores, 1 chip) and 1 Sun Fire T2000 (6 cores, 1 chip) 801.70 SPECjAppServer2004 JOPS@Standard; 1 Sun Fire T2000 (8 cores, 1 chip) and 1 Sun Fire T2000 (8 cores, 1 chip) 733.22 SPECjAppServer2004 JOPS@Standard. SPEC, SPECjAppServer reg tm of Standard Performance Evaluation Corporation. Results from www.spec.org as of 07/10/2007.

Certified Results 883.66 SPECjAppServer2004 JOPS@Standard
Reference Date: Jul 10, 2007
Systems: 1 x Sun Fire T2000, 64GB
1 x Sun Fire T1000, 8GB, 2 x Sun StorEdge 3320 FC Array
Total Number Processors: 1, 1
Processor/GHz of Server: UltraSPARC T1 1.4 GHz
UltraSPARC T1 1 GHz
Operating System: Solaris 10 8/07
Software: Sun Java System Application Server 9.1 Platform Edition
IBM DB2 9.1 Enterprise Edition
JVM: J2SE 6.0 update 02

Like this post? del.icio.us | furl | slashdot | technorati | digg
Posted at 10:20AM Jul 13, 2007 by BM Seer in Benchmark Issues
Tags:

Record SPECjAppServer Sun Fire E2900 / Sun Fire T2000 combo

Tuesday Apr 03, 2007

World Record Performance on 2-node Configuration! One Sun Fire E2900 equipped with 12 UltraSPARC IV+ at 1.95GHz running the BEA Weblogic 9.2 Application Server and one Sun Fire T2000 equipped with one UltraSPARC T1 processor at 1.2 GHz running the DB2 8.2 Univeral Database achieved 1781.37 SPECjAppServer2004 JOPS@Standard.

This SPECjAppServer2004 benchmark result is a World record for application server performance on a single system.

The Sun Fire E2900 result is an example of J2EE Server Consolidation. The result was obtained using 6 BEA Weblogic application server instances, each running in a separate Solaris Container.

The Sun Fire E2900 and Sun Fire T2000 performed 7% better than the cluster of 6x HP DL380 G4 running BEA Weblogic 9 and 1x HP rx8620 server running Oracle 10g database.

The Sun Fire E2900 and Sun Fire T2000 performed 32% better than the cluster of 5x IBM eServer xSeries 365 servers running IBM Websphere 6 and 2x IBM eServer xSeries 365 running DB2 8.2 database.

This result also demonstrates the superior performance of the Sun Fire T2000 as a database server, using IBM DB2 Universal Database software. The UltraSPARC-T1 based T2000 Sun server supports a higher SPECjAppServer2004 workload (JOPS) than one HP rx8620 [16x 1.5 GHz Itanium 2] using Oracle 10g or two IBM xSeries 365 [8x 3.0 GHz Intel Xeon MP] using IBM DB2 v8.2.

SPECjAppServer2004 JOPS@Standard (bigger is better) 04/03/2007

  SPECjAppServer2004
JOPS@Standard		 J2EE Server DB Server
Sun 1781.37 1x Sun Fire E2900
24 cores, 12 chips @ 1.95 GHz US-IV+
BEA WebLogic 9.2		 1x Sun Fire T2000
8 cores, 1 chip @ 1.2 GHz US-T1
IBM DB2 8.2.6
HP 1664.36 6x HP DL380
12 cores, 12 chips @ 3.6 GHz Xeon
BEA WebLogic 9.0		 1x HP rx8620
16 cores, 16 chips @ 1.5 GHz Itanium 2
Oracle 10g 10.1.0.4
IBM 1343.47 5x IBM eServer xSeries 365
20 cores, 20 chips @ 3.0 GHz Intel Xeon MP
WebSphere 6.0		 2x IBM eServer xSeries 365
8 cores, 8 chips @ 3.0 GHz Intel Xeon MP
IBM DB2 v8.2
Sun 1781.47 5x Sun Fire X4100
20 cores, 10 chips @ 2.4 GHz AMD 280
BEA WebLogic 9.0		 1x Sun Fire E6900
32 cores, 16 chips @ 1.2 GHz US-IV
Oracle 10g 10.1.0.4
HP 1266.42 1x HP rx6600
8 cores, 4 chips @ 1.6 GHz Itanium 2
BEA WebLogic 9.1		 1x HP rx8620
16 cores, 16 chips @ 1.6 GHz Itanium 2
Oracle 10g 10.1.0.4

Benchmark Description

SPECjAppServer2004 (Java Application Server) is a multi-tier benchmark for measuring the performance of Java 2 Enterprise Edition (J2EE) technology-based application servers. SPECjAppServer2004 is an end-to-end application which exercises all major J2EE technologies implemented by compliant application servers as follows:

  • The web container, including servlets and JSPs
  • The EJB container
  • EJB2.0 Container Managed Persistence
  • JMS and Message Driven Beans
  • Transaction management
  • Database connectivity

Moreover, SPECjAppServer2004 also heavily exercises all parts of the underlying infrastructure that make up the application environment, including hardware, JVM software, database software, JDBC drivers, and the system network.

The primary metric of the SPECjAppServer2004 benchmark is jAppServer Operations Per Second (JOPS) which is calculated by adding the metrics of the Dealership Management Application in the Dealer Domain and the Manufacturing Application in the Manufacturing Domain. There is NO price/performance metric in this benchmark.

Disclosure Statement:

SPECjAppServer2004
1 Sun Fire E2900 (24 cores, 12 chips) and 1 Sun Fire T2000 (8 cores, 1 chip) 1781.37 SPECjAppServer2004 JOPS@Standard.
6 HP DL380 (12 cores, 12 chips) and 1 HP rx8620 (16 cores, 16 chips) 1664.36 SPECjAppServer2004 JOPS@Standard.
5 IBM xSeries 365 (20 cores, 20 chips) and 2 IBM xSeries 365 (8 cores, 8 chips) 1343.47 SPECjAppServer2004 JOPS@Standard.
1 HP rx6600 (8 cores, 4 chips) and 1 HP rx8620 (16 cores, 16 chips) 1266.42 SPECjAppServer2004 JOPS@Standard.
5 Sun Fire X4100 (20 cores, 10 chips) and 1 Sun Fire E6900 (32 cores, 16 chips) 1781.47 SPECjAppServer2004 JOPS@Standard.
SPEC, SPECjAppServer reg tm of Standard Performance Evaluation Corporation.
Results from www.spec.org as of 04/03/2007.

Results Summary

Certified Results 1781.37 SPECjAppServer2004 JOPS@Standard
Reference Date: Apr 3, 2007
Systems: 1 x Sun Fire E2900, 12x 1.95 GHz UltraSPARC IV+
1 x Sun Fire T2000, 1.2 GHz UltraSPARC T1
# Processors: 12, 1
Processor/GHz of Server: UltraSPARC IV+ 1.95 GHz
UltraSPARC T1 1.2 GHz
Operating System: Solaris 10 11/06
Software: BEA WebLogic 9.2 Advantage Edition
IBM DB2 8.2.6 Enterprise Editon
JVM: J2SE 5.0 update 11
... yes more coming even tomorrow and beyond, keep checking...

Like this post? del.icio.us | furl | slashdot | technorati | digg
Posted at 03:28PM Apr 03, 2007 by BM Seer in Benchmarks
Tags:

SPEC updates SPECjAppServer2004 to benefit open-source community

Tuesday Feb 20, 2007

SPEC.org has released a version of SPECjAppServer2004 called EAStress2004. This is a multi-tier Java benchmark which measures the performance of Java Platform Enterprise Edition (Java EE) application servers.

EAStress2004 that relaxes run and reporting rules, enabling informal results to be shared in open-source projects.

"Results from the EAStress2004 workload cannot be used for marketing purposes, and comparisons to other SPECjAppServer2004 results are not permitted."

read more at: http://www.3dprofessor.org/Press%20Releases.htm

...so you won't see any EAstress2004 benchmarks reported on this blog, but I really think this is a very cool thing to do. Cheers!

Like this post? del.icio.us | furl | slashdot | technorati | digg
Posted at 07:08PM Feb 20, 2007 by BM Seer in Misc
Tags:

NEW 1.4GHz Sun Fire T2000 sets World Record 2-Node SPECjAppServer

Tuesday Jan 09, 2007

The new 1.4GHz Sun Fire T2000 achieved 801.70 SPECjAppServer2004 JOPS and beats the HP Itanium-2 rx3600 two-node result of 618.22 SPECjAppServer2004 JOPS by 29%. This is the dual-core 1.6GHz Itanium2!

The T2000 result also beats the IBM two-node result using the p5 505Q and p5 550 of 618.38 SPECjAppServer2004 JOPS@Standard by 29%.

One Sun Fire T2000 server equipped with one 1.4GHz UltraSPARC T1 running BEA Weblogic 9.2 Advantage Edition and one Sun Fire T2000 equipped with a UltraSPARC T1 processor at 1.0 GHz running IBM DB2 8.2.6 delivered a result of 801.70 JOPS@Standard for best performance of single socket servers in the SPECjAppServer2004 benchmark.

IBM POWER5+ and Itanium2 Dual-cores also take a lot more power and space:

    When compared to HP's rx4640 equipped with Itanium2 and running Linux, the T2000 delivers nearly 1.5X higher performance in 4x less power and half the space, delivering over 6X higher performance per watt and 12x SWaP.

    The Sun Fire T2000 delivers nearly 1.3X higher performance in nearly 3x less power and half the space, resulting in nearly 3.5X higher performance per watt and 7x SWaP when compared to HP's rx3600 equipped with two of the latest dual core Itanium2 processors and running HP-UX11i.

This result highlights the performance benefits of the latest BEA Weblogic Server 9.2 release on Sun Fire servers. It also shows the best way to get superior performance on IBM DB2 software is to use the Sun T2000 server.

This benchmark result demonstrates that the Sun Fire T2000 running the Solaris 10 Operating system can support thousands of concurrent users accessing Web Services applications.

SPECjAppServer2004 Performance Chart - JOPS@Standard
c/c = cores/chip.

  JOPS@
Standard		 J2EE Server App SW DB Server DB SW
Sun 801.70 1 x Sun Fire T2000
1.4GHz US-T1 8 core/1 chip (8 c/c)		 BEA WebLogic 9.2 1 x Sun Fire T2000
1.0GHz US-T1 6 core/1 chips (6 c/c)		 IBM DB2 8.2.6
IBM 618.38 1 x IBM p505Q
1.65GHz POWER5+ 4 core/2 chips (2 c/c)		 IBM WebSphere 6.1 1 x IBM p550
2.1GHz POWER5+ 4 cores/2 chips (2 c/c)		 IBM DB2 8.2
HP 618.22 1 x HP rx3600
1.6GHz Itanium2 4 core/2 chip (2 c/c)		 BEA WebLogic 9.2 1 x HP rx4640
1.6GHz Itanium2 4 core/4 chip (1 c/c)		 Oracle 10g
Sun 615.64 1 x Sun Fire T2000
1.2GHz US-T1 8 core/1 chip (8 c/c)		 BEA WebLogic 9.0 1 x Sun Fire V490
1.5GHz US-IV+ 8 core/4 chips (2 c/c)		 Oracle 10g 10.1.0.4
HP 542.17 1 x rx4640
1.6GHz Itanium2 4 core/4 chip (1 c/c)		 BEA WebLogic 9.1 1 x rx4640
1.6GHz Itanium2 4 core/4 chip (1 c/c)		 Oracle 10g 10.1.0.4
IBM 404.88 1 x p5 505
2.1GHz POWER5+ 2 cores/1 chip (2 c/c)		 IBM WebSphere V6.1 1 x p4 505Q
1.65GHz POWER5+ 4 core/2 chips (2 c/c)		 IBM DB2 v8.2

SPECjAppServer2004 Results Page

Benchmark Description

SPECjAppServer2004 (Java Application Server) is a multi-tier benchmark for measuring the performance of Java 2 Enterprise Edition (J2EE) technology-based application servers. SPECjAppServer2004 is an end-to-end application which exercises all major J2EE technologies implemented by compliant application servers as follows:

  • The web container, including servlets and JSPs
  • The EJB container
  • EJB2.0 Container Managed Persistence
  • JMS and Message Driven Beans
  • Transaction management
  • Database connectivity
Moreover, SPECjAppServer2004 also heavily exercises all parts of the underlying infrastructure that make up the application environment, including hardware, JVM software, database software, JDBC drivers, and the system network.

The primary metric of the SPECjAppServer2004 benchmark is jAppServer Operations Per Second (JOPS) which is calculated by adding the metrics of the Dealership Management Application in the Dealer Domain and the Manufacturing Application in the Manufacturing Domain. There is NO price/performance metric in this benchmark.

Disclosure Statement:

SPECjAppServer2004 Sun Fire T2000 (8 cores, 1 chip) 801.70 JOPS@Standard. SPECjAppServer2004 IBM p5 505Q (4 cores, 2 chips) 618.38 JOPS@Standard. SPECjAppServer2004 HP rx4600 (4 cores, 4 chip) 542.18 JOPS@Standard. SPECjAppServer2004 IBM p5 505 (2 cores, 1chip) 404.88 JOPS@Standard. SPECjAppServer2004 HP rx3600 (4 cores, 2 chips) 618.22 JOPS@Standard.
SPEC, SPECjAppServer reg tm of Standard Performance Evaluation Corporation. All results from www.spec.org as of 01/09/07.
HP rx4640 server specifications 10/19/05 from http://www.hp.com/products1/servers/integrity/entry_level/rx4640/
HP rx4640 power rating of 1,303 watts taken from HP Enterprise Configurator 10/19/05 from http://h30099.www3.hp.com/configurator/catalog-hpintegrity.asp. System configured with Redundant Power, 4 x 1.6GHz Itanium processors, 8 x 2GB DIMMs, 0 x PCI cards and 2 x 73GB HDDs.
IBM specifications from Fact and Features report, 1/9/06: ftp://ftp.software.ibm.com/common/ssi/rep_sp/n/PSB01628USEN/PSB01628USEN.PDF. IBM power is based on the reported maximum power consumption.
HP rx3600 power consumption estimated by taking 70% of the maximum output power supply rating reported here on 11/14/06: http://h20341.www2.hp.com/integrity/cache/387834-0-0-225-121.html
Sun Fire T2000 server power consumption taken from measurements made during the benchmark run.

Certified Result in a two-system configuration:

  • Certified Result: 801.70 JOPS@Standard
  • Reference Date: Jan 9, 2007
Application Server:
  • Sun Fire T2000:
  • one 1.4 GHz 8-core UltraSPARC T1
  • 64 GB memory (16x4GB)
  • Solaris 10 11/06
  • BEA WebLogic 9.2 Advantage Edition
  • JVM J2SE 5.0 Update 10

Database Server:

  • Sun Fire T2000:
  • one 1.0 GHz 6-core UltraSPARC T1 processor
  • 8 GB memory
  • 2x Sun StorEdge SE3320 SCSI Array
  • Solaris 10 6/06
  • IBM DB2 Universal Database v8.2.6

Like this post? del.icio.us | furl | slashdot | technorati | digg
Posted at 11:13AM Jan 09, 2007 by BM Seer in Benchmarks
Tags:

Sun/s better $/perf than IBM's servers on IBM Websphere

Friday Dec 15, 2006

A Sun Fire T2000 (UltraSPARC-T1) delivered 616.22 SPECjAppServer2004 JOPS@Standard running the Websphere Application Server 6.1. The T2000 delivers more 5.6x the per-socket performance of IBM's best Xeon result when running the Websphere App Server, for a 57% better software price/performance.

For Websphere customers, a Sun Fire T2000 server delivers 69% more throughput than an IBM p5 550. This translates into a 2.8x better performance per Websphere license.

When running IBM's own software, the T2000 outperforms a p5 505 by 77%, and with lower software license and maintenance costs.

All published SPECjAppServer2004 results using IBM Websphere v6 as of 12/07/06. Detail at: http://www.spec.org/jAppServer2004/

System: Brief description of hardware and software
JOPS: SPECjAppServer2004 JOPS@Standard (bigger is better)
PVUs: Total Websphere PVUs (1)
Cost: Websphere License Cost (US$) (2)
$/JOPS: Software $/JOPS (lower is better)
Adv: T2000 Price/Performance Advantage

System JOPS PVUs Cost $/JOPS Adv
Sun Fire T2000
1.2GHz UltraSPARC T1
Websphere 6.1
Solaris 10 6/06 		616.22 240 $36,000 $58.42 -
IBM p5 505
2.1GHz POWER5+
Websphere 6.1
AIX 5L V5.3		 349.11 200 $30,000 $85.93 1.5x
IBM OpenPower 720
2x 1.65GHz POWER5
Websphere 6.0
SLES9		 1334.96 800 $120,000 $89.89 1.5x
20xIBM HS20
2x 3.6GHz Xeon
Websphere 6.1
SLES9		 4368.02 4000 $600,000 $137.36 2.4x
8xIBM p5 550
2x 1.9GHz POWER5+
Websphere 6.0
SLES9		 2921.48 3200 $480,000 $164.30 2.8x
5xIBM xSeries 365
4x 3.0GHz Xeon
Websphere 6.0
SLES9		 1343.47 2000 $300,000 $223.30 3.8x

(1) PVUs. Processor value Units. This is the metric used to determine the number of licensed needed for Websphere and other IBM software products. 100 PVUs equates to 1 software license. For details, see IBM's PVU document.

(2) As of 12/7/06, the US license cost of one PVU for Websphere Application Server (Network Deployment) is USD$150. Source: IBM online catalog.

Benchmark Description

SPECjAppServer2004 (Java Application Server) is a multi-tier benchmark for measuring the performance of Java 2 Enterprise Edition (J2EE) technology-based application servers. SPECjAppServer2004 is an end-to-end application which exercises all major J2EE technologies implemented by compliant application servers as follows:

  • The web container, including servlets and JSPs
  • The EJB container
  • EJB2.0 Container Managed Persistence
  • JMS and Message Driven Beans
  • Transaction management
  • Database connectivity
Moreover, SPECjAppServer2004 also heavily exercises all parts of the underlying infrastructure that make up the application environment, including hardware, JVM software, database software, JDBC drivers, and the system network. The primary metric of the SPECjAppServer2004 benchmark is jAppServer Operations Per Second (JOPS) which is calculated by adding the metrics of the Dealership Management Application in the Dealer Domain and the Manufacturing Application in the Manufacturing Domain. There is NO price/performance metric in this benchmark.

Disclosure Statement:

SPEC, SPECjAppServer reg tm of Standard Performance Evaluation Corporation. Results from www.spec.org as of 12/07/2006. Sun Fire T2000 (8 cores, 1 chip) 616.22 SPECjAppServer2004 JOPS@Standard. IBM p5 505 (2 cores, 1 chip) 349.11 SPECjAppServer2004 JOPS@Standard. IBM p5 550 cluster (32 cores, 16 chips) 2921.48 SPECjAppServer2004 JOPS@Standard. IBM xSeries BladeCenter HS20 cluster (40 cores, 40 chips) 4368.02 SPECjAppServer2004 JOPS@Standard.

Websphere pricing from IBM's PVU Document and the IBM online catalog.

Results Summary

Certified Results


616.22 SPECjAppServer2004 JOPS@Standard

Reference Date:


August 2, 2006

Systems:


1 x Sun Fire T2000 (application server) 32 GB
1 x Sun Fire X4200 (database server) 16GB

Total Number Processors:


App Server: 1
DB Server: 2

Processor/GHz of Server:


App Server: UltraSPARC T1 at 1.2GHz (8-core)
DB Server: Dual-core Opteron 275 at 2.2GHz

Operating System:


App Server: Solaris 10 6/06
DB Server: Solaris 10 1/06

Software:


WebSphere Application Server 6.1
DB2 Universal Database 8.2.4 (64-bit)

JVM:


J2SE 5.0 update 6 (IBM build)

see also:
SPECjAppServer2004 Results Page
Benchmark announcement on www.sun.com

Like this post? del.icio.us | furl | slashdot | technorati | digg
Posted at 11:01AM Dec 15, 2006 by BM Seer in Benchmarks
Tags:

Sun T2000 3.4x beter than Itanium 2 on cost

Wednesday Dec 13, 2006

Sun Fire T2000 Sun Java Systems Application Server World Record Two-Node Price/Performance on SPECjAppserver2004. The HP Itanium2-based server is over 3.4x times most costly than the Sun Fire T2000 Server using Sun Java EE application. Sun's solutions is the lowest overall application tier deployment and maintenance cost. The Sun Fire T2000 server also requires only 2RU vs. 4RU for the more-costly HP Itanium 2 server.

Sun's dual-node configuration delivered throughput in excess of 26,000 operations per minute with absolutely no Java EE Application Server licensing constraints. This submission is fully Java EE 5 compatible and fully supported by Sun Microsystems. Sun Microsystems is the only vendor to provide robust performance on the SPECjAppServer benchmark using a Java EE 5 certified application server.

One Sun Fire T2000 server equipped with 1 UltraSPARC T1 processor (8 cores) at 1.2 GHz running Sun Java System Application Server 9.0 UR 1 PE and a Sun Fire T2000 equipped with 1 UltraSPARC T1 processor (6 cores) at 1.0 GHz running Oracle 10g Database Standard Edition delivered a result of 521.42 SPECjAppServer2004 JOPS@Standard for the SPECjAppServer2004 benchmark for the best application tier price/performance result for a two-node server.

Competitive Landscape

SPECjAppServer2004 Performance Chart - Ordered by Application Tier Cost per SPECjAppServer2004 JOPS@Standard (lower is better), CPJ column is the Cost Per SPECjAppServer2004 JOPS@Standard, Score column is the SPECjAppServer2004 JOPS@Standard result, Cost column is the application cost of the hardware and software.

Submitter CPJ Score Cost J2EE Server DB Server
Sun $51.81 521.42 $27,016.95 1 x Sun Fire T2000
8 cores, 1 chip (8 cores/chip) @1.2GHz
Sun Java System AS 9.0 PE		 1 x Sun Fire T2000
6 cores, 1 chip (6 cores/chip) @1.0GHz
Oracle 10g 10.2.0.2
Sun/BEA $76.37 615.64 $47,016.95 1 x Sun Fire T2000
8 cores, 1 chip (8 cores/chip) @1.2GHz
WebLogic 		1 x Sun Fire V490
8 cores, 4 chips (2 cores/chip) @1.5GHz
Oracle 10g 10.1.0.4
Sun $122.13 616.22 $75,234.92 1 x Sun Fire T2000
8 cores, 1 chip (8 cores/chip) @1.2GHz
WebSphere Application Server Network Deployment, Version 6.1		 1 x Sun Fire X4200
4 cores, 2 chip (2 cores/chip) @2.2GHz
DB2 Universal Database v8.2.4
HP $298.20 471.28 $140,537.88 1 x rx4640
4 cores, 4 chips (1 core/chip) Itanium 2 @1.6GHz
BEA WebLogic 9.0		 1 x rx4640
4 cores, 4 chips (1 core/chip) Itanium 2 @1.6GHz
Oracle 10g 10.1.0.4

  • SPECjAppServer2004 Results Page

    • Benchmark Description

    SPECjAppServer2004 (Java Application Server) is a multi-tier benchmark for measuring the performance of Java 2 Enterprise Edition (J2EE) technology-based application servers. SPECjAppServer2004 is an end-to-end application which exercises all major J2EE technologies implemented by compliant application servers as follows:

    • The web container, including servlets and JSPs
    • The EJB container
    • EJB2.0 Container Managed Persistence
    • JMS and Message Driven Beans
    • Transaction management
    • Database connectivity
    Moreover, SPECjAppServer2004 also heavily exercises all parts of the underlying infrastructure that make up the application environment, including hardware, JVM software, database software, JDBC drivers, and the system network.

    The primary metric of the SPECjAppServer2004 benchmark is jAppServer Operations Per Second (JOPS) which is calculated by adding the metrics of the Dealership Management Application in the Dealer Domain and the Manufacturing Application in the Manufacturing Domain. There is NO price/performance metric in this benchmark.

    Disclosure Statement:

    SPEC, SPECjAppServer reg tm of Standard Performance Evaluation Corporation. Results from www.spec.org as of Dec 6, 2005. Sun Fire T2000 (8 cores, 1 chip) 521.42 SPECjAppServer2004 JOPS@Standard. HP rx4640 (4 cores, 4 chips) 471.28 SPECjAppServer2004 JOPS@Standard. Sun HW+SW application tier cost = $27,016.95, appl cost per JOP = $51.81. HP HW+SW application tier cost = $140,537.88, appl cost per JOP = $298.20 HP Bill of Material from http://www.spec.org/jAppServer2004/results/res2005q3/jAppServer2004-20050913-00016.html. BEA pricing from http://www.awaretechnologies.com/BEA/index.html. IBM pricing from http://www.cdw.com/ System pricing dated 12/06/06 HP rx4640 server specifications 10/19/05 from http://www.hp.com/products1/servers/integrity/entry_level/rx4640/index.html

    Certified Results 521.42 SPECjAppServer2004 JOPS@Standard
    Reference Date: Dec 6, 2006
    Systems: 1 x Sun Fire T2000, UltraSPARC T1 1.2 GHz (8 cores, 1 proc), 32 GB Memory
    1 x Sun Fire T2000, UltraSPARC T1 1.0 GHz (6 cores, 1 proc), 8GB Memory
    Operating System: Solaris 10 6/06 (same for both)
    Software: Sun Java System Application Server 9.0 Platform Edition UR1 Patch 1
    Oracle 10g Database Enterprise Edition v10.2.0.2
    JVM: J2SE 6.0

    Like this post? del.icio.us | furl | slashdot | technorati | digg
    Posted at 11:07AM Dec 13, 2006 by BM Seer in Benchmarks
    Tags: