BM Seer Facts & Questions from an Anonymous Sun Source

UltraSPARC T2 Plus: try it yourself on Web, Appl, & Database

Monday Apr 14, 2008

In the last week this blog had talked a lot about the great performance of the SPARC Enterprise T5140 and T5240 servers.

But forget the leading performance, price/performance, watt/perf results, if you want to try it for yourself you can. Sun continues its try-and-buy program and extends it to the new Sun SPARC Enterprise T5140 and T5240 servers.

Free 60-day trial program. You pay nothing (Sun even pays the shipping), for details see: http://www.sun.com/tryandbuy/index.jsp (scroll down to find T5240/T5140)

Reminder: Summary of technical index of CMT blogs @ Allan Packer's blog:
http://blogs.sun.com/allanp/entry/sun_s_cmt_goes_multi

I've had several talks with friends at different competitors, and they said they didn't think Sun had it in it to really make a breakthrough in performance, price, and power -- but now they all talk about high-level meetings in their companies (competitors) who are frantically trying to figure out how to counter Sun's offering.

[1] Comments
Like this post? del.icio.us | furl | slashdot | technorati | digg
Posted at 12:18PM Apr 14, 2008 by BM Seer in Benchmarks
Tags:

Summary of new CMT

Monday Apr 14, 2008

For a survey of the wide variety of blogs with good technical data on the new UltraSPARC T2 Plus servers (Sun SPARC Enterprise T5240, Sun SPARC Enterprise T5140,...), please look at Allan Packer's blog index at:
http://blogs.sun.com/allanp/entry/sun_s_cmt_goes_multi

Like this post? del.icio.us | furl | slashdot | technorati | digg
Posted at 08:25AM Apr 14, 2008 by BM Seer in Benchmark Issues
Tags:

SPECjAppServer2004 World Record Single Application Server: Sun SPARC Enterprise T5240

Wednesday Apr 09, 2008

The Sun SPARC Enterprise T5240 server delivered a World Record single server result of 3331.31 SPECjAppServer2004 JOPS@Standard. This result used one Sun SPARC Enterprise T5240 (two UltraSPARC T2 Plus 1.4GHz chips) for the application server and a Sun SPARC Enterprise T5240 (with two UltraSPARC T2 Plus 1.4GHz chips) for the database server.

This benchmark used the Oracle Application Server 10g and Oracle Database 10g Enterprise Edition. This benchmark result proves that the Sun SPARC Enterprise T5240 server using the UltraSPARC T2 Plus processor performs as an oustanding J2EE application server as well as an Oracle 10G OLTP database server.

The Sun SPARC Enterprise T5240 server in the application tier consumed an average of 720 Watts in a 2RU space during the execution of this benchmark. The Sun SPARC Enterprise T5240 server in the database tier consumed an average of 670 Watts in a 2RU space during the execution of this benchmark.

One Sun SPARC Enterprise T5240 server (two UltraSPARC T2 Plus chips) in the application tier demonstrated 62% better performance over the HP BL460c blade result of 2056.27 JOPS@Standard which used two 3.1 Ghz Xeon X5460 chips.

One Sun SPARC Enterprise T5240 server (two 1.4 GHz UltraSPARC T2 Plus chips) in the application tier demonstrated 2.8X better performance over the IBM p570 result of 1197.51 JOPS@Standard which used two 4.7Ghz IBM POWER6 chips.

One SPARC Enterprise Sun T5240 server (two 1.4 GHz UltraSPARC T2 Plus chips) in the application tier performed within 8% of the Dell result of 3593.58 JOPS@Standard which used two Dell PowerEdge 1950 servers with a total of four 2.8 Ghz Xeon E5440 chips. The two Dell PE1950 servers requires 2RU of rack space and consumes on average 938 Watts of power. One Sun SPARC Enterprise T5240 server has 21% better SWaP and 18% better power-performance than two Dell PowerEdge 1950 servers combined.

One SPARC Enterprise Sun T5240 server (two 1.4 GHz UltraSPARC T2 Plus chips) in the application tier demonstrated 3.8X better performance than the HP rx2660 result of 874.17 JOPS@Standard which used two 1.6 Ghz Itanium 2 chips. The Sun SPARC Enterprise T5240 server has 2.8X better SWaP and 2.9X better power-performance than the HP rx2660 server.

One Sun SPARC Enterprise T5240 server (two 1.4 GHz UltraSPARC T2 Plus chips) in the application tier demonstrated 5.1X better performance over the Dell PowerEdge 2900 result of 652.95 JOPS@Standard which used two 3.0 Xeon X5160 chips. The Sun SPARC Enterprise T5240 server has 5.7X better SWaP and 2.4X better power-performance than the Dell PowerEdge 2900.

One Sun SPARC Enterprise T5240 server (two 1.4 GHz UltraSPARC T2 Plus chips) in the application tier demonstrated 2.8X better performance over the IBM Power6 570 result of 1197.51 JOPS@Standard which used two 4.7 Ghz IBM POWER6 chips. The Sun SPARC Enterprise T5240 server has 7.6X better SWaP and 3.9X better power-performance than the IBM Power6 570.

One Sun SPARC Enterprise T5240 server (two 1.4 GHz UltraSPARC T2 Plus chips) in the database tier performed within 8% of the result of 3593.58 JOPS@Standard using the Dell PowerEdge R900 equipped with four 2.9 Ghz Xeon X7350 chips. The Sun SPARC Enterprise T5240 server has 3.1X better SWaP and 50% better power-performance than the Dell R900.

One SPARC Enterprise Sun T5240 server (two 1.4 GHz UltraSPARC T2 Plus chips) in the database tier demonstrated 5.1X better performance over the Dell PowerEdge 2900 result of 652.95 JOPS@Standard which uses two 3.0 GHz Xeon X5160 chips. The Sun SPARC Enterprise T5240 server has 5.7X better SWaP and 2.4X better power-performance than the Dell PowerEdge 2900.

One Sun SPARC Enterprise T5240 server (two 1.4 GHz UltraSPARC T2 Plus chips) in the database tier demonstrated 2.8X better performance over the IBM p5 550 result of 1197.51 JOPS@Standard which used two 2.1 GHz IBM POWER5+ chips. The Sun SPARC Enterprise T5240 server has 6.3X better SWaP and 3.2X better power-performance than the IBM Power5 550.

The SWaP metric is a measure of server efficiency ratio that includes system performance, power and space consumption on a specific benchmark. (SWaP = Perf /[ Space (RU) x Watts ] )

Power-performance is computed as watt/performance. Since power-performance is related to price/performance they are both calculated with performance in the denominator.

SPECjAppServer2004 Performance Chart as of 04/09/2008. Complete benchmark results may be found at the SPEC benchmark website http://www.spec.org. SPECjAppServer2004 JOPS@Standard (bigger is better)

  SPECjAppServer2004
JOPS@Standard		 J2EE Server DB Server
Sun 3331.31 1x Sun SPARC Enterprise T5240
16 cores, 2 chip @ 1.4 GHz US-T2 Plus
Oracle OC4J 10.1.3.3.2		 1 x Sun SPARC Enterprise T5240
16 cores, 2 chip @ 1.4 GHz US-T2 Plus
Oracle 10g DB 10.2.0.3
HP 2056.27 1x BL460c
8 cores, 2 chips @ 3.1 Xeon X5460
Oracle OC4J 10.1.3.3		 1x BL480c
8 cores, 2 chips @ 2.8 Xeon E5440
Oracle 10g DB 10.2.0.3
Sun 2000.92 1x Sun SPARC Enterprise T5220
8 cores, 1 chip @ 1.4 GHz US-T2
Oracle OC4J 10.1.3.3		 1 x Sun SPARC Enterprise T5120
8 cores, 1 chip @ 1.2 GHz US-T2
Oracle 10g DB 10.2.0.3
Rackable 1672.64 1x Rackable C2002
8 cores, 2 chips @ 2.66 Xeon X5355
Oracle OC4J 10.1.3.2		 1x Rackable S3118
8 cores, 2 chips @ 2.33 Xeon E5345
Oracle 10g DB 10.2.0.2
IBM 1197.51 1 x IBM p570
4 cores, 2 chips @ 4.7 GHz IBM POWER6
IBM WebSphere 6.1		 1 x IBM p550
4 cores, 2 chips @ 2.1 GHz IBM POWER5+
IBM DB2 v9.1
HP 874.17 1 x HP rx2660
4 cores, 2 chips @ 1.6 GHz Itanium 2
Oracle OC4J 10.1.3.2		 1 x HP rx2660
4 cores, 2 chips @ 1.6 GHz Itanium 2
Oracle 10g DB 10.2.0.2
Sybase 652.95 1 x Dell PowerEdge 2900
4 cores, 2 chips @ 3.0 GHz Xeon 5160
Sybase EAS 6.0.2		 1 x Dell PowerEdge 2900
4 cores, 2 chips @ 3.0 GHz Xeon 5160
SQLAnywhere 10.0.1
Dell 3593.58 2 x Dell PowerEdge 1950
16 cores, 4 chips @ 2.8 GHz Xeon E5440
Oracle OC4J 10.1.3.3		 1 x Dell PowerEdge R900
16 cores, 4 chips @ 2.9 GHz Xeon X7350
Oracle 10g DB 10.2.0.2

Benchmark Description

SPECjAppServer2004 (Java Application Server) is a multi-tier benchmark for measuring the performance of Java 2 Enterprise Edition (J2EE) technology-based application servers. SPECjAppServer2004 is an end-to-end application which exercises all major J2EE technologies implemented by compliant application servers as follows:

  • The web container, including servlets and JSPs
  • The EJB container
  • EJB2.0 Container Managed Persistence
  • JMS and Message Driven Beans
  • Transaction management
  • Database connectivity
Moreover, SPECjAppServer2004 also heavily exercises all parts of the underlying infrastructure that make up the application environment, including hardware, JVM software, database software, JDBC drivers, and the system network. The primary metric of the SPECjAppServer2004 benchmark is jAppServer Operations Per Second (JOPS) which is calculated by adding the metrics of the Dealership Management Application in the Dealer Domain and the Manufacturing Application in the Manufacturing Domain. There is NO price/performance metric in this benchmark.

Disclosure Statement:

SPECjAppServer2004
Sun SPARC Enterprise T5240 (16 cores, 2 chip) 3331.31 SPECjAppServer2004 JOPS@Standard.
IBM p570(4 cores, 2 chips) 1197.51 SPECjAppServer2004 JOPS@Standard.
IBM p550(4 cores, 2 chips) 1197.51 SPECjAppServer2004 JOPS@Standard.
HP BL460c (8 cores, 2 chips) 2056.27 SPECjAppServer2004 JOPS@Standard.
HP rx2660 (4 cores, 2 chips) 874.17 SPECjAppServer2004 JOPS@Standard.
Dell PE 2900 (4 cores, 2 chips) 652.95 SPECjAppServer2004 JOPS@Standard.
Dell PE 1950 (16 cores, 4 chips) 3593.68 SPECjAppServer2004 JOPS@Standard.
Dell PE R900 (4 cores, 4 chips) 3593.68 SPECjAppServer2004 JOPS@Standard.
SPEC, SPECjAppServer reg tm of Standard Performance Evaluation Corporation.
Results from www.spec.org as of 04/09/2008.

Power References:

Dell 1950 power rating estimated by applying 70% to the PSU rating reported 03/10/08 for each server:
http://www.dell.com/content/products/productdetails.aspx/pedge_r900?c=us&cs=555&l=en&s=biz
HP rx2660 power calculated as 70% of max input power reported 07/17/07:
http://h18004.www1.hp.com/products/quickspecs/12698_div/12698_div.HTML#Technical%20Specifications
Dell power rating 08/24/07 from Dell DataCenter Capacity Planner:
http://www.dell.com/content/topics/topic.aspx/global/products/pedge/topics/en/config_calculator?c=us&cs=555&l=en&s=biz
System configured with 2 x Xeon 5160 processors, 8 x 2GB DIMMs, 1 x Disk, 1 x HBA & Redundant PSU
IBM p6 570 power specifications from 80% of maximum report power consumption published here, 06/07/07, posted at
ftp://ftp.software.ibm.com/common/ssi/rep_sp/n/PSB01628USEN/PSB01628USEN.PDF
Dell R900 power estimated by applying 70% to the PSU rating, reported 03/10/08 at
http://www.dell.com/content/products/productdetails.aspx/pedge_r900?c=us&cs=555&l=en&s=biz
IBM p5 power specifications calculated by applying 70% of the power numbers published in ?Facts and Features Report?, 3/10/06, posted at
http://www-03.ibm.com/servers/eserver/pseries/hardware/factsfeatures.html

Results Summary

Certified Results 3331.31 SPECjAppServer2004 JOPS@Standard
Reference Date: Apr 9, 2008
Systems: 2 x Sun SPARC Enterprise T5240
Total Number Processors: 2,2
Processor/GHz of Server: UltraSPARC T2 Plus 1.4 GHz
Operating System: Solaris 10 8/07
Software: Oracle Application Server 10g Release 10.1.3.3.2 - Java Edition
Oracle Database Enterprise Edition Release 10.2.0.3
JVM: J2SE 6.0 update 6p

[4] Comments
Like this post? del.icio.us | furl | slashdot | technorati | digg
Posted at 08:47AM Apr 09, 2008 by BM Seer in Benchmarks
Tags:

but wait, there is more

Wednesday Apr 09, 2008

Not only did Sun release a benchamark on the UltraSPARC T2, we also announced a new processor and a new set of new benchmarks. Sun continues to raise the bar.

Check out the press release and news sources. Sun now has an UltraSPARC T2 Plus and new systems!

The press release states:

    "Today, the SPARC Enterprise T5140 and T5240 servers are setting the pace with breakthrough performance and beating the competition in performance, price/performance and power and space utilization on business-critical and compute-intensive workloads spanning the entire enterprise – from the edge to the heart of the datacenter."

Like this post? del.icio.us | furl | slashdot | technorati | digg
Posted at 06:20AM Apr 09, 2008 by BM Seer in Benchmarks
Tags:

Sun's even faster SPECweb2005: New Record Sun SPARC Enterprise T5220 UltraSPARC T2

Wednesday Apr 09, 2008

The Sun SPARC Enterprise T5220 obtained a world record SPECweb2005 result 41847 SPECweb2005 with one UltraSPARC T2 running Solaris 10 with a real world web server Sun Java[TM] System Web Server. This is a 13% improvement over the original result published at www.spec.org in Oct '07. Demonstrating Sun Microsystems continued commitment to performance improvements.

The Sun SPARC Enterprise T5220 server delivers 4% greater performance than the four-socket HP ProLiant DL580 G5 with 2.9 GHz Quad-Core Xeon processors. In addition, the Sun SPARC Enterprise T5220 has 1.8X better power-performance and has 3.6X better SWaP.

The Sun SPARC Enterprise T5220 server delivers 41% greater performance than the 2-socket HP ProLiant DL380 G2 with 3.16 GHz Quad-core Intel Xeon 5460 processors. In addition, the Sun SPARC Enterprise T5220 has 1.1X better power-performance and has 1.1X better SWaP.

There are no IBM POWER6 results on the SPECweb benchmark.  The Sun SPARC Enterprise T5220 server is 5.3 times faster than the 4-core IBM p550 1.9GHz POWER5+.

This world record benchmark result clearly demonstrates that the Sun SPARC Enterprise T5220 running the Solaris 10 05/08 and Java System Webserver 7.0 Update 3 can support thousands of concurrent secure and non secure web server sessions while allowing larger and more complex Java applications to be run and is an industry leader in web serving.

Cryptography performance is enhanced on the Sun SPARC Enterprise T5220 by using UltraSPARC T2's enhanced on-chip cryptographic hardware with Solaris 10's secured web service software feature. SPECweb2005's banking workload highlights the server's secure web server performance. The Sun SPARC Enterprise T5220 (70,000 SPECweb2005_Banking) performance was 35% greater than the 2 socket 3.16 GHz Quad-Core Xeon X5460 HP ProLiant DL380 G5 (51,840 SPECweb2005_Banking).

The HP Proliant DL580 G5 (40,046 SPECweb2005) used seventeen 1GbE networks versus Sun's three 10GbE and two 1GbE, providing much simplified administration.

At peak load, the Sun SPARC Enterprise T5220 had an average power consumption of 617 watts for the three SPECweb2005 benchmark workloads at steady-state.

The SWaP metric is a measure of server efficiency ratio that includes system performance, power and space consumption on a specific benchmark. (SWaP = Perf /[ Space (RU) x Watts ] )

Power-performance is computed as watt/performance. Since power-performance is related to price/performance they are both calculated with performance in the denominator.

Selected SPECweb2005 benchmark results as of 04/01/2008. Complete information at: http://www.spec.org website.

System Chips, Core
/Chip		 CPU/GHz OS Web Server SPEC web
2005		 Bank Ecom Supp
Sun SE T5220 1,8 US T2 1.4 Solaris 05/08 Sun JSWS 7.0 Update 3 41847 70000 58000 40000
HP PL DL580 G5 4,4 Xeon QC / 2.993 RedHat Linux Rock1.4.6/
JRock v1.3.1		 40046 71104 55552 36032
Sun SE T5220 1,8 US T2/ 1.4 Solaris 05/08 Sun JSWS 7.0
Update 3 		37001 63000 49500 36000
HP PL DL380 G5 2, 4 Xeon QC / 3.16 RedHat Linux Rock1.4.6/
JRock v1.3.1		 29591 51840 46512 23816
HP PL DL580 G5 4, 4 Xeon QC/2.4 RedHat Linux Rock1.4.1/
JRock v1.2.0		 26119 45056 37312 23488
Sun Fire T2000 1,8 US T1/1.4 Solaris 11/06 Sun JSWS 6.1
SP5 64b		 16407 25812 24048 15768
Sun Fire T2000 1, 8 US T1/1.2 Solaris Sun JSWS 6.1
SP5 64b		 14001 21500 21500 13160
Sun Fire T1000 1, 8 US T1/1.0 Solaris Sun JSWS 6.1
SP5 64b		 10466 20000 16500 7700
IBM p5 550 2,2 POW5+/ 1.9 SuSE Linux Zeus4.3r1/
Tomcat5.5.9		 7881 12240 11820 7500

Results in BLUE are the Sun SPARC Enterprise T5220 results currently under SPEC review.

Benchmark Description

SPECweb2005, is the latest industry standard benchmark for evaluating Web Server performance developed by SPEC. The benchmark simulates multiple user sessions accessing a Web Server and generating static and dynamic HTTP requests. The major features of SPECweb2005 are:

  • Measures simultaneous user sessions
  • Dynamic content: currently PHP and JSP implementations
  • Page images requested using 2 parallel HTTP connections
  • Multiple, standardized workloads: Banking (HTTPS), E-commerce (HTTP and HTTPS), and Support (HTTP)
  • Simulates browser caching effects
  • File accesses more accurately simulate today's disk access patterns

Example Disclosure Statement:

Sun SPARC Enterprise T5220 (8 cores, 1 chip) 41847 SPECweb2005, submitted to SPEC for review on April 8, 2008. HP ProLiant DL580 G5 (16 cores, 4 chips) 40046 SPECweb2005. HP ProLiant DL380 G5 (8 cores, 2 chips) 29591 SPECweb2005. HP ProLiant DL580 G5 (16 cores, 4 chips) 26119 SPECweb2005. Sun Fire T2000 (8 cores, 1 chip) 16407 SPECweb2005. Sun Fire T2000 (8 cores, 1 chip) 14001 SPECweb2005. Sun Fire T1000 (8 cores, 1 chip) 10466 SPECweb2005. IBM p5 550 (4 cores, 2 chips) 7881 SPECweb2005. SPEC, SPECweb reg tm of Standard Performance Evaluation Corporation. Results from www.spec.org as of Apr 7, 2008.

Sun SPARC Enterprise T5220 server power consumption taken from measurements made during the benchmark run. Power is average measured watts during benchmark run.

HP DL580 power consumption from HP Power Calculator system configured with 4 x2.93GHz processors, redundant PSU, 16 x 4GB DIMMs, 8 x 36GB SAS drives,1 x PCI card, 80% utilisation on 9/10/07: http://h30099.www3.hp.com/configurator/powercalcs.asp

HP DL380G5 power consumption from HP Power Calculator for system configured with 2 x X5460 3.16GHz processors, redundant PSU, 8 x 4GB DIMMs, 2 x HBAs and 2 x 146GB SAS drives, 80% utilisation on 01/09/07: http://h30099.www3.hp.com/configurator/powercalcs.asp

Results Summary

    Certified Results 41847 SPECweb2005
    Reference Date: April 7, 2008
    Systems: 1 x Sun SPARC Enterprise T5220
    Total Number Processors: 1 chip / 8 cores (8 threads/core)
    Processor/GHz of Server: Sun UltraSPARC T2 1.4 GHz
    Operating System: Solaris 10 05/08 + patches
    Software: Sun Java[TM] System Web Server 7.0 Update 3
    Sun Java[TM] Runtime Environment, Standard Edition 1.6.0_06-p

[1] Comments
Like this post? del.icio.us | furl | slashdot | technorati | digg
Posted at 06:06AM Apr 09, 2008 by BM Seer in Benchmark Issues
Tags:

UltraSPARC T2: Web, App, & Database

Wednesday Apr 09, 2008

Last Wednesday (in my last posting), I showed benchmarks that showed that an UltraSPARC T2 demonstrated great performance in Web, Application, and Database tiers. So it was quite surprising when someone commented "but I can't understand on which market it is great ? "

Wow, no convincing some people. A single chip UltraSPARC T2 can beat 4-socket Quad-cores and do it at less hardware cost when reasonably configured with memory. A single-chip UltraSPARC T2 can out perform super-expensive 4-core IBM power6 (2-chip).

Maybe Sun will just have to raise the bar...

...off to do more work now, then more blogging later this morning.

[1] Comments
Like this post? del.icio.us | furl | slashdot | technorati | digg
Posted at 05:06AM Apr 09, 2008 by BM Seer in Benchmarks
Tags:

Siebel CRM 8.0 PSPP UltraSPARC T2 beats POWER6 and sets World Record

Thursday Jan 10, 2008

arrgghhh... I've been asked to show only Sun's results. You must now do your own math with the information posted on Oracle's website: http://www.oracle.com/apps_benchmark/doc/Sun_Siebel8_10000_PSPP_On_Solaris.pdf
http://www.oracle.com/apps_benchmark/doc/IBM_Siebel8_7000_PSPP_On_AIX_POWER6%20Final.pdf

IBM now longer holds the world record and really needs to post a correction on:
http://www-03.ibm.com/systems/p/hardware/benchmarks/erp.html

Four Sun SPARC Enterprise T5120 and T5220 servers (UltraSPARC T2 processors) set a new World Record using Siebel's standard Platform Sizing and Performance Program (PSPP) benchmark suite with Siebel CRM 8.0 Industry Applications and Oracle 10g R2 DB running on Solaris 10.

The Sun results using the UltraSPARC T2 supported 30% higher Siebel benchmark concurrent users compared to other results on the Siebel CRM Applications Release 8.0.

Sun again shows the UltraSPARC T2 servers are ideally suited for Oracle database applications. The database server ran Oracle 10g R2 on this Siebel benchmark.

{ Stuff deleted }

Sun's Solaris and Coolthreads based servers proves once again to be the best combination for scalability and resource utilization in the datacenter, giving users a consistent response time on critical applications as shown 10,000 users benchmark on Siebel CRM 8.0.

The 10,000 Siebel benchmark users performance results on 4 Sun SPARC Enterprise T5120/T5220 servers running Solaris 10 delivers a scalable and cost-effective platform for deploying Siebel CRM Application and Oracle 10g R2 deployment.

The result of 10,000 active concurrent Siebel user benchmark was run end to end on the new generation of Sun SPARC Enterprise servers using coolthreads technology with the highest level of space and energy efficiency.

See Also: http://www.oracle.com/apps_benchmark/html/white-papers-siebel.html

Siebel CRM 8.0 PSPP Performance Chart as of 01/04/2008 (bigger is better)

Vendor Users Web Server Application Servers Database Server
Sun 10,000 1 x Sun SPARC Enterprise T5120
4 cores, 1 chip @1.2 GHz US-T2
    8 GB RAM
Siebel CRM 8.0 SIA [20204] ENU
Sun Java System Web
    Server 6.1 SP8
Solaris 10 8/07 		1 x Sun SPARC Enterprise T5220
8 cores, 1 chip @1.4 GHz US-T2
    32 GB RAM
1 x Sun SPARC Enterprise T5220
8 cores, 1 chip @1.2 GHz US-T2
    32 GB RAM
Siebel CRM 8.0 SIA [20204] ENU
Solaris 10 8/07		 1 x Sun SPARC Enterprise T5120
8 cores, 1 chip @1.2 GHz US-T2
    32 GB RAM
Oracle 10gR2 Database
    Server v10.2.0.1.0
Solaris 10 8/07
. . . . .

As noted on the official benchmark report: "Siebel CRM Release 8.0 Industry Application Platform Sizing and Performance benchmarks are based on Siebel CRM Release 8.0 customized industry applications and reflect a heavier scenario mix and more-aggressive think times than earlier version. Results of this benchmark are not comparable with those of prior Siebel CRM Release 7 benchmarks."

Benchmark Description

Siebel CRM 8.0 Platform Sizing and Performance Program (PSPP) is a multi-tier benchmark designed to stress the Siebel CRM Release 8.0 architecture and to demonstrate that large customers can successfully deploy many thousands of concurrent users. Among the Siebel CRM Release 8.0 architecture features exercised are the following:

  • Smart Web Architecture: Takes advantage of the newest Web browser technology to deliver a highly interactive experience. The interaction model, which is similar to Windows-based applications, also improves productivity. Utilization rates on the web server are low, allowing customers to retain existing Web server infrastructure.

  • Smart Network Architecture: Allows Siebel CRM Release 8.0 customers to leverage their existing network infrastructure by compressing and caching user interface components, so that browser/Web server interaction occurs only when the application requests data. This allows customers to avoid expensive network upgrades that can be necessary with competing products.

  • Server Connection Broker: The Siebel Connection Broker (SCBroker) is a server component that provides intraserver loadbalancing. SCBroker distributes server requests across multiple instances of Application Object Managers (AOMs) running on a Siebel server.

  • Smart Database Connection Pooling and Multiplexing: Allows customers to scale their database without intrducing expensive and complex transaction-processing monitors.

  • Server Request Broker: Server Request Broker (SRBroker) processes synchronous server requests - reuqests that must be run immediately, and for which the calling process waits for completion.

  • Enterprise Application Integration: Allows customers to integrate their existing systems with Siebel CRM applications.

  • eScript: eScript is a scripting or programming language that application developers use to write simple scripts to extend Siebel applications. Javascript, a popular scripting language used primarily on Web sites, is its core language.

The test simulated real-world requirements of a large organization, consisting of 10,000 concurrent, active users from multiple departments accessing a call center. Test conditions simulated service representatives running Siebel Financial Services Call Center and partner organizations running Siebel Partner Relationship Management (Web sales and Web service). Siebel Workflow and the Siebel Scripting Engine were used to incorporate business-process-management customizations. The application also simulated integration with Web systems, using the Siebel Enterprise Application Integration component and Siebel Web Services.

Disclosure Statement:

Siebel CRM 8.0 Platform Sizing and Performance Program (PSPP) benchmark as of 01/04/08. Sun Microsystems: 10,000 users, 1 x Sun SPARC Enterprise T5120 web server (4 cores, 1 chip @1.2 GHz US-T2, 8 GB RAM), Siebel CRM 8.0 SIA [20204] ENU, Sun Java System Web Server 6.1 SP8, Solaris 10 8/07, 1 x Sun SPARC Enterprise T5220 application server (8 cores, 1 chip @1.4 GHz US-T2, 32 GB RAM), 1 x Sun SPARC Enterprise T5220 application server (8 cores, 1 chip @1.2 GHz US-T2, 32 GB RAM) Siebel CRM 8.0 SIA [20204] ENU, Solaris 10 8/07, 1 x Sun SPARC Enterprise T5120 database server (8 cores, 1 chip @1.2 GHz US-T2, 32 GB RAM), Oracle 10gR2 Database Server v10.2.0.1.0, Solaris 10 8/07 Oracle, Siebel, registered trademarks of Oracle Corporation and/or its affiliates. More info www.oracle.com/apps_benchmark/html/white-papers-siebel.html

Power Reference:

Sun measured: Database Server (1.2 GHz T5120, 8 core, 32G memory): 291W, Gateway/Application Server #1 (1.4 GHz T5220, 8 core, 32G memory): 323W, Application Server #2 (1.2 GHz T5220, 8 core, 32G memory): 376W, Web Server (1.2 GHz T5120, 4 core, 8G memory): 212W.

IBM power calculation based on the following: The p570 is supplied in building blocks with 2 chips, 4 cores per chassis called a CEC. Up to 4 CECs can be connected together to create a single 16 chip, 32 core SMP system. Each CEC is 4 RU, and each CE is estimatedC to consume 1,040 watts when configured with 2 processors, based on the following: IBM p6 570 power specifications from 80% of maximum report power consumption published here, 06/07/07, posted at ftp://ftp.software.ibm.com/common/ssi/rep_sp/n/PSB01628USEN/PSB01628USEN.PDF

System Configuration

Certified Results 10,000 Users
Reference Date: January 4, 2008
Systems: 1 x Sun SPARC Enterprise T5120, web server (one 1.2GHz UltraSPARC T2)
1 x Sun SPARC Enterprise T5220, gateway/application server (one 1.4GHz UltraSPARC T2)
1 x Sun SPARC Enterprise T5220, application server(one 1.2GHz UltraSPARC T2)
1 x Sun SPARC Enterprise T5120, database server (one 1.2GHz UltraSPARC T2)
Operating System: Solaris 10 8/07
Software: Sun Java System Web Server 6.1 SP8
Siebel CRM 8.0 SIA [20204] ENU
Oracle 10gR2 Database Server v10.2.0.1.0

[21] Comments
Like this post? del.icio.us | furl | slashdot | technorati | digg
Posted at 06:58AM Jan 10, 2008 by BM Seer in Benchmark Issues
Tags:

UltraSPARC T2 servers better/lower-price than IBM high-end Power6

Thursday Dec 06, 2007

In the past posting there was a comment that one can't compare high-end Power6 systems with what they call low-end T2 systems. Quite simply UltraSPARC T2 systems can out perform Power6 on important datacenter workloads and much lower cost. Little need to buy from the ultra-expensive-IBM.

  • SAP-SD, clearly a high-end ERP benchmark with SAP and database. Sun T5120 Beats ultra-expensive 4-core IBM p570 4.7 GHz POWER6 by 7%. Oracle Database used on Sun's SAP-SD.
  • SPECjAppServer, another application tier and database-tier benchmark. Good for high-end servers, clearly UltraSPARC T2 is in that class and much less expensive the Power6. UltraSPARC T2 used as Oracle Database server. Sun T5120 67% faster 4-core IBM p570 4.7GHz Power6
    App Server: 3.8 better power-perf & 7x better SWaP
    Oracle Server: 3.4 better power-perf & 14x better SWaP
  • SPECjbb, another application benchmark with lots of big servers. Sun T5220 9% faster than 4-core IBM p570 4.7GHz POWER6, 2.5x better power-performance & 5x better SWaP
  • SPECint_rate2006: UltraSPARC T2 1.4GHz beats best 1-chip(2-core) IBM POWER6 4.7GHz by 29%
  • No SPECweb2005 on power6, OK web is not an application for Power6 otherwise they would have published. However IBM did publish on the IBM p550 Power5 (an embarrassingly low result). Evidently the even more expensive are reputably faster Power6 couldn't get to the level of performance.

Pricing dataquoted to a customer!
IBM p570 POWER6 4.7GHz 4-core, 32GB $252K USD
IBM p570 POWER6 4.7GHz 4-core, 64GB $313K USD ($78K/core!!!)

So I'm left with 4-core Power6 is way to expensive and doesn't have any more redundancy features that UltraSPARC T2 which outperforms it.

The only public info that lists IBM component prices that I know is at: http://www.tpc.org/results/individual_results/IBM/IBM_570_10000GB_20071015_ES.pdf

Disclosure statement

SPEC, SPECint reg tm of Standard Performance Evaluation Corporation. Results from www.spec.org as of 11/13/07. Sun Blade T6320 (UltraSPARC T2, 1 chip, 8 cores), 78.6 SPECint_rate2006. Sun SPARC Enterprise T5220 (UltraSPARC T2, 1 chip, 8 cores), 78.5 SPECint_rate2006.Sun SPARC Enterprise T5220 gccfss (UltraSPARC T2, 1 chip, 8 cores), 78.0 SPECint_rate2006. IBM p570 (POWER6, 1 chip, 2 cores), 60.9 SPECint_rate2006. Sun SPARC Enterprise T5220 (UltraSPARC T2, 1 chip, 8 cores), 62.3 SPECfp_rate2006. IBM p570 (POWER6, 1 chip, 2 cores), 58.0 SPECfp_rate2006. SPEC, SPEComp reg tm of Standard Performance Evaluation Corporation. Other results from www.spec.org as of 11/13/07. Sun SPARC Enterprise T5220 (1 chip, 8 cores, 64 threads, 1.4 GHz) 16208 SPECompM2001. Sun SPARC Enterprise T5220 (1 chip, 8 cores, 64 threads, 1.4 GHz) 16208 SPECompM2001. IBM p5 520 (1 chip, 2 cores, 4 threads, 1.9 GHz) 8174 SPECompM2001. Sun SPARC Enterprise T5220 (1 chip, 8 cores, 64 threads, 1.4 GHz) 16208 SPECompM2001. Sun SPARC Enterprise T5220 (8 cores, 1 chip) 37001 SPECweb2005. IBM p5 550 (4 cores, 2 chips) 7881 SPECweb2005. SPEC, SPECweb reg tm of Standard Performance Evaluation Corporation. Results from www.spec.org as of Nov 13, 2007. Sun SPARC Enterprise T5220 server power consumption taken from measurements made during the benchmark run. Power is average measured watts during benchmark run.IBM 550 power specifications calculated by applying 70% of the Maximum Watts published in “Facts and Features Report”, 11/14/06, posted at ftp://ftp.software.ibm.com/common/ssi/rep_sp/n/PSB01628USEN/PSB01628USEN.PDF. SPECjbb2005 Sun SPARC Enterprise T5120 (1 chip, 8 cores) 192055 SPECjbb2005 bops, 24007 SPECjbb2005 bops/JVM, Sun SPARC Enterprise T5220 (1 chip, 8 cores) 192055 SPECjbb2005 bops, 24007 SPECjbb2005 bops/JVM, Sun SPARC Enterprise T5120 (1 chip, 8 cores) 170153 SPECjbb2005 bops, 170153 SPECjbb2005 bops/JVM, Sun SPARC Enterprise T5220 (1 chip, 8 cores) 170153 SPECjbb2005 bops, 170153 SPECjbb2005 bops/JVM, Sun SPARC Enterprise T5120/T5220 results submitted to SPEC, IBM p570 (1 chip, 2 cores) 88089 SPECjbb2005 bops, 88089 SPECjbb2005 bops/JVM, IBM p570 (2 chips, 4 cores) 175474 SPECjbb2005 bops, 87737 SPECjbb2005 bops/JVM, IBM p505Q (2 chips, 4 cores) 63544 SPECjbb2005 bops, 31772 SPECjbb2005 bops/JVM, SPEC, SPECjbb reg tm of Standard Performance Evaluation Corporation. Results as of 10/08/2007 on www.spec.org. The 2-core IBM p570 POWER6 system requires 4 RU or 4 times the rack space of a Sun T5120 and consumes on average 1040 Watts of power. The 4-core IBM p570 POWER6 system requires 4 RU or twice the rack space of a Sun T5220 and consumes on average 1040 Watts of power. IBM p6 570 2-core & 4-core power specifications from 80% of maximum report power consumption published here, 06/07/07, posted here. The IBM p505Q POWER5+ system requires 1 RU of rack space and consumes on average 320 Watts of power. IBM p505 power specifications from 80% of maximum report power consumption published in ?Facts and Features Report?, 03/27/06, posted here. 1 IBM p570 (4 cores, 2 chips) and 1 IBM p550 (4 cores, 2 chips) 1197.51 SPECjAppServer2004 JOPS@Standard. 1 IBM p505Q (4 cores, 2 chips) and 1 IBM p550(4 cores, 2 chips) 618.38 SPECjAppServer2004 JOPS@Standard. SPEC, SPECjAppServer reg tm of Standard Performance Evaluation Corporation. Results from www.spec.org as of 10/10/2007. The IBM p570 POWER6 system requires 4RU or twice the rack space of a Sun T5220 and consumes on average 1040 Watts of power. The IBM p6 570 power specifications from 80% of maximum report power consumption published 06/07/07, posted here. The IBM p505Q requires 1 RU of rack space and consumes on average 320* Watts of power. The IBM p505 power specifications from 80% of maximum report power consumption published in "Facts and Features Report", 03/27/07, posted here. The IBM p550 requires 4RU of rack space and consumes on average 770* Watts of power. The IBM p5 power specifications calculated by applying 70% of the power numbers published in ?Facts and Features Report?, 3/10/06, posted < href=http://www-03.ibm.com/servers/eserver/pseries/hardware/factsfeatures.html> here. Two-tier SAP Standard Sales and Distribution (SD) standard SAP ERP 2005 application benchmark: SPARC Enterprise Model T5120 (1-way, 1 proc, 8 cores, 64 threads) 1 x 1.4 GHz UltraSPARC T2, 64GB memory, 2175 SD Benchmark users, 1.91 sec avg response time, Cert#20070xx, Oracle 10g, Solaris 10; SPARC Enterprise Model T2000 | Sun Fire T2000 (1-way, 1 proc, 8 cores, 32 threads) 1 x 1.4 GHz UltraSPARC T1, 64GB memory, 1100 SD Benchmark users, 1.91 sec avg response time, Cert#2007051, Oracle 10g, Solaris 10; IBM System p 570 (2-way, 2 processors, 4 cores, 8 threads) 2 x 4.7 GHz POWER6, 32GB memory, 2035 SD Benchmark users, 1.99s avg resp time, Cert#2007037, Oracle 10g, AIX 5L Version 5.3; SAP, R/3, mySAP reg TM of SAP AG in Germany and other countries. More info www.sap.com/solutions/benchmark.

[10] Comments
Like this post? del.icio.us | furl | slashdot | technorati | digg
Posted at 02:30PM Dec 06, 2007 by BM Seer in IBM Follies
Tags:

gcc, SPEC CPU2006, & Sun SPARC Enterprise T5220

Friday Nov 02, 2007

Sun has released benchmarks results on SPEC CPU with GCCfss. GCCfss is a GCC compatible frontend with Sun Studio backend. If you have codes developed with GCC you can now just use it to run really fast on UltraSPARC T2, with all kinds of great optimizations.

For more on GCCfss see: http://cooltools.sunsource.net/gcc/

The Sun SPARC Enterprise T5220 server, running at 1.4 GHz, delivered a result 78.0 SPECint_rate2006 which is slightly lower (1%) when compared with the full Sun Studio 12 compiler.

The Sun SPARC Enterprise T5220 using the GCC for SPARC Systems (gccfss) compiler topped all competitor's single chip results including the 4.7 GHZ POWER6 result from IBM by over 28% which used a proprietary compiler.

The gccfss compiler allows one to use the optimal Sun SPARC optimization tools along with the popular gcc coding conventions and deliver performance that has not been possible before without time consuming code changes.

SPEC CPU2006 Performance Charts: bigger is better, selected recent results

SPECint_rate2006

System Processors Performance Results
Type GHz Chips Cores Threads Peak Base
T5120/T5220 UltraSPARC T2 1.4 1 8 64 78.5 73.0
T5220 (gccfss) UltraSPARC T2 1.4 1 8 64 78.0 71.6
HP DL360 G5 Intel X5365 3.0 1 4 4 61.3 53.8
IBM p 570 Power6 4.7 1 2 4 60.9 53.2
Fujitsu RX300 Intel X5355 2.66 1 4 4 52.8 50.5

Results as of 30 Oct 2007 from www.spec.org.

Benchmark Description

SPEC CPU2006 is made up of two suites of benchmarks, CFP2006 and CINT2006. CFP2006 targets floating-point performance, while CINT2006 targets integer performance.

Each suite has two different measures. First is the CPU measure, which is the performance on the suite as a single stream. This can be either a single thread or automatic compiled parallel run. This measure is further defined by base and optimized runs. Base uses the same compiler flags for all kernels, where optimized is allowed to use different compiler flags for each kernel. Results are compared against a baseline system run that was standardized by SPEC.

The second measure is Rate. It is a measure of how many CPU measures can be run at a time. Typically, it is run as n processes on n processors. It shows how well the same job mix can run on a system under some load. It also is run as a base and optimized set of results.

Disclosure Statement:

SPEC, SPECint reg tm of Standard Performance Evaluation Corporation. Sun result submitted to SPEC, other results from www.spec.org as of 10/30/07. Sun SPARC Enterprise T5220 gccfss (UltraSPARC T2, 1 chip, 8 cores), 78.0 SPECint_rate2006; IBM p570 (POWER6, 1 chip, 2 cores), 60.9 SPECint_rate2006; HP DL360 G5 (Intel X5365 1chip 4-core), 61.3 SPECint_rate2006; Fujitsu RX300 (Intel X5355, 1-chip, 4-core) 52.8 SPECint_rate2006; Sun SPARC Enterprise T5220 (UltraSPARC T2, 1 chip, 8 cores), 78.5 SPECint_rate2006.

Results Summary

Results
Reference Date: Oct 30, 2007
System: Sun SPARC Enterprise T5220
Processor: Sun UltraSPARC T2, 1.4 GHz
  78.0 SPECint_rate2006
Software: Solaris 10, Sun Studio 12 Compiler gccfss

[2] Comments
Like this post? del.icio.us | furl | slashdot | technorati | digg
Posted at 07:07AM Nov 02, 2007 by BM Seer in Benchmarks
Tags:

careful reading shows a lot

Wednesday Oct 24, 2007

You have to read some things carefully

    "...And the good news is that about 40-70% of the stuff we do in performance tuning actually ends up helping end users," -- Bruce Lindsay(IBM Fellow), May 06, http://www.sigmod.org/sigmod/record/issues/0506/p71-column-winslet.pdf

    "This is feasible in the TPC-C benchmark because there are only five tables and only ten to fifteen columns in each table. In a more realistic application, where there are many more queries to be considered, the tables are typically much, much wider, in the 80 to 100 column range; and there are dozens if not thousands of tables. Then this kind of analysis(ed note: tuning) is no longer practical." -- Bruce Lindsay(IBM Fellow since '96), May 06, http://www.sigmod.org/sigmod/record/issues/0506/p71-column-winslet.pdf

    "The idea is to get the numbers by hook and by crook." -- Bruce Lindsay(IBM Fellow since '96), May 06, http://www.sigmod.org/sigmod/record/issues/0506/p71-column-winslet.pdf

    The TPC-C benchmark is an industry standard for measuring the ability of a system to process complex online transactions and large volumes of business data. The TPC-C benchmark is unique in the way it exercises all components of a system, including processors, memory, networking, storage, operating system and database software, demonstrating total system performance in a way that many of the other benchmarks touted by some competitors do not. -- Bruce Lindsay(IBM Fellow since '96), July 25, 2006, http://www-03.ibm.com/solutions/sap/doc/content/news/pressrelease/1623288130.html

Issues:
  • This means that 30% to 60% of IBM's TPC-C tuning is useless for customers.
  • IBM clearly over-hyped TPC-C, just 2-3 months after they publicly showed all of its problems and "optimizations" they used.

    Next:

      "Significantly, the high utilization rate of the System z9 mainframes -- systems can and do operate at 80 to 100 percent utilization -- combined with its ability to "virtualize" workloads, can enable a single mainframe processor to perform far more work than a single x86 processor running Microsoft Windows. The latter may run as low as 5 percent utilization." - IBM Press Release http://www-03.ibm.com/press/us/en/pressrelease/19577.wss
    Issues:
  • used different work for mainframe and for its competitor.
  • "do" and "may" mean very different things
  • "mainframes do operate at 80-100%", "x86 processor running Microsoft Windows. The latter may run as low as 5%". So it is a valid but totally useless statement.
  • An equally invalid statement: x86 do operate at 80-100% and mainframes may run as low as 5%.

    Next:

      "First of all, the math is really simple. 4.7 is greater than 1.4. IBM's POWER6 4.7 GHz chip is faster than Sun's 1.4 GHz UltraSPARC T1 chip. And second of all, the IBM System p 570 remains the #1 SPECjbb2005 2-core result (1)." Marketing Program manager of IBM performance blog, Jun07
    Issues:
  • Did not compare system or chip performance but only quoted the GHz of a chip?
  • Made a true statement about core count but ignored that that IBM cores cost much more than Sun UltraSPARC T1 and/or UltraSPARC T2 on a per core basis, I know this is hard to verify since IBM isn't public about pricing, so you'll have to ask your IBM people to price specific configurations for you, be specific so you understand exactly what is priced.

    Next:

      "Even more impressive, the processor bandwidth of the POWER6 chip – 300 gigabytes per second -- could download the entire iTunes catalog in about 60 seconds" - IBM Press Release http://www-03.ibm.com/press/us/en/pressrelease/21580.wss
    Issues:
  • Added every bandwidth (L3 cache, address bandwidth?!?,...) in a chip, even though peak memory bandwidth is limited to at least a 10th of that, delivered is a lot less.
  • stated "processor bandwidth", even though "delivered" system bandwidth would actually be required to move the data (not address :) ).

    Next:

      "IBM calculates that 30 SunFire v890s can be consolidated into a single rack of the new IBM machine, saving more than $100,000 per year on energy costs (3)." - IBM Press Release http://www-03.ibm.com/press/us/en/pressrelease/21580.wss
    Issues:
  • used 2 year old sun result compared to power6 yet to be shipped as of may press release
  • said V890, so that people think it is a current comparison, had to read in the footnotes that it was 1.5 GHz slower CPU. Sun has introduced 1.8GHz, and 2.1GHz since.
  • made a "conservative" comparisons by giving IBM another 15% in performance
  • claimed Sun at 20% utilisation and IBM at 60% utilisation, that is one way to get 3x over your competition :)
  • never showed exactly what power was drawn by a 4.7GHz, 64GB memory system, at ??MHz DDR2 used in the comparison, etc.

    This was a bit of a repeat, but some things should not be forgotten.

    I've never been about popularity or names. You don't need my expertise to see funny things in IBM's statements. Don't attack me, attack the facts. Anonymously yours, Sun's BM Seer.

    Disclosure statement:

    TPC-C is a trademark of Transaction Processing Performance Council (TPC). More info www.tpc.org.

    Like this post? del.icio.us | furl | slashdot | technorati | digg
    Posted at 03:14PM Oct 24, 2007 by BM Seer in Benchmark Issues
    Tags:

    • SPECjAppServer2004 World Record Single-Application server Sun SPARC Enterprise T5220 and a Sun SPARC Enterprise T5120 (Oracle database server)

    Thursday Oct 11, 2007

    The Sun UltraSPARC T2 processor provides fast performance at both the Oracle database tier and the java application tier. The Sun SPARC Enterprise T5220 server delivered a World Record result of 2000.92 SPECjAppServer2004 JOPS@Standard for a single application server system. This result used a Sun SPARC Enterprise T5220 Application Server (single UltraSPARC T2 1.4GHz) and a Sun T5120 Server Database System (single UltraSPARC T2 1.2GHz).

    This benchmark used the Oracle Application Server 10g Release 10.1.3.3 - Java Edition and Oracle Database Enterprise Edition Release 10.2.0.3. This benchmark result proves that the Sun SPARC Enterprise T5220 and T5120 servers using the UltraSPARC T2 processor perform as oustanding J2EE application servers as well as an Oracle 10G OLTP database server.

    The Sun T5220 server consumed an average of 468 Watts and the Sun T5120 consumed an average of 388 Watts for a total of 856 Watts in 3 RU space during the execution of this benchmark.

    One Sun T5220 server (single UltraSPARC T2 chip) demonstrated 67% better performance over the IBM result of 1197.51 SPECjAppServer2004 JOPS@Standard which used 4-core IBM p570 with 4.7GHz POWER6 processors. The Sun SPARC Enterprise T5220 used as Application server has 3.8x better power-performance and has 7.3x better SWaP than the IBM p570 power6. Enterprise T5120 used as database servrer has 3.4 better power-performance and has 13.5x better SWaP as the IBM p550.

    One Sun T5220 server (single UltraSPARC T2 chip) demonstrated 19% better performance over the Rackable Systems result of 1672.64 SPECjAppServer2004 JOPS@Standard which used 2-socket Rack C2002 quad-core 2.66GHz Xeon processors.

    One Sun T5220 server (single UltraSPARC T2 chip) demonstrated 30% better performance over the Inspur result of 1538.65 SPECjAppServer2004 JOPS@Standard which used 2-socket Inspur NF280D quad-core 2.66GHz Xeon processors

    One Sun T5220 server (single UltraSPARC T2 chip) demonstrated 58% better performance over the HP result of 1266.42 SPECjAppServer2004 JOPS@Standard which used 4-socket HP rx6600 dual-core 1.6GHz Itanium2 processors. The Sun T5220 achieved 4x better power-performance and has 13.3 better SWaP.

    The SWaP metric is a measure of server efficiency ratio that includes system performance, power and space consumption on a specific benchmark. (SWaP = Perf /[ Space (RU) x Watts ] )

    Power-performance is computed as watt/performance. Since power-performance is related to price/performance they are both calculated with performance in the denominator.

    SPECjAppServer2004 Performance Chart as of 10/10/2007. Complete benchmark results may be found at the SPEC benchmark website http://www.spec.org. SPECjAppServer2004 JOPS@Standard (bigger is better)

      SPECjAppServer2004
    JOPS@Standard    		 J2EE Server DB Server
    Sun 2000.92 1x Sun SPARC Enterprise T5220
    8 cores, 1 chip @ 1.4 GHz US-T2
    Oracle OC4J 10.1.3.3    		 1 x Sun SPARC Enterprise T5120
    8 cores, 1 chip @ 1.2 GHz US-T2
    Oracle 10g DB 10.2.0.3
    Rackable 1672.64 1x Rackable C2002
    8 cores, 2 chips @ 2.66 Xeon X5355
    Oracle OC4J 10.1.3.2    		 1x Rackable S3118
    8 cores, 2 chips @ 2.33 Xeon E5345
    Oracle 10g 10.2.0.2
    Inspur 1538.65 1x Inspur NF280D
    8 cores, 2 chips @ 2.66 GHz Xeon X5355
    BEA WebLogic 10.0    		 1x Inspur NF380D
    8 cores, 2 chips @ 2.66 GHz Xeon X5355
    IBM DB2 9.1
    HP 1266.42 1 x HP rx6600
    8 cores, 4 chips @ 1.6 GHz Itanium 2
    BEA WebLogic 9.1    		 1 x HP rx8620
    16 cores, 16 chips @ 1.6 GHz Itanium 2
    Oracle 10g 10.1.0.4
    IBM 1197.51 1 x IBM p570
    4 cores, 2 chips @ 4.7 GHz IBM POWER6
    IBM WebSphere 6.1    		 1 x IBM p550
    4 cores, 2 chips @ 2.1 GHz IBM POWER5+
    IBM DB2 v9.1
    HP 874.17 1 x HP rx2660
    4 cores, 2 chips @ 1.6 GHz Itanium 2
    Oracle OC4J 10.1.3.2    		 1 x HP rx2660
    4 cores, 2 chips @ 1.6 GHz Itanium 2
    Oracle 10g 10.2.0.2
    Sybase 652.95 1 x Dell PowerEdge 2900
    4 cores, 2 chips @ 3.0 GHz Xeon 5160
    Sybase EAS 6.0.2    		 1 x Dell PowerEdge 2900
    4 cores, 2 chips @ 3.0 GHz Xeon 5160
    SQLAnywhere 10.0.1
    IBM 618.38 1 x IBM p505Q
    4 cores, 2 chips @ 1.65 GHz POWER5+
    IBM WebSphere 6.1    		 1 x IBM p550
    4 cores, 2 chips @ 2.1 GHz POWER5+
    IBM DB2 v8.1

    Benchmark Description

    SPECjAppServer2004 (Java Application Server) is a multi-tier benchmark for measuring the performance of Java 2 Enterprise Edition (J2EE) technology-based application servers. SPECjAppServer2004 is an end-to-end application which exercises all major J2EE technologies implemented by compliant application servers as follows:

    • The web container, including servlets and JSPs
    • The EJB container
    • EJB2.0 Container Managed Persistence
    • JMS and Message Driven Beans
    • Transaction management
    • Database connectivity
    Moreover, SPECjAppServer2004 also heavily exercises all parts of the underlying infrastructure that make up the application environment, including hardware, JVM software, database software, JDBC drivers, and the system network.

    The primary metric of the SPECjAppServer2004 benchmark is jAppServer Operations Per Second (JOPS) which is calculated by adding the metrics of the Dealership Management Application in the Dealer Domain and the Manufacturing Application in the Manufacturing Domain. There is NO price/performance metric in this benchmark.

    Example Disclosure Statement:

    SPECjAppServer2004 1 Sun SPARC Enterprise T5220 (8 cores, 1 chip) and 1 Sun SPARC Enterprise T5120 (8 cores, 1 chip) 2000.92 SPECjAppServer2004 JOPS@Standard. 1 Rackable C2002 (8 cores, 2 chips) 1 Rackable S3118 (8 cores, 2 chips) 1672.64 SPECjAppServer2004 JOPS@Standard. 1 Inspur NF280D (8 cores, 2 chips) and 1 Inspur NF380D (8 cores, 2 chips) 1538.65 SPECjAppServer2004 JOPS@Standard. 1 HP rx6600 (8 cores, 4 chips) and 1 HP rx8620 (16 cores, 16 chips) 1266.42 SPECjAppServer2004 JOPS@Standard. 1 IBM p570 (4 cores, 2 chips) and 1 IBM p550 (4 cores, 2 chips) 1197.51 SPECjAppServer2004 JOPS@Standard. 1 HP rx2660 (4 cores, 2 chips) and 1 HP rx2660 (4 cores, 2 chips) 874.17 SPECjAppServer2004 JOPS@Standard. 1 Dell PowerEdge 2900 (4 cores, 2 chips) and 1 Dell PowerEdge 2900 (4 cores, 2 chips) 652.95 SPECjAppServer2004 JOPS@Standard. 1 IBM p505Q (4 cores, 2 chips) and 1 IBM p550(4 cores, 2 chips) 618.38 SPECjAppServer2004 JOPS@Standard. SPEC, SPECjAppServer reg tm of Standard Performance Evaluation Corporation. Results from www.spec.org as of 10/10/2007.

    The IBM p570 POWER6 system requires 4RU or twice the rack space of a Sun T5220 and consumes on average 1040 Watts of power. The IBM p6 570 power specifications from 80% of maximum report power consumption published 06/07/07, posted here.

    The HP rx2660 requires 2RU of rack space and consumes on average 559 Watts of power. The HP rx2660 power calculated as 70% of max input power reported 07/17/07

    The Dell PowerEdge 2900 requires 5RU of rack space and consumes on average 350 Watts of power. The Dell power rating 08/24/07 from Dell DataCenter Capacity Planner System configured with 2 x Xeon 5160 processors, 8 x 2GB DIMMs, 1 x Disk, 1 x HBA & Redundant PSU

    The IBM p505Q requires 1 RU of rack space and consumes on average 320 Watts of power. The IBM p505 power specifications from 80% of maximum report power consumption published in "Facts and Features Report", 03/27/07, posted here.

    The HP rx2660 requires 2RU of rack space and consumes on average 559 Watts of power. Power Reference: HP rx2660 power calculated as 70% of max input power reported 07/17/07.

    The Dell PowerEdge 2900 requires 5RU of rack space and consumes on average 350 Watts of power. The Dell power rating 08/24/07 from Dell DataCenter Capacity Planner System configured with 2 x Xeon 5160 processors, 8 x 2GB DIMMs, 1 x Disk, 1 x HBA & Redundant PSU

    The IBM p550 requires 4RU of rack space and consumes on average 770 Watts of power. The IBM p5 power specifications calculated by applying 70% of the power numbers published in ?Facts and Features Report?, 3/10/06, posted < href=http://www-03.ibm.com/servers/eserver/pseries/hardware/factsfeatures.html> here.

    The HP rx6600 server requires 7 RU of rack space and consumes on average 1163* Watts of power. Power Reference: HP rx6600 power consumption estimated by taking 70% of the maximum reported power dissipation, documented here on 03/23/07.

    Results Summary

    Certified Results 2000.92 SPECjAppServer2004 JOPS@Standard
    Reference Date: Oct 10, 2007
    Systems: 1 x Sun SPARC Enterprise T5220
    1 x Sun SPARC Enterprise T5120
    Total Number Processors: 1, 1
    Processor/GHz of Server: UltraSPARC T2 1.4 GHz
    UltraSPARC T2 1.2 GHz
    Operating System: Solaris 10 8/07
    Software: Oracle Application Server 10g Release 10.1.3.3 - Java Edition
    Oracle Database Enterprise Edition Release 10.2.0.3
    JVM: J2SE 6.0 update 3

    [3] Comments
    Like this post? del.icio.us | furl | slashdot | technorati | digg
    Posted at 12:50PM Oct 11, 2007 by BM Seer in Benchmarks
    Tags:

    Sun SPARC Enterprise T6320 SPECint_rate2006 Single-Chip World Record

    Thursday Oct 11, 2007

    The Sun Blade 6000 chassis can run Solaris, Linux, Windows, and VMware running on single and multi-core processors by Sun, AMD, and Intel, in one chassis. It is a 10-blade, 10RU Sun Blade 6000 Chassis.

    Sun has announced single chip World Record results for SPECint_rate2006. This result was run on the Sun Blade T6320 blade module which uses the 1.4 GHz UltraSPARC T2 processor.

    The Sun SPARC Enterprise T5220 server, running at 1.4 GHz, beat all single chip results running SPECint_rate2006 with a result of 78.5.

    The Sun Blade T6320 system beats the best single IBM 4.7 GHz dual-core POWER6 processor result by 29%.

    The Sun Blade T6320 system beat the best published single 3 GHz Xeon quad-core by 28% on SPECint_rate2006.

    There are no single quad-core Opteron results published for SPECint_rate2006.

    SPEC SPECint_rate2006 Performance - bigger is better, selected recent results, please see www.spec.org for complete results.

    System CPU Performance
    Type, GHz Chips, Cores,Threads Peak Base
    T6320 US T2 1.4GHz 1, 8, 64 78.6 73.1
    T5120/T5220 US T2, 1.4GHz 1, 8, 64 78.5 73.0
    HP DL360 G5 Intel Xeon QC 3GHz 1, 4, 4 61.3 53.8
    IBM p 570 Power6 4.7GHz 1, 2, 4 60.9 53.2
    Fujitsu RX300 Intel Xeon, 2.66 Xeon 1, 4, 4 52.8 50.5
    Yes UltraSPARC T2 result differences are in the noise between these platforms, SPEC allows run-to-run variations. Notice these results are 0.127% to 0.137% (yes near 1/10 of 1%) different.

    Results as of 9 Jan 2008 from www.spec.org.

    Benchmark Description

    SPEC CPU2006 is made up of two suites of benchmarks, CFP2006 and CINT2006. CFP2006 targets floating-point performance, while CINT2006 targets integer performance.

    Each suite has two different measures. First is the CPU measure, which is the performance on the suite as a single stream. This can be either a single thread or automatic compiled parallel run. This measure is further defined by base and optimized runs. Base uses the same compiler flags for all kernels, where optimized is allowed to use different compiler flags for each kernel. Results are compared against a baseline system run that was standardized by SPEC.

    The second measure is Rate. It is a measure of how many CPU measures can be run at a time. Typically, it is run as n processes on n processors. It shows how well the same job mix can run on a system under some load. It also is run as a base and optimized set of results.

    Disclosure Statement:

    SPEC, SPECint reg tm of Standard Performance Evaluation Corporation. Results as of 9 Jan 2008 from www.spec.org. Sun Blade T6320 (UltraSPARC T2, 1 chip, 8 cores), 78.6 SPECint_rate2006. Sun Blade T6320 (UltraSPARC T2, 1 chip, 8 cores), 78.6 SPECint_rate2006. IBM p570 (POWER6, 1 chip, 2 cores), 60.9 SPECint_rate2006. Sun Blade T6320 (UltraSPARC T2, 1 chip, 8 cores), 78.6 SPECint_rate2006. HP DL360 G5 (X5365, 1 chip, 4 cores), 61.3 SPECint_rate2006.

    Results Summary

    Results
    Reference Date: 9 Jan 2008
    System: Sun Blade T6320
    Processor: Sun UltraSPARC T2, 1.4 GHz
      78.6 SPECint_rate2006
    Software: Solaris 10, Sun Studio 12 Compiler

    [1] Comments
    Like this post?