IBM hates this

Tuesday Jan 22, 2008

I heard from many in the field that IBM hates this Siebel benchmark head-to-head comparison and is trying to do anything to remove it from consideration. It really shows the advantages of Sun's US T2 systems on something real (and agrees with the other benchmarks of course. Well it is out there and they can't make us remove it.

If you want the URL it is: http://blogs.sun.com/bmseer/entry/siebel_crm_8_0_pspp.

...I've seen more benchmarks in the works around the hallways at Sun, you'll see them soon.

Siebel CRM 8.0 PSPP UltraSPARC T2 beats POWER6 and sets World Record

Thursday Jan 10, 2008

arrgghhh... I've been asked to show only Sun's results. You must now do your own math with the information posted on Oracle's website: http://www.oracle.com/apps_benchmark/doc/Sun_Siebel8_10000_PSPP_On_Solaris.pdf
http://www.oracle.com/apps_benchmark/doc/IBM_Siebel8_7000_PSPP_On_AIX_POWER6%20Final.pdf

IBM now longer holds the world record and really needs to post a correction on:
http://www-03.ibm.com/systems/p/hardware/benchmarks/erp.html

---

Four Sun SPARC Enterprise T5120 and T5220 servers (UltraSPARC T2 processors) set a new World Record using Siebel's standard Platform Sizing and Performance Program (PSPP) benchmark suite with Siebel CRM 8.0 Industry Applications and Oracle 10g R2 DB running on Solaris 10.

The Sun results using the UltraSPARC T2 supported 30% higher Siebel benchmark concurrent users compared to other results on the Siebel CRM Applications Release 8.0.

Sun again shows the UltraSPARC T2 servers are ideally suited for Oracle database applications. The database server ran Oracle 10g R2 on this Siebel benchmark.

{ Stuff deleted }

Sun's Solaris and Coolthreads based servers proves once again to be the best combination for scalability and resource utilization in the datacenter, giving users a consistent response time on critical applications as shown 10,000 users benchmark on Siebel CRM 8.0.

The 10,000 Siebel benchmark users performance results on 4 Sun SPARC Enterprise T5120/T5220 servers running Solaris 10 delivers a scalable and cost-effective platform for deploying Siebel CRM Application and Oracle 10g R2 deployment.

The result of 10,000 active concurrent Siebel user benchmark was run end to end on the new generation of Sun SPARC Enterprise servers using coolthreads technology with the highest level of space and energy efficiency.

See Also: http://www.oracle.com/apps_benchmark/html/white-papers-siebel.html

Siebel CRM 8.0 PSPP Performance Chart as of 01/04/2008 (bigger is better)

Vendor	Users	Web Server	Application Servers	Database Server
Sun	10,000	1 x Sun SPARC Enterprise T5120 4 cores, 1 chip @1.2 GHz US-T2     8 GB RAM Siebel CRM 8.0 SIA [20204] ENU Sun Java System Web     Server 6.1 SP8 Solaris 10 8/07	1 x Sun SPARC Enterprise T5220 8 cores, 1 chip @1.4 GHz US-T2     32 GB RAM 1 x Sun SPARC Enterprise T5220 8 cores, 1 chip @1.2 GHz US-T2     32 GB RAM Siebel CRM 8.0 SIA [20204] ENU Solaris 10 8/07	1 x Sun SPARC Enterprise T5120 8 cores, 1 chip @1.2 GHz US-T2     32 GB RAM Oracle 10gR2 Database     Server v10.2.0.1.0 Solaris 10 8/07
.	.	.	.	.

As noted on the official benchmark report: "Siebel CRM Release 8.0 Industry Application Platform Sizing and Performance benchmarks are based on Siebel CRM Release 8.0 customized industry applications and reflect a heavier scenario mix and more-aggressive think times than earlier version. Results of this benchmark are not comparable with those of prior Siebel CRM Release 7 benchmarks."

Benchmark Description

Siebel CRM 8.0 Platform Sizing and Performance Program (PSPP) is a multi-tier benchmark designed to stress the Siebel CRM Release 8.0 architecture and to demonstrate that large customers can successfully deploy many thousands of concurrent users. Among the Siebel CRM Release 8.0 architecture features exercised are the following:

• Smart Web Architecture: Takes advantage of the newest Web browser technology to deliver a highly interactive experience. The interaction model, which is similar to Windows-based applications, also improves productivity. Utilization rates on the web server are low, allowing customers to retain existing Web server infrastructure.
• Smart Network Architecture: Allows Siebel CRM Release 8.0 customers to leverage their existing network infrastructure by compressing and caching user interface components, so that browser/Web server interaction occurs only when the application requests data. This allows customers to avoid expensive network upgrades that can be necessary with competing products.

• Server Connection Broker: The Siebel Connection Broker (SCBroker) is a server component that provides intraserver loadbalancing. SCBroker distributes server requests across multiple instances of Application Object Managers (AOMs) running on a Siebel server.
• Smart Database Connection Pooling and Multiplexing: Allows customers to scale their database without intrducing expensive and complex transaction-processing monitors.
• Server Request Broker: Server Request Broker (SRBroker) processes synchronous server requests - reuqests that must be run immediately, and for which the calling process waits for completion.
• Enterprise Application Integration: Allows customers to integrate their existing systems with Siebel CRM applications.
• eScript: eScript is a scripting or programming language that application developers use to write simple scripts to extend Siebel applications. Javascript, a popular scripting language used primarily on Web sites, is its core language.

The test simulated real-world requirements of a large organization, consisting of 10,000 concurrent, active users from multiple departments accessing a call center. Test conditions simulated service representatives running Siebel Financial Services Call Center and partner organizations running Siebel Partner Relationship Management (Web sales and Web service). Siebel Workflow and the Siebel Scripting Engine were used to incorporate business-process-management customizations. The application also simulated integration with Web systems, using the Siebel Enterprise Application Integration component and Siebel Web Services.

Disclosure Statement:

Siebel CRM 8.0 Platform Sizing and Performance Program (PSPP) benchmark as of 01/04/08. Sun Microsystems: 10,000 users, 1 x Sun SPARC Enterprise T5120 web server (4 cores, 1 chip @1.2 GHz US-T2, 8 GB RAM), Siebel CRM 8.0 SIA [20204] ENU, Sun Java System Web Server 6.1 SP8, Solaris 10 8/07, 1 x Sun SPARC Enterprise T5220 application server (8 cores, 1 chip @1.4 GHz US-T2, 32 GB RAM), 1 x Sun SPARC Enterprise T5220 application server (8 cores, 1 chip @1.2 GHz US-T2, 32 GB RAM) Siebel CRM 8.0 SIA [20204] ENU, Solaris 10 8/07, 1 x Sun SPARC Enterprise T5120 database server (8 cores, 1 chip @1.2 GHz US-T2, 32 GB RAM), Oracle 10gR2 Database Server v10.2.0.1.0, Solaris 10 8/07 Oracle, Siebel, registered trademarks of Oracle Corporation and/or its affiliates. More info www.oracle.com/apps_benchmark/html/white-papers-siebel.html

Power Reference:

Sun measured: Database Server (1.2 GHz T5120, 8 core, 32G memory): 291W, Gateway/Application Server #1 (1.4 GHz T5220, 8 core, 32G memory): 323W, Application Server #2 (1.2 GHz T5220, 8 core, 32G memory): 376W, Web Server (1.2 GHz T5120, 4 core, 8G memory): 212W.

IBM power calculation based on the following: The p570 is supplied in building blocks with 2 chips, 4 cores per chassis called a CEC. Up to 4 CECs can be connected together to create a single 16 chip, 32 core SMP system. Each CEC is 4 RU, and each CE is estimatedC to consume 1,040 watts when configured with 2 processors, based on the following: IBM p6 570 power specifications from 80% of maximum report power consumption published here, 06/07/07, posted at ftp://ftp.software.ibm.com/common/ssi/rep_sp/n/PSB01628USEN/PSB01628USEN.PDF

System Configuration

Certified Results			10,000 Users
Reference Date:			January 4, 2008
Systems:			1 x Sun SPARC Enterprise T5120, web server (one 1.2GHz UltraSPARC T2)
			1 x Sun SPARC Enterprise T5220, gateway/application server (one 1.4GHz UltraSPARC T2)
			1 x Sun SPARC Enterprise T5220, application server(one 1.2GHz UltraSPARC T2)
			1 x Sun SPARC Enterprise T5120, database server (one 1.2GHz UltraSPARC T2)
Operating System:			Solaris 10 8/07
Software:			Sun Java System Web Server 6.1 SP8
			Siebel CRM 8.0 SIA [20204] ENU
			Oracle 10gR2 Database Server v10.2.0.1.0