A new and exceptional TPC-H result submitted today has been obtained on a cluster of 43 Sun Fire X4540 servers, each equipped with two AMD Opteron 2356 2.3 GHz processors, running ParAccel Analytic Database on Sun OpenSolaris 2009.06. The Sun/ParAccel Cluster achieved a result of 1,050,556.20 QphH @30000GB with a price performance of $2.86/QphH @30000GB.
This is an incredible World Record for both performance and price-performance at the largest TPC-H Scale Factor (30TB) to date.
As of today, the only other 30TB result posted is on a single HP Superdome, powered by 64 x 1.6 GHz Itanium2 Dual Core processors running Oracle 10gR2. The HP result is 150,960 QphH @30000GB with a price-performance of $46.69/QphH @30000GB.
This result establishes the overall leadership of the Sun/ParAccel/OpenSolaris cluster solution in Decision Support Systems (DSS) and Data Warehousing.
-
The Sun Fire X4540 / ParAccel Cluster was over seven time (7x) faster than the HP Superdome and had sixteen times (16x) better price-performance. In addition, the total cost of the Sun/ParAccel configuration (H/W + S/W + 3 years maintenance) is less than half of the total cost of the HP/Oracle configuration.
- The Sun Fire X4540 cluster storage consisted entirely of fully mirrored internal drives. There were almost 1000 fewer disk spindles than the HP Superdome solution (2064 vs. 3072 disks), resulting in an enormous reduction of hardware logistics, at a fraction of the floor space (172 RU vs 1120 RU).
- This solution is one of the TPC-H new-generation DSS DBMS (column based, shared nothing, data compression, etc.) results. It is noteworthy that all of the other new generation TPC-H submissions (at 100GB up to 3000GB) ran queries entirely from memory. This new result is disk based and thus establishes the leadership and viability of the Sun/ParAccel/OpenSolaris solution on shared nothing clusters for very large disk based databases -- much larger than memory sizes realistically available even in extremely large database installations.
- There are a number of new generation DBMS designed for Decision Support such as ParAccel, either currently for sale or still under development, all implemented on Linux. This result is the first public proof point of a new generation data warehousing product running on Solaris, more specifically OpenSolaris.
- The load time of the 30TB database on the Sun/ParAccel cluster was 4 times faster than the HP Superdome solution. For large DSS databases, load time is a very important factor.
Performance Landscape
ch/co/th = chips, cores, threads
$/QphH = TPC-H Price/Performance metric (smaller is better)
QphH = TPC-H Composite Metric (bigger is better)
| System |
ch/co/th | Database | QphH | $/QphH | Price | # Disks | Available |
|---|---|---|---|---|---|---|---|
| 43 x Sun Fire X4275 | 86/344/344 | PADB | 1,050,566 | 2.86 | $3,006,861 | 2064 | 06/21/09 |
| 1 x HP Superdome | 64/128/128 | Oracle | 150,960 | 46.69 | $7,048,342 | 3072 | 06/18/07 |
Complete benchmark results may be found at the TPC benchmark website http://www.tpc.org.
Results and Configuration Summary
Servers:
- 43 X Sun Fire X4540 each with:
- 2 x AMD Opteron 2356, 2.3 GHz QC processors
64 GB memory
48 x 500GB (7,200 RPM) internal SATA disks
344 total processor cores
344 total processor threads
Storage:
- No external storage
Switches:
- 3 x 48 port Cisco 3750 + 4 x Cisco 3750 24 port 1Gb Ethernet Switches
Software:
- Operating System: OpenSolaris 2009.06
Database Manager: ParAccel PADB
Audited Results:
| Database Size: | 30,000 GB (Scale Factor) |
| TPC-H Composite: | 1,050,566.20 QphH@30000GB |
| Price/performance: | $2.86 / QphH@30000GB |
| Available: | June 21, 2009 |
| Total 3 Year Cost: | $3,006,861 |
| TPC-H Power: | 1,326,910.40 |
| TPC-H Throughput: | 831,758.00 |
| Database Load Time: | ~3 Hours 29 minutes |
| Storage Ratio: | 32.04 |
Benchmark Description
The TPC-H benchmark is a performance benchmark established by the Transaction Processing Council (TPC) to demonstrate Data Warehousing/Decision Support Systems (DSS). TPC-H measurements are produced for customers to evaluate the performance of various DSS systems. These queries and updates are executed against a standard database under controlled conditions. Performance projections and comparisons between different TPC-H Database sizes (100GB, 300GB, 1000GB, 3000GB and 10000GB) are not allowed by the TPC.
TPC-H is a data warehousing-oriented, non-industry-specific benchmark that consists of a large number of complex queries typical of decision support applications. It also includes some insert and delete activity that is intended to simulate loading and purging data from a warehouse. TPC-H measures the combined performance of a particular database manager on a specific computer system.
The main performance metric reported by TPC-H is called the TPC-H Composite Query-per-Hour Performance Metric (QphH@SF, where SF is the number of GB of raw data, referred to as the scale factor). QphH@SF is intended to summarize the ability of the system to process queries in both single and multi user modes. The benchmark requires reporting of price/performance, which is the ratio of QphH to total HW/SW cost plus 3 years maintenance. A secondary metric is the storage efficiency, which is the ratio of total configured disk space in GB to the scale factor.
Key Technical Points
ParAccel PADB is one of a new generation of DBMS designed specifically
for Decision Support and Data Warehousing applications.The Sun Fire X4540 and
OpenSolaris2009.06 are a perfect match for the PADB solution. The Sun Fire
X4540 with its large amount of internal storage in a compact form
factor and OpenSolaris with ISM shared memory management, network
performance and powerful Dtrace performance analysis tools.
Below are the
main architectural features of the ParAccel product:
Shared Nothing Architecture
Shared nothing is the most optimal hardware architecture for highly parallel database operations in DSS environments. The inherent divide and conquer approach of distributing data over many nodes proportionally reduces the amount of work each node must do and thus has the potential for near linear scalability.Column Based Physical Storage
Relational tables can be physically stored on disk in a row oriented fashion, or in a column oriented fashion. In the row oriented option, all columns of each row are stored contiguously on disk. By contrast, the column oriented option stores all the values of each column contiguously on disk. The choice of row store vs. column store may at first glance seem arbitrary, but in fact has profound consequences on the amount of I/O bandwidth, memory bandwidth and CPU requirements necessary for processing various types of queries.Aggressive Data Compression
There are dozens of known techniques for storing data in a manner requiring fewer bytes than the original plain form of the data. The techniques are referred to as data compression algorithms. ParAccel uses several very effective data compression techniques. Compression is beneficial for query processing in that it reduces the amount of data that needs to be read from disk, and the amount of main memory space needed for processing the data. Both of these characteristics lead to query processing efficiencies and cost efficiencies.Low Cost Servers and Interconnects
The ParAccel software does not require expensive proprietary hardware. Shared nothing clusters of small and low cost systems can provide adequate memory for aggressively compressed database engines to achieve performance levels far above the levels achievable by conventional database engines. In addition, the software does not require expensive special networking infrastructure but instead provides excellent performance just running on standard GbE equipment.
See Also
-
Sun Fire X4540 TPC-H Executive Summary Report Acrobat PDF (402K)
-
Complete Sun Fire X4540 TPC-H Full Disclosure Report Acrobat PDF (819K)
Disclosure Statement
TPC-H@30000GB Sun Fire X4540 1,050,566 QphH@30000GB, $2.86/QphH@30000GB, availability 6/21/09. TPC-H, HP Integrity Superdome, 150,960 QphH @30000GB, $46.69 / QphH @30000GB, availability 06/18/07, QphH, $/QphH tm of Transaction Processing Performance Council (TPC). More info www.tpc.org.