BM Seer Unofficial thoughts from an anonymous Sun employee

Open Letter to SPEC part Deux: The Cantrill Chronicles

Tuesday Feb 03, 2009

Just saw this this morning, a good writeup on a SPEC benchmark. Bryan Cantrill writes:

    "The result is such a deformed monstrosity that -- like the index case of some horrific new pathogen -- its only remaining utility lies on the autopsy table: by dissecting SPEC SFS and understanding how it has failed, we can seek to understand deeper truths about benchmarks and their failure modes.
For more read: "Eulogy for a benchmark: I come to bury SPEC SFS, not to praise it."
http://blogs.sun.com/bmc/entry/eulogy_for_a_benchmark

Basically I think there are some very good SPEC & TPC benchmarks, but I think there is also some partisanship that needs to be removed to just do the right thing for the industry. See my previous posting for some ideas on good things to do.

I've covered the problems with ageing TPC-C, but maybe I should have used the same language that Bryan used. :)

    Short-stroking 224 15K RPM drives is the equivalent of fueling a dragster with nitromethane -- it is top performance at a price so high as to be useless off the dragstrip.
Does this apply to the system configurations used in SPECpower. hmmmm, looks like the same colour.

[1] Comments
Like this post? del.icio.us | furl | slashdot | technorati | digg
Comments:

Bit of an argument going on here - http://pl.atyp.us/wordpress/?p=1797 in response to bmc's post

Posted by James McPherson on February 04, 2009 at 10:48 PM PST #

Post a Comment:
Comments are closed for this entry.