Friday May 29, 2009
Another SPECtacular award from the SPEC
annual meeting: John
Henning of Sun Microsystems is
secretary of the Open Systems Group steering committee. John has been
the driving force behind improvements to our policy
document. This is crucial to efficient operation of the
organization, especially as so many new organizations have joined
SPEC and so many new participants have joined into the work even from
long time SPEC member companies. John is also the one who reminds all
of us to pause in our lecturing and really listen to our adversaries,
the dissident minority voice. Sometimes they have a point that is
valuable to the task at hand, if we only recognize it, and thereby harness all of the energy and creativity of the group.
Thursday May 28, 2009
Another SPECtacular award from the SPEC annual meeting: David Morse (Dell) served as vice-chair and now chair of the Open Systems Group steering committee, his effective organization and leadership of a rather fractious bunch, with successful release of many benchmarks, and formalization of rules and
procedures to put everyone on an even footing with the "good old boys" and reduce risk and uncertainty in members' use of the benchmarks. Another example of his dedication is his implementation of bookmarkable search extensions to benchmark result queries on spec.org. David is equally comfortable and competent in the most complicated leadership roles and in the most difficult and detailed technical roles.
Wednesday May 27, 2009
Another
SPECtacular award from the SPEC annual meeting: Paula Smith
(VMware) was honored for her
tireless, competent and patient work managing the SPEC office and the
people there. Paula consistently exhibits what make SPEC an unique
place. The attention and enthusiasm she brings to her volunteer work
make her a pleasure to interact with. She goes above and beyond in
everything she does, and is often able to turn emergencies into
opportunities. Most impressive is how she maintains this over time
and in every interaction, despite many competing pressures for her
attention. Beyond this management work, she also manages to handle
the organizational and technical work of chairing the Virtualization
committee, and of course her day job at VMware.
Tuesday May 26, 2009
Another SPECtacular award from the
SPEC annual meeting: Cloyce Spradling (Sun
Microsystems) was honored for continued timely support of SPEC
CPU, HPG and editorial tools. The key factor is his timeliness, in
that he responds to unplanned, asynchronous requests, if not with a
solution then at least with a map to help people find their way out
of the woods. And that's on top of his day job at Sun.
Friday May 22, 2009
More 2009
SPECtacular awards. The SPECpower committee has been busy. They
released version 1.10 of
the SPECpower_ssj2008 benchmark as a no-cost upgrade to existing
licensees. It adds support for measurement of multi-node (blade)
servers, improves usability, and adds a graphical display of power
data during benchmark execution. Review and publication of benchmark
results continues apace, with a spirited competition for first place,
and with ever more power
analyzers accepted for testing, and more test labs qualified for
independent publication. They have also been assisting several other
benchmark committees inside SPEC, and other industry
standard benchmark organizations, to implement energy measurement for
their benchmarks. SPECpower is more than just a benchmark; it is a
methodology,
and the methodology is modified and expanded as necessary over time
to accommodate energy measurements for all the different workloads
which are relevant to the real world in those market segments. In
alphabetical order SPEC recognizes:
-
Chris
Boire (Sun
Microsystems) – As release manager he coordinated and
integrated development activities to keep the deliverables on
schedule.
-
David
Schmidt (HP)
– He created stand-alone and network integrated tools for
automated results checking to help insure that results submissions
are correct and complete.
-
Greg Darnell (Dell)
– Author of the PTDaemon, he helped many other groups get started
measuring power for their benchmarks. He helps out with whatever
needs to be done, technical or organizational.
-
Hansfried
Block (Fujitsu
Technology Solutions) - He automated the process of determining
power analyzer precision, handled the acceptance of several new
power analyzers, and was instrumental in getting multi-channel
analyzers accepted.
-
Harry
Li (Intel)
– He was primary developer of the Visual Activity Monitor, giving
an unique view of the system's activity.
-
Jeremy
Arnold (IBM)
– If I tried to recount all the accomplishments Jeremy was cited
for I'd probably run into some internal blog size limit. Suffice it
to say he is a primary developer on many parts of the code, who
never turns down a plea for help, and who is never satisfied until
the entire benchmark package is right.
-
Karl
Huppler (IBM)
– As primary author/editor of the Power and Performance
Methodology, he organized the document to capture deep technical
consensus in the committee, and made it readable and understandable
for people new to the field.
-
Matthew
Galloway (HP)
– He designed the control software to drive multiple JVMs,
enabling multi node (blade) testing.
-
An engineer (AMD)
– Who created and maintained much of the web content explaining
the benchmark and methodology to the public.
Thursday May 14, 2009
More 2009 SPECtacular awards. SPEC's
forthcoming virtualization
benchmark will provide meaningful metrics of hardware and
software performance in data center consolidation. As complex as this
benchmark is, running several different benchmarks together in
virtual machines on a host system under test, the code is only half
the story. As with all benchmarks the workload is vital, to represent
realistic usage scenario(s) so that performance improvements made on
the benchmark will also benefit real world users. And the run rules
are vital, needing to accommodate technology improvements over the
lifetime of the benchmark, while precluding unrepresentative
optimizations exploiting rule loopholes. (Or what the layman might
call “cheating”) There is spirited debate from companies
representing rather diverse user communities, all with an interest in
seeing that their customers' needs are addressed by the benchmark. In
the end when this group of top engineers reaches a consensus you know
they've come up with a benchmark that is as rock solid as is possible
to make. From among this great
team of partners and competitors, three were singled out for
SPECtacular awards:
Andrew
Bond of HP always steps forward when
a person is needed to test new code, features, parameter tuning. He
performed many experiments whose results showed the committee the
sensitivity of the benchmark to various parameters, sizes, and
configuration options, so that the right choices could be made for
fair benchmark comparisons. He also created scripts to set up and
configure new guest VMs for each workload.
Chris
Floyd of IBM improved and tailored
the mail server and application server workloads for the new
benchmark. He's revamped these workloads several times to improve
the I/O profiles and add burstiness to the application server
transaction injection. He helps the other developers at regular
on-line coding sessions, explaining new features, and resolving
problems. He even helps out when on vacation.
Greg
Kopczynski of VMware
developed a (necessarily) complex and feature extensive
harness for the benchmark. He responds to countless pleas for help,
assistance, debugging, etc., in true SPEC fashion without asking
whether the help is for a partner or a competitor. He added
burstiness to the web server workload. And he integrates new code and
changes from all the developers for each development kit revision.
Thanks for your great efforts!
Wednesday May 13, 2009
More 2009
SPECtacular awards. Sometimes even success doesn't succeed, at first.
SPEC developed a workstation
energy consumption benchmark, and a lot of people worked extra
hard to deliver it in time for EPA to consider using it in the Energy
Star program which is being extended beyond PC's to also include
workstations, servers, thin clients, and storage. Although EPA
decided not to use our test for the workstation program at this time,
the work is still important and I am confident it will be used in
some way. A graphics processor can easily use
more energy than a CPU, especially a high performance accelerated
3D processor. For their exceptional work in producing this benchmark
I thank David Reiner of AMD,
Joerg Grosshennig of Fujitsu
Technology Solutions, Paul Besl of Intel,
and an engineer from NVIDIA.
Tuesday May 12, 2009
More 2009 SPECtacular awards. SPEC
released an update to our MPI2007
benchmark of Message Passing
Interface performance. It allows evaluation of MPI-parallel,
floating point, compute intensive performance across a wide range of
cluster and SMP hardware. MPI2007 continues the SPEC tradition of
giving HPC users the most objective and representative benchmark
suite for measuring the performance of SMP (shared memory
multi-processor) systems. The update, provided at no cost to existing
MPI2007 licensees, improved compatibility, stability, documentation
and ease of use. SPEC gave awards to:
-
Brian Whitney of Sun
Microsystems for meticulous care as release manager in
scheduling, and putting it all together,
-
Carl Ponder of IBM
for the development and management of documentation, especially with
respect to the run rules, FAQ, and the configuration file.
-
Håkon Bugge of Platform
Computing for outstanding testing skills during the benchmark
development.
Monday May 11, 2009
At SPEC's 2009 annual meeting, awards
were given for SPECtacular contributions.
When your competitors and partners alike join to honor one of your
own it indicates that person has truly excelled. There are 77 member
organizations in SPEC including hardware vendors, software vendors,
universities, government agencies, and more. We are joined by a
common belief that the industry as a whole is well served by a common
base of reliable and representative measures of computer system
performance and energy. Thereby our companies benefit from more
effective test results at lower cost. And for academia, the SPEC
benchmarks provide a common reference point from which to begin
performance and energy related studies.
It takes a lot of
hard work to produce these benefits. Each year the individuals who
are recognized by their peers as having done the most to advance
SPEC's mission are singled out for awards. And now I have the
pleasure of thanking these exceptional people publicly. I won't list
everyone since some people don't want their names posted; but you
know who you are.
I'll start today
by thanking Michael Abbott of Apple
who carried the brunt of the new profile and code changes to the
SPECmail2009 benchmark,
and contributed invaluable insight and analysis on message
characteristics to improve the representativeness of the benchmark.
SPECmail2009 simulates corporate mail server workloads ranging from
250 to 10,000 or more users, using industry standard SMTP, IMAP4, SSL
v3.0, and TLS 1.0 protocols. Folder and message MIME structures
accomodate traditional office documents and a variety of rich media
content.
The SPECtacular award winners like Michael are making
a positive difference in the industry, and so I say thank you! (More
award winners coming...)
|
|
|
|
Walter,
Does the engineer from AMD wish to remai...
The AMD engineer hasn't said that it's okay to pos...