Saturday June 30, 2007 | The Navel of Narcissus Josh Simons' Coordinates in the Blogosphere |
|
HPC Consortium: Big SMPs in Education
Bernd Dammann, Associate Professor at the Technical University of Denmark, spoke this week at Sun's HPC Consortium meeing in Dresden. The title of his talk was "Using Large SMP machines for research and education -- some experiences from the Technical University of Denmark." As part of his introduction, Bernd mentioned that the University was founded in 1829 by H.C. Orsted. The school was relocated in the 1960s to the site of a former airport, which is evident if you look at the site layout. The University is strong in a number of areas, notably wind turbine design and materials optimization--e.g. how much material can be cut away from a jet to reduce weight while still maintaining safety and structural integrity. Work has also been done on magnetic earth imaging via satellite and we were told that students at the University are very involved in corporate-sponsored eco-vehicle design contests. DTU is a Sun Center of Excellence in interval arithmetic and dynamic systems. The HPC Center at DTU has a large amount of Sun "big iron"--large SMP machines-- around which the Center's computational capabilities are centered. They also have several other Sun hardware models in their machine room. Through a series of acquisitions, DTU now has onsite two Sun Fire E25Ks with 96 and 72 cores, three Sun Fire E6900s with 48 cores each, 10 V440s and a Sun Fire T2000 system. All of their SPARC machines are kept at the same revision of Solaris (currently S10 11/06), which makes the complex easy to maintain and administer with two part-time system administrators. In addition to their central compute infrastructure, DTU has the largest deployment of Sunray thin clients in Scandinavia with over 600 in use. Of these, they use about 24 as part of a "mobile classroom" that can be deployed on short notice in locations for temporary use. Students love the thin clients and appreciate the ability to access their desktop sessions from any Sunray on campus using their smartcards. Bernd made several interesting points with respect to their Sun compute infrastructure. First, the variety of SPARC implementations and system architectures in their compute complex is used to advantage in their High Performance Computing course to expose students to a range of systems. They are also able to explore both OpenMP and MPI on their systems. In addition, because the use this single environment for both education and research, those students who move on to become researchers already have familiarity with the full range of scientific and productivity tools deployed on the HPC compute infrastructure. He summarized the value proposition as follows. They don't have wasted desktop cycles tied up in thick clients. They have lower administration costs, they have consolidated their software licenses onto their central infrastructure. In addition, they can do centralized deployment of software, they can ensure that students do not tamper with configuratons while still allowing them the freedom to install their own software in $HOME and they do not have virus issues. As a drawback, Bernd mentioned that their thin client environment was unfortunately not suitable for supporting heavy OpenGL 3D graphics for their users. After the talk, I introduced Bernd to Linda Fellingham, the engineering manager in charge of Sun's shared and scalable visualization products. As it turns out, Sun has a solution for DTU that will allow them to install an existing, but noisy, high-end graphics workstation in their central machine room and then route 3D graphics output directly to Sunrays in a seamless way. It's a pretty slick software solution (read more here. When I asked Bernd later if he found the Consortium meeting useful, he cited this interaction as an example of how meeting with Sun's engineering and other employees at such meetings is very useful for him. (2007-06-30 04:10:49.0) Permalink Comments [3]
Trackback URL: http://blogs.sun.com/simons/entry/hpc_consortium_big_smps_in
Post a Comment: |
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Posted by Marc on June 30, 2007 at 11:40 AM EDT #
Marc,
I very much appreciate your comment--thanks. I agree that our description on the web page does not do a great job of explaining what the software does and I'm working with our engineering team to try to improve that.
In the case of the Sunray in particular, the software goes beyond the scenario you describe. Putting the graphics hardware in the Sunray server itself is possible, but with possibly hundreds of people using the server, it isn't the best way to do this. With the shared visualization software, we can set things up so that the application runs on the Sunray server, the graphics are rendered on another machine, and the graphics appear seamlessly on the Sunray as if they were generated locally on the Sunray server. In addition, we do an optimization that routes the pixels directly from the rendering node to the Sunray device, bypassing the Sunray server. This avoids the extra hop through the possibly heavily loaded Sunray server. I've seen pretty good frame rates on Sunrays with this approach--it really does work.
If you are interested in talking more about this with me and my colleague Linda who is responsible for this software, drop me a note at joshua dot simons at sun.com. I'd be very interested to get your further perspectives on what we might do to explain this in a more compelling way.
Josh Simons
Posted by Josh Simons on June 30, 2007 at 11:54 AM EDT #
The post you did today on LCN also helped understand what the system is about. I understand that from a user perpective, one cannot see any difference between using a workstation with a very powerful graphics card and using this system, which is great.
My reason for thinking about many graphics cards in a single server is that I have the feeling that in the setups you describe, the processors of the workstations may be under-used (note that I may be completely wrong). As for cases of hundreds of people using simultaneously the same server, well you usually don't use a single server in this case anyway (which reminds me that I have never looked at the possibility to move a session between sunray servers).
I will remember the offer for more information if I manage to get the right people here interested enough. Thanks again.
Posted by Marc on July 01, 2007 at 12:15 PM EDT #