White Paper: Best Practices for Architecting a Lustre-Based Storage Environment

In this white paper by Data Direct Networks, you'll learn best practices for architecting a Lustre-based storage environment. While many approaches can be taken to building up a Lustre environment, it is important to be aware of the trade-offs associated with various design decisions. Full Story

Sun Rolls Out Storage & Archive Solution for HPC

The new Sun Storage and Archive Solution for HPC enables you to manage the balance between high-performance access to your data when needed and cost effective, lower-performance storage for large amounts of data over the long term. Built with an architecture that supports multiple storage tiers, the solution provides high-performance storage for current use, bulk disk storage for low-performance needs, and long-term storage on power-efficient tape for data requiring only occasional access. Data movement or migration is managed through anautomated policy engine to help ensure that the right data is in the right place at the right time.

What makes this offering unique is that it's a complete storage solution for HPC requirements:

"That's really its strength," said Chris Wood, CTO of Sun Data Storage. "It's not a just a NAS filer, it's not a tape drive, it's not a box--it's a complete solution that addresses the very specific data types you run into in an HPC environment. And not to forget, Sun recently has brought into its family the Lustre file system, a very, very high performance scratch file system for HPC. We of course are seamlessly integrated with Lustre, so you can use them both. And what you get out of that is the multiple-petabyte scratch capability of Lustre, with the complete, system-managed, multi-tiered archive of the SAM-QFS side of the house, with the seamless ability to move the data between the two at extraordinarily high bandwidth." Full Story.

Transforming Big Data

In this HPC Wire story, John E. West writes that the dramatic growth in data we humans collect needs better data-intensive computing schemes:

"As Grosh pointed out, the shift that is needed goes to the core of system design. Disk vendors have largely focused on capacity rather than bandwidth, and many supercomputing applications avoid I/O as much as possible. In data intensive applications, this view is turned on its head: it's all about moving stored data in for processing, and pushing transformed data out. According to Grosh, NVRAM technology may be very important on the hardware front in the future of data intensive supercomputing. It offers an architecturally "clean slate" that doesn't carry any of the design culture of disk storage along with it, and it may be able to fill the gap between DRAM and disk with respect to both price per capacity and access speed." Full Story.

New Whitepapers: Lustre Storage Architecture and Networking

Two recent publications provide information on several aspects of the Lustre File System. These sun.com papers cover basic information about Lustre architecture, networking, high availability, and comparison with other shared/cluster file systems:

Lustre File System: High-Performance Storage Architecture and Scalable Cluster File System
Scalability is one of Lustre's most attractive attributes, offering as it does, the ability for users to deploy a Lustre file system as a general-purpose, datacenter back-end file system at a variety of sites, from Internet service providers (ISPs) to large financial institutions. Enhancements to wide area support scheduled for imminent release in Lustre networking (LNET) and storage software, should make these market segments even more important.

Lustre Networking White Paper
This paper provides information about Lustre networking that can be used to plan cluster file system deployments for optimal performance and scalability. The paper includes information on Lustre message passing, Lustre Network Drivers,and routing in Lustre networks, and describes how these features can be used to improve cluster storage management. The final section of this paper describes new Lustre networking features that are currently under consideration or planned for future release.

Top 10 storage predictions for 2008

IT managers looking to boost storage efficiency next year will embrace online storage services, push de-duplication in the data center and adopt solid-state disk drives to help fuel hardware consolidation strategies and green initiatives, according to IDC's top 10 storage predictions for 2008.

"The top 10 storage industry predictions by the Framingham, Mass.-based market research company expected to arrive in 2008 include:

1. Storage services models for data backup, archiving and replication will be more appealing to businesses.
2. New role-based storage systems will demand tighter integration between the storage layer and content-generating applications.
3. Vendors will build object-based storage systems to classify data and add policies closer to the point of creation.
4. Falling prices of solid-state disk drives will push mainstream adoption.
5. Virtual servers will become an ideal conduit for iSCSI.
6. Value-added storage services will become nontethered from storage infrastructure.
7. Full-disk encryption will be prevalent in the data center to satisfy compliance and safe harbor provision rules.
8. Offerings designed for small and midsize businesses featuring integrated storage and server technology will flood the storage market.
9. Green storage initiatives will cause companies to seek nondisruptive/partial hardware upgrades.
10. De-duplication, thin provisioning and virtual tape libraries will be in demand because of power saving efforts in the data center." Full Story

Clustered storage: a paradigm shift

According to Continuity Central, the need for clustered storage systems continues to grow across multiple vertical markets and industries:

"Indeed, as more companies turn to clustered computing for their IT needs, clustered storage has become an extremely attractive solution to complement their computational infrastructures, enhancing data collection and analysis to deliver better business results." Full Story

Petabyte of Angels on the Head of a Pin

A team of UCLA and California Institute of Technology chemists reports in the Jan. 25 issue of the journal Nature the successful demonstration of a large-scale, "ultra-dense" memory device that stores information using reconfigurable molecular switches. This research represents an important step toward the creation of molecular computers that are much smaller and could be more powerful than today's silicon-based computers.

"In 1959, physicist Richard Feynman said it should be possible some day to store all of the Encyclopedia Britannica on the tip of a needle," noted UCLA's J. Fraser Stoddart. "We're not there yet, but we're not far off." Full Story