Taylor's Take on Sun Storage

HP's Upline goes Offline

HP Upline is HP's new SaaS offering for online storage, backup and data migration services - from HP's recent acquisition of Opelin.  They offer "unlimited storage" for $299 for year 1 or $599 for 2 years.

Unfortunately HP Upline crashed just a few days after it was launched.   To be fair, this stuff isn't always easy - we had several obstacles to overcome with our own SaaS compute service.

However, HP probably didn't count on an active EMC blogger as an early adopter (openness has its pros and cons).  EMC's Storagezilla posted a blog with HP's notice to customers about the crash.   EMC's own SaaS storage service, Mozy, wasted no time on capitalizing on HP's crash in true EMC fashion - launching a Google text ad titled "Shafted by Upline?" and "Is Upline jerking you around?"

Another significant point Mr. Zilla points out is that the current SaaS leader, Amazon Web Services' (AWS) total revenue for 2007 was $100M.  

Bottom line:  The market and storage industry is adopting SaaS - but the market is still new and emerging.  Like most trends, SaaS won't take over the world - but the datacenter mix will change, evolve over time.   And while simple backup technologies and strategies are not as sexy as new trends like Web 2.0 or SaaS - a simple backup strategy will still have its place in the new world. 

Posted at 02:12PM Apr 23, 2008 by Taylor Allis in Storage Intelligence  |  Comments[2]

Web 2.0 Needs Good Backup Too

To backup or not to backup, that is the question; Whether 'tis nobler in the mind to suffer the slings and arrows of outrageous downtimes, Or to protect data against a sea of troubles, and by opposing, end them...

Five years ago I was managing StorageTek's Advanced Technology Research department in RD&E (we were the "R").  One of our research probes was "Grid Storage."  At the time we used Grid Storage to describe an emerging storage architecture.  We also researched "Utility Storage" - or paying for only the storage you use as a type of service.   Even at StorageTek, where tape was king, we were talking about how "Grid Storage" could get rid of backups forever!  Imagine, multiple cheap nodes on the network, data striped across all of them - a whole section of the "Grid" goes down and you have redundancy across other sections. 

No more need for data backup and all the admin/management pains that go with it...

Today we have new innovations on the service and infrastructure side.   When talking about SaaS, I have used Amazon S3 as a prime example.  EMC just entered this space with their announcement of an online backup service available through EMC Fortress - their storage service infrastructure/platform.  On the infrastructure side, companies (and, more importantly, end users) are building grid-like enterprise storage nodes with volume components and clustered/parallel/virtualized file systems.  Sun is one vendor leading the charge here.  And Web 2.0 companies have emerged as the primary consumers and developers of these systems. 

But for some Web 2.0 companies good backup (and backup practices) is an afterthought.   Afterall, start ups can't afford enterprise protection practices like hot replication.  Oftentimes they have to restore data from backups during a crash or outage - but if their processes are not up to snuff, or their backup/restore system is faulty - they succumb to longer outages and lost data.  Bottom line - the utopia of "Grid Storage" is not here yet so having a good backup and recovery plan in place should be a necessity for Web 2.0 companies too...

NOTE:  While I am using some public examples below, I do need to note a couple of important items:

• First, these companies should be commended for being open w/ their users.  There is something to be said for flat out honesty, and I couldn't link to these examples if these companies weren't honest and open.
• Second, these companies most likely implemented very high quality storage systems with advanced RAID protection - even the best systems fail.  (The odds are against 3 drives failing simultaneously, but unfortunately, it happens) 
  
• The point it that these were GOOD systems that failed - so even advanced systems need some sort of backup...
  

There have been several outages in some social networking/photo sharing sites of late.  PBase as a great example.   Read about their outage here.  Below is an excerpt from their IT dept to their end users on PBase's discussion forum: 

"On Saturday, we lost 3 disks simultaneously in our main storage system which runs on NetApp hardware. This caused an 8 Terabyte volume to have some inconsistencies which have to be analyed and repaired before we can put the volume back online. ... I wish the recovery process could have gone faster, but after a problem with the filesystem, it's important to analyze it carefully so we can be sure everything is healthy."

Digital Photography Review (dpreview.com) posts an update about its recent outage:

"On January 18th 2008 we had a multiple disk RAID failure...The forums are now back up and running again. There are three caveats: firstly that messages posted before 1st January 2008 are still restoring, secondly that it appears that messages posted in the last five days have been lost and that search is disabled..."

Now, let's say as a Web 2.0 company you choose to go with a storage service (SaaS) rather than an internal system.  Most notably, SmugMug uses Amazon S3 for this.  This is a viable option, and while I am a fan of Amazon S3, users need to read Amazon's Terms & Conditions first.  Here is an excerpt from Amazon S3's T&C (bold sections mine for emphasis): 

"7.1. Downtime and Service Suspensions.  In addition to our rights to terminate or suspend Services to you as described in Section 3 above, you acknowledge that: (i) your access to and use of the Services may be suspended for the duration of any unanticipated or unscheduled downtime or unavailability of any portion or all of the Services for any reason, including as a result of power outages, system failures or other interruptions; and (ii) we shall also be entitled, without any liability to you, to suspend access to any portion or all of the Services at any time, on a Service-wide basis: (a) for scheduled downtime to permit us to conduct maintenance or make modifications to any Service; (b) in the event of a denial of service attack or other attack on the Service or other event that we determine, in our sole discretion, may create a risk to the applicable Service, to you or to any of our other customers if the Service were not suspended; or (c) in the event that we determine that any Service is prohibited by law or we otherwise determine that it is necessary or prudent to do so for legal or regulatory reasons (collectively, "Service Suspensions"). Without limitation to Section 11.5, we shall have no liability whatsoever for any damage, liabilities, losses (including any loss of data or profits) or any other consequences that you may incur as a result of any Service Suspension."

So outsourcing storage may be a great option for a lot of companies - but there is also risk here...

Ay, there's the rub...

To backup is clearly the answer - it was years ago, it still is today.  But the rub is this: the time investment and cost between a poor backup process/system and a good one is probably minimal. 

Let me repeat that:  the time investment and cost between a poor backup process/system and a good one is probably minimal.      

I've been doing stuff in storage and IT for 14 years now, and I know that a basic, thought-out data protection plan will give you one of the best returns on investment in IT.  Odds are that every Web 2.0 company has some type of data protection practice in place - but it may be ill defined or largely neglected in lieu of the million other things going on there.   But a little time investment will go a long way in keeping customers confident that they can rely on you safeguarding their data. 

And, if you need to know how to pull together a good backup or data protection plan, Sun StorageTek Service Plans are a good place to start...

Posted at 02:58PM Jan 29, 2008 by Taylor Allis in Storage Intelligence  |  Comments[1]

Storage Trends Take 2: IDC's 2008 Storage Predictions

IDC recently released their 2008 Top 10 Storage Predictions (Doc #209796, Worldwide Storage 2008 Top 10 Predictions: New Paradigms.)  In my previous post I listed our Top 10 predictions, let's look at IDC's take... 

IDC's 2008 Storage Predictions:

1.  Storage as a Service (SaaS): See our Trend #10, looks like this may be the year for SaaS.  The best thing that SaaS does is this:  It lowers the barrier of entry for start ups.  Want a perfect example?  SmugMug.com stores approx. 205,000,000 photos for its customers using Amazon S3 and estimates they will save around $2M in storage costs just this year.

2. Role-based Storage Systems:   I had to read deeper into the report to see what IDC is talking about here.  Their summary describes it as storage solutions that will target a specific issue (backup/restore, archive, etc.) and one that will leverage "standard server architectures" and add value through "advanced software."   Hmmm, sounds an awful lot like Sun's Open Storage Platform (see trend #1) - Standard server architecture: check.  Advanced software features: ZFS? - check.  Role-based: well, add VTL software to Sun's X4500 and you have a backup/restore device, add IPconfigure software and you have a Digital Video Recorder (DVR), add Greenplum software and you have a Data Warehouse application - check! 

3. Object-based Storage Systems:   See our trend #7.   IDC makes an excellent distinction in their report that I must highlight...a lot of storage applications classify data (moving it to the appropriate storage tier) by looking at data workloads.  But several different types of workloads can be used by a single application.  The type of data + the application it is tied to may be a better way to classify it. 

4. Solid-State Disk (SSD):  See our trend #9.  IDC states that SSD will enter into the data center as storage tier 0 and I agree.  Flash promoters and disk vendors are already starting to pull up benchmarks against each other, but an integrated approach will probably prevail.  For a fun SSD RAID implementation see the "Battleship Mtron."  StorageMojo has a balanced take on SSD.          

5. Virtual Servers (e.g. VMware) will be killer app for iSCSI:  IDC predicts that just under half of virtualized servers connected to SANs will be connected to iSCSI.  They state that manufactures selling iSCSI systems will find the servers they are connected to will be running server virtualization.  (As virtual server admins are more comfortable with IP & Ethernet technology).  

6. Value-Added Storage Services Will Begin to Be Divorced from Storage Subsystems, Resulting in Further Commoditization of Storage Subsystems:  Quite a mouthful - but if you want an example, check out Sun's ZFS and its point-in-time-copy, volume management, administration, Copy-on-write and RAID Storage Services!  

7.  Disk Encryption: See our trend #5.  We did it for tape, disk is a logical next step.  Key Management continues to be the key part of encryption solutions, whether they are tape or disk based...

8. Vendors Will Create More Attractive "All In One" Solutions Using an Integrated Storage and Server Approach:   Look no further than the SunFire X4500 (aka "Thumper")

9.  "Green" Initiatives Will Spark Some Hardware Refreshes:  IDC predicts that Eco messaging will evolve to vendors helping users connect business practices to green storage, as well as IT focusing on how to address the environmental impacts of manufacturing and disposing of older storage equipment. 

10.  De-Dup, VTL & Thin Provisioning become standard options:  See our #3 and #4 trends.   What were emerging technologies in 2007, will become "rights to play" in 2008...

Posted at 02:46PM Jan 09, 2008 by Taylor Allis in Storage Intelligence  |  Comments[0]