Cloud Optimized Storage: Atmos

In 1969 during the original Star Trek TV show, The Cloud Minders episode featured Statos, a city in the clouds. Today, EMC launches Atmos, cloud optimized storage. This is not science fiction, but the realization of much work on managing very large amounts of data “in the cloud.” Having been in the hands of customers since early Summer, this offering is intended to manage massive amounts of Internet-based information. How massive? Petabytes to begin with.

Forecast: Cloudy?

“Cloud computing” is a very popular topic right now, and there is often more heat than light shed on the subject. EMC releases Atmos at a time when many others are still debating over cloud computing and arguing whether it is or is not grid computing, software as a service, outsourcing, or Web 2.0-based data.

The Atmos sphere

What does Atmos encompass? First, it is different than simply block-based Storage Area Networks (SAN), file-based Network Accessed Storage (NAS), or even object-based Content Addressed Storage (CAS). EMC introduced CAS in the Spring of 2002 with the launch of Centera, part of an object-based archiving and compliance solution. As revolutionary as this was half a decade ago, so too is COS today.

  • Massive Scalability

Global manageability through a namespace, regardless of geographical location. Multi-tenancy means that different tenants could store their unique information objects in their own private namespace under the Atmos namespace.

  • Policy Based Information Management

Information can be managed by policy, and automatically acted upon by business rules for the metadata that defines the policy. For example, if an object conforms to a policy of “popular”, it could be replicated appropriately to deliver better service levels to users. When demand drops off and it becomes less “popular” the number of copies could be automatically pruned.

  • Operational Efficiency

Whether it’s a drive, server, or network — all of this can be seen and managed from a single console.

 

There are many excellent articles available already that explain this in greater detail. Check out Chuck Hollis at Chuck’s Blog, Mark Twomey at Storagezilla, Steve Todd at Information Playground, Dave Spencer at Dave Talks Shop, Dave Graham at Dave Graham’s Weblog, and Len Devanna’s summary.

Thanks for coming along.

BillPetro.com

Share this:
  • Print this article!
  • E-mail this story to a friend!
  • StumbleUpon
  • Digg
  • del.icio.us
  • Technorati
  • Facebook
  • TwitThis

Information Reformation

I wrote the following article about a dozen years ago when I was a technology evangelist at Sun. Back in the mid-’90s, we were experienced the early part of the first wave of “The Web.” Today, with the advent of Web 2.0 technologies we’re seeing an explosion in different dimensions. Wikis, social networking, mass collaboration, blogging, and Instant Messaging have expanded what was largely a “reader oriented” phenomenon into a dynamic read-write participatory platform. While the mantle of managing information has passed to a new generation of companies like EMC, the basic principles about information production and exponential growth remain the same.

barilan_internet_thumb.jpgINFORMATION REFORMATION

Every October 31, we observe the anniversary of the German Reformation. Presently, there is a lot of talk about the Internet Explosion. There are several significant similarities between the two.
Indeed, one could call it the “Information Reformation.”

HIGHLIGHTS:

1) Common Language:

  • Luther made previously exclusive information accessible to the common man by publishing in the common language (German), not the language of scholars (Latin).
  • With the aid of graphical tools like Mosaic, Netscape or the HotJava browsers (a Java-based browser from Sun), anyone can easily read the Internet and discover new information without knowing classical Geek.

2) Common Format:

  • Luther published pamphlets, extending the existing single page “broadside” to multiple pages in quarto and octavo sizes. He featured pictures using the finest woodcuts and engravings of the times.
  • Graphical Web browsers that take advantage of open, standard HTML make information pictorial and, with advanced Java capabilities, dynamic, and multimedia.

3) Mass Distribution:

  • Luther’s 95 Theses, with the aid of the movable type printing press invented a few decades before his birth, were distributed to the masses. Within two weeks, it had spread throughout Germany. Within a month, it was all over Europe. By the end of the year, it had spread beyond the Holy Roman Empire.
  • With the availability of interconnected computer networks, like those offered by Sun, information is quickly distributed all over the World Wide Web.

4) Unprecedented Growth:

  • Between 1517 and 1523, publications in Germany increased 7 times. Half were Luther’s writings.
  • The growth of the Internet and the availability of information on the Web has grown phenomenally, with a growth curve that appears almost biological.

5) Broadcast Marketing

  • Luther took advantage of the new printing press to “evangelize” his views on theology and detract from his competitors with his pamphlets.
  • Many companies, organizations, and individuals now take advantage of Internet home pages to “market” and promote their product, offerings, and views.

BACKGROUND:

In the 16th century, as a result of a dispute concerning certain Church practices, a German University professor posted a call for debate on their equivalent of a bulletin board, the door of the Castle Church. These 95 Theses were not intended as a call to reformation but a quiet, scholarly discussion of theological issues.

So it was, on October 31, 1517, that this 33 year old Augustinian monk named Martin Luther nailed the 95 Theses on the Wittenberg Door, marking what historians conveniently use as a coat hanger for the beginning of the Reformation.

But it was two significant things that changed history: first, one of Luther’s students took the original Latin 95 Theses and translated them into German, the language of the common man. Now they were available to anyone who could read.

Secondly, with the aid of the movable type printing press, invented not far away in Maintz by Gutenberg toward the end of the previous century, copies were distributed to the masses. It became a veritable manifesto for change.

Thus it is with the spread of the Internet. So one could say we’re currently experiencing more than an Internet Explosion or Revolution, but an Information Reformation.

Bill Petro, your friendly neighborhood historian
www.billpetro.com

© Bill Petro - visit the author for more great content.

Share this:
  • Print this article!
  • E-mail this story to a friend!
  • StumbleUpon
  • Digg
  • del.icio.us
  • Technorati
  • Facebook
  • TwitThis

CLARiiON co-stars in Body of Lies

Last week I saw the new Ridley Scott spy thriller Body of Lies. Scott has made a number of movies in recent years starring Academy Award winner Russell Crowe, including Gladiator, A Good Year, and American Gangster. In this film Crowe co-stars with Leonardo DiCaprio, and additional co-stars who are even more flashy.

EMC loaned Warner Brothers six Symmetrix DMX-3 and nine CLARiiON systems. These were featured in a particularly intense negotiation scene in the film, situated in the US Embassy in Amman, Jordan. The arrays were originally configured to be be fully working, but proved to be too loud for the sound man on the set. So instead, the systems were “powered” with LEDs behind their bezels to light up the display and drop lights to illuminate the fronts. Ridley Scott liked to look of the EMC systems and in the scene above, during a very tense phone conversation you can see the colorful systems, the co-stars behind the stars.

BillPetro.com

Share this:
  • Print this article!
  • E-mail this story to a friend!
  • StumbleUpon
  • Digg
  • del.icio.us
  • Technorati
  • Facebook
  • TwitThis

Information Growing Exponentially

Exponential GrowthWhy Info Exponential? Because information is growing faster right now than it ever has in history.

Much of it is coming from so called “end users” like you and me. IDC estimates 70% will come from individual creation by 2010. Personally, I create a data wake, or digital footprint of about 10 gigabytes a day — including all my emails, digital photos, TV DVR recordings, cell phone usage, Internet use and “click stream”, even pictures of me by airport surveillance cameras. That can add up. How fast? This counter below shows how much information I’ve created directly or indirectly since the beginning of the year:

But this is just me. Consider the wider population and their contribution to the “digital shadow.” What if you add all of them up? IDC calculated that in 2007 the digital shadow was about 281 exabytes or 281 billion gigabytes. This counter shows the current results:

Would you like to calculate your digital shadow? Check out the personal digital footprint calculator at EMC’s website here.

But this growth is not just incremental, it’s accelerating. There is a group of people who Gartner Research calls “Generation Virtual.” Unlike previous generations, who are usually defined by age, Generation V, regardless of:

gender, social demographic or geography … demonstrated achievement, accomplishments and an increasing preference for the use of digital media channels to discover information, build knowledge and share insights.

This generation is growing, and changing. My own use, consumption, and generation of information has changed, even over the last few years.

2003I recall a research project conducted at the University of California, Berkeley and sponsored by EMC Corporation — just five years ago — that concluded the following:

  • The amount of new information stored on paper, film, optical and magnetic media reached about five exabytes - or 5 million terabytes - in 2002, compared to about half that in 1999.
  • Some 92 percent of new information is stored on magnetic media, primarily hard drives.
  • New information flowing electronically on radio, television and the Internet in 2002 totaled nearly 18 exabytes.
  • The phone accounts for the largest percentage of information flow, with e-mail placing second.
  • While original information on paper continues to grow, most comes in the form of office documents and mail - not books, newspapers and journals.
  • Worldwide production of books increased by 2 percent in the last year.
  • Production of newspapers in the last year decreased by 2 percent.
  • The United States produces 35 percent of all print material, 40 percent of the images and more than half of the digitally stored material.
  • Peer-to-peer file sharing has exploded, and MP3 music files and digital video accounted for 70 percent of the files on the hard disks of users who participate in online file exchanges.
  • Globally, the average Internet user spends 11.5 hours online per month, but the average Internet user in the United States spends more than twice that amount.

Remember, this information is 5 years old!

This blog intends to cover subjects that address the phenomenon of exponentially explosive information growth, and EMC’s leadership role in addressing it.

Welcome aboard, and fasten your seat belt low and tight across your lap.

BillPetro.com

 


 

 

Share this:
  • Print this article!
  • E-mail this story to a friend!
  • StumbleUpon
  • Digg
  • del.icio.us
  • Technorati
  • Facebook
  • TwitThis

Eagle Eye on EMC DMX

EMC on the Set of This weekend, I saw producer Steven Spielberg’s latest #1 blockbuster Eagle Eye. In a particularly exciting scene, the cameras flashed to the front of a some impressive looking information processing equipment. When they needed equipment to represent the super-computer named ARIA, they used EMC’s DMX arrays. The “Direct Matrix” Symmetrix storage systems are indeed the most powerful platforms one would think of, and an outstanding visual selection for the movie as well. As you can see along the left wall in the picture, they have a next generation look that fits in well with the sophistication of the set used to represent the super-computer complex.

In the movie, ARIA is located far below the Pentagon and contains a phenomenal amount of surveillance information. What better platform than the DMX to store, manage and protect this information? So, how much information storage are we talking about? If these DMX arrays were filled and powered on, they would represent multiple petabytes of information. What’s a petabyte? If we put it in perspective, according to Wikipedia:

  • The Internet Archive contains almost 2 petabytes of data.
  • Google processes about 20 petabytes of data a day
  • The 4 experiments in the Large Hadron Collider will produce about 15 petabytes of data per year, which will be distributed over the LHC Computing Grid
  • 88 petabytes is the storage capacity of Star Trek’s android “Data”

The movie production company got 30 DMX arrays which were lifted by crane into the massive set, situated inside large airplane hangers that once housed Howard Hughes’ airplane The Spruce Goose in Playa Vista, Southern California. You can see all the photos on Flickr here.

Eagle Eye (2008) PosterEagle Eye is a dramatic techno-thriller that opened in late September as a standard film as well as an IMAX movie. And, as the subject of the movie is concerned with mobile devices, there is a mobile version of the Eagle Eye: the Mobile Game available on a variety of BlackBerry, Windows Mobile, and Java powered devices.

BillPetro.com

Share this:
  • Print this article!
  • E-mail this story to a friend!
  • StumbleUpon
  • Digg
  • del.icio.us
  • Technorati
  • Facebook
  • TwitThis

B2D and TiVo

image While giving a talk to a group of sales reps in New York, we were discussing the concepts of Backup to Disk (B2D) and Virtual Tape Libraries (EMC Disk Library). Some of these folks were quite experienced as sales reps, but didn’t quite understand the value proposition of the Disk Library.

At one point, the conversation got around to the Yankees, as I imagine often happens in NYC, and the Sales Manager said,

“Yeah, I’m going to TiVoTM the game tonight so I don’t miss it while I am taking the train home.”

I asked the group, knowingly,

“How many of you use TiVo or other Digital Video Recorders?”

Most of the hands went up.

“Would you ever go back to using VCR tape recording?”

Universal “No’s” came back.

I continued,

“That’s what backing up to disk is all about. You get the benefits of speed, faster seeking, instant playback, etc…”

You could see the lights going on in their eyes.

I love it when that happens.

BillPetro.com



Share this:
  • Print this article!
  • E-mail this story to a friend!
  • StumbleUpon
  • Digg
  • del.icio.us
  • Technorati
  • Facebook
  • TwitThis

VMworld 2008: Day 2 Review - Virtually Anything is Possible

VMWORLD 2008: DAY 2 REVIEW - VIRTUALLY ANYTHING IS POSSIBLE

VMworld is not just a trade show about virtualization, it uses virtual technologies and Web 2.0 technologies in a way I’ve never seen before. Here’s an example:

Blogging:

IMG_0145Not only is blogging encouraged, but it is honored. There is a special set of tables in the keynote auditorium for bloggers to set up their laptops for blogging. Or in my case, I was Twittering about the keynote with my iPhone. Indeed, during yesterday’s keynote with with VMware CEO Paul Maritz, the announcer invited attendees to use Twitter to send in their questions. The person next to me was from Denmark and didn’t understand what I was doing. He had never heard of Twitter, so I sent him to Twitter.com. By the way, my real-time “Tweets” (noun form of Twitter) on this show can be found at this link. Note, they’ll appear in reverse chronological order, most recent at the top.

Podcasting:

IMG_0153John Troyer of VMware, blogger and podcaster extraordinaire, was doing several podcasts live from the Communities Lounge at the Solutions Exchange on the show floor. John is very involved in VMware’s blogger community and end user communities. He has lots of community management experience. Here you see John interviewing user moderators from VMware’s communities. You’ll find John at the VMTN Blog and his podcasts here.

Virtual Pavilion:

MainFloorWhile this is a show about virtualization, there is also a virtual show going on at the same time. Eric Nielsen, VMware’s Director of Web Communities showed me around the virtual, online pavilion.

You can access it directly from the VMworld.com website, or from here. It is a two dimensional virtual world that an attendee can navigate through and visit various rooms.

As an attendee navigates around the Virtual Pavilion he or she can see other attendees, participate in contests and games, gain points for answering questions on multiple choice questions, etc. This virtual navigation system is a 3rd party module for Clearspace, the social networking technology that VMworld.com uses. There are even “Expert Sessions” non-synchronous “events” — talks that you need not be present to hear — where a speaker will provide audio, video, content or a whitepaper which is then attached to a forum. The expert will visit daily for the next two weeks to answer any questions.

restroomThe Virtual Pavilion also features 15 “hidden rooms” where you can find special clues, quiz answers, and secret codes for a free t-shirt at the Communities Lounge. One of these hidden rooms is the Restroom, which itself has a portal to a hidden room.

Eric manages VMworld.com year round. It is active not just during the semi-annual shows, but throughout the year. Various Partners have “booths” here. Can you find the “hidden room” in the Dell booth?

Blogs:

And as I mentioned before, the VMworld.com website features attendee blogs as well, found here.

Thanks for coming along.

BillPetro.com

© Bill Petro - visit the author for more great content.

Share this:
  • Print this article!
  • E-mail this story to a friend!
  • StumbleUpon
  • Digg
  • del.icio.us
  • Technorati
  • Facebook
  • TwitThis

VMworld 2008: a Veritable Verdant Venture (Green)

TIGVMWORLD 2008: A VERITABLE VERDANT VENTURE

“Green, that’s what it’s all about,” Larry says as he shows me the eco bag that TIG is handing out at the VMworld 2008 show. Many of the booths say “Green IT” right on their signs. Virtualization can contribute to Energy Efficient IT in a number of ways, not the least of which is consolidation and containment of servers, thus reducing power requirements, but also the associated savings in data center cooling.

From the initial registration for the conference, there has been an emphasis on Green. During the registration process, there is a discussion of transportation options to Las Vegas and their carbon footprint implications.

Upon arrival, the notebook that attendees received comes with a pen made from recycled cardboard and a wooden clip.

Timbuk2BagIn the VMware Store on premise, there is a Timpuk2 messenger bag for sale. It’s a special limited edition of 75, made from the recycled banners from last year’s VMworld 2007 in San Francisco, available in blue, black, orange and green. The beanies are made from recycled cotton, and the polo shirts from recycled polyester. No new polyesters need give their life to make a new polo shirt.

Thanks for coming along.

BillPetro.com

© Bill Petro - visit the author for more great content.

Share this:
  • Print this article!
  • E-mail this story to a friend!
  • StumbleUpon
  • Digg
  • del.icio.us
  • Technorati
  • Facebook
  • TwitThis

VMworld 2008: Day 1 Keynote

Paul MaritzVMWORLD 2008: DAY 1 KEYNOTE

Following yesterday’s opening event, both the Technology Exchange and Partner Day, the conference started in earnest today with a keynote by Paul Maritz, VMware President and CEO.

Paul is quite an articulate speaker, sounding both like a savvy businessman and an erudite professor. For many, his accent is difficult to place, is it Australian, South African? Turns out he was born in Zimbabwe, next door to South Africa, but he went to school in Cape Town, South Africa. Someone remarked that he pronounces some words like Sean Connery. Paul did work at University of St. Andrews in Scotland. Sean Connery grew up in nearby Edinburgh, Scotland.

Back to the keynote, Paul amplified many of the concepts introduced and announced yesterday, specifically by drawing on the past to explain where VMware is going in the future. I found the history a good review of many of the events I’d witnessed in my own long career with computing, and a fascinating basis for describing where he sees the company going, as well as a foundation for the many announcements this week. How did he do this?

Two Models

He went back to the ’60s and ’70s (mainframes) and outlined the contrast between the Centralized vs. De-centralized models of computing. While he did not say so, the industry has swung between them several times over the last 30 years. He pointed out that we initially saw mainframes in the early days, and the proliferation of PCs in the ’80s. The early ’90s saw the rise of x86 Servers as well as the rise of the Client/Server model.

A Third Alternative

He quipped that it’s ironic that he is now profiting from his previous sins in promoting the Client/Server model, which got us into a world of hurt so that we now seek another path, the best of both the Centralized and the De-centralized models. The advent of the Web in the mid-’90s offered the promise of this. He paid tribute to the founders of VMware, who started the company ten years ago back in 1998.

VMware’s Initial Offerings

He described VMware’s early efforts with both VMware Workstation (on the client, or De-centralized side in 1999) as well as the early VMware Server (GSX, on the Centralized side in 2000.) He pointed out that many other companies are currently virtualizing on the Centralized (server) side, but reminded us that VMware has done both sides, but raised the bar in 2004 with the introduction of VMware Infrastructure, a higher level of abstraction than either Server or Client side virtualization.

Paul pointed out that the “Best of Both” on the Web is now more promising with a variety of new (Web 2.0) technologies like AJAX (Asynchronous JavaScript And XML), Ruby on Rails, and Python. 2007 saw the launch of VMware’s Fusion, virtualization of Windows on the Macintosh and the popularity of Cloud computing.

It’s The Platform

At this point, I reflected that during my career I’d seen software engineers write to whatever the leading “platform” was at the time. In the ’80s it was Unix, and particularly SunOS (Solaris). The virtuous cycle had the platform supporting applications that led to more volume… which made the platform more viable. With the rise in popularity of Windows, it became the platform of choice. In the mid-’90s it was Java, with the promise of “Write Once, Run Anywhere” across a variety of devices. But last year, it became clear to me, especially following VMworld 2007 in San Francisco, that VMware was becoming the “platform”. Both the Press and the Analysts “got it,” and Wall Street saw a huge jump in VMware’s stock price following the ESXi announcement and others.

The New Platform

VDC-OS So, what’s the new “platform”? Paul explained the Virtual Datacenter OS, or VDC-OS. It is a way to support a variety of current popular “platforms” line .Net, Windows, Linux, Java, Software As A Service… with Application vServices that provide Availability, Security, and Scalability. This rests upon Infrastructure vServices called vCompute, vStorage, and vNetwork… as well as Cloud vServices. These in turn live on either the On-premise cloud, or an Off-premise Cloud (for additional resources.) Meanwhile, all of this can be managed by vCenter (the rebranded Virtual Center management framework) which handles both Application Management at the top end and Infrastructure Management at the backend.

To this end, many announcements fit into this new, higher level of abstraction. Once again, VMware raises the bar.

Thanks for coming along,

BillPetro.com

© Bill Petro - visit the author for more great content.

Share this:
  • Print this article!
  • E-mail this story to a friend!
  • StumbleUpon
  • Digg
  • del.icio.us
  • Technorati
  • Facebook
  • TwitThis

VMworld in Vegas

VMworldVMWORLD IN VEGAS

This year’s VMworld, at the Venetian Hotel in Las Vegas September 15-18 looks to be the place where all things virtual will occur. Last year’s event in San Francisco attracted 10,000 attendees, this year’s conference in Las Vegas expects 14,000. The VMworld.com website is using Jive Software’s Clearspace social networking platform — enabling attendees to participate in discussion threads, send and receive private messages, create their schedule online, and even blog from it.

I’ll be blogging from this website daily, as well as Twittering more frequently from the conference about what’s hot from the keynotes and sessions.

Thanks for coming along.

BillPetro.com

© Bill Petro - visit the author for more great content.

Share this:
  • Print this article!
  • E-mail this story to a friend!
  • StumbleUpon
  • Digg
  • del.icio.us
  • Technorati
  • Facebook
  • TwitThis