We Liked Data Before it was Big

Posted by George Hamilton | Author Info

Oct 15, 2014 9:00:00 AM

“I liked data before it was big” is a sign hanging on a wall in one of our EMC offices (I scoured my LinkedIn feed to find the picture again to no avail). I love what that sign conveys. Here at EMC, we’ve always been about data; storage is just the means to keep, access, protect and use it. In my mind, EMC does not just tackle storage problems; we solve data management challenges. Big Data is the latest data management challenge. That’s why EMC is so excited to be at Hadoop World to showcase our storage and data management solutions for Big Data.

The quote on the front page of the Strata+Hadoop World web page reads, “Big data is at the foundation of all the megatrends happening today”. Hard to argue with that assessment. I’d only add that storage and data management are the foundation for Big Data. So, by transitive relationship, this means storage and data management are the foundation of all the megatrends happening today. If this sounds like hubris, take a look at what IT decision makers identified as their most important factors when evaluating storage for Big Data ( scale 1-5, 1 = Essential to 5= Unimportant).

Read More

Topics: Software Defined Storage, ViPR, HADOOP, Big Data, Hadoop World, Isilon

Looking Back to Get Ahead Using 'Divide and Conquer'

Posted by Mark A. O'Connell | Author Info

May 12, 2014 9:00:00 AM

While my last blogs encouraged taking advantage of new technologies and not being constrained by 
we've always done things", for this blog I'll emphasize the wisdom that can come from looking backwards.

Divide and conquer is an old strategy that has been applied effectively to many situations and problems. In politics, splitting the opposition, by offering deals that appeal to individual groups or subsets of the opposition, can enable successful policy implementations that would normally have united the opposition and prevented progress. Militarily, victory can be achieved by avoiding an enemy's combined strength, by engaging the enemy repeatedly in smaller battles and whittling down the enemy's fighting capacity.

It is not often that politics, warfare, computing, and storage all intersect, but in this case, leveraging an age old strategy can help us gain insights into today's seem
ingly intractable problems.
Read More


The World Of Storage Has Changed

Posted by Michael Wehle | Author Info

Jan 29, 2014 9:00:00 AM

I am really a sci-fi geek at heart.  The second Hobbit movie in the new trilogy came out last December, and I couldn’t wait.  Being a huge Lord of the Rings fan, I am reminded of the first line in the Lord of the Rings: 

"I amar prestar sen”.  

The world has changed. The same can be said when it comes to Cloud Computing and Big Data Analytics.  As datasets are becoming larger and more distributed, companies are increasing turning to the cloud to store them.  At the same time, the business potential for Big Data is growing.  Gartner recently released a study that the financial value of big data is increasing across verticals – Retail can see a 60%+ increase in net margin, US healthcare could grow to $300 billion per year, and the personal mobile data market could realize as much as $100 billion per year for service providers.

Enter EMC ViPR Data Services
EMC ViPR has been designed to address the growing ubiquitous nature of data storage by transforming existing heterogeneous physical storage into a simple, extensible, and open virtual storage platform.  In this context, it abstracts storage from physical arrays into a single pool of virtual storage while maintaining the unique capabilities of the underlying arrays.  The net result is that it allows data to be stored in the traditional enterprise outside of the traditional file system boundaries, allowing big data to be stored.  This enables a single object platform spanning multiple storage arrays, and even multiple data centers.  This platform then enables higher level data services with which global applications can act upon.  A deeper dive on the ViPR data services platform can be found here.  The following architecture diagram describes the ViPR stack, turning physical storage into a ubiquitous object storage platform.
Read More

Topics: Software Defined Storage, ViPR, HADOOP

Understanding Hadoop, HDFS, and What That Means to Big Data

Posted by Amrita Sadhukhan | Author Info

Jan 27, 2014 9:00:00 AM

Over the past few years, usage of the Internet has increased massively.  People are now accessing emails, social networking sites, writing blogs, and creating multiple websites.  As a result, petabytes of data are generated every moment.  Enterprises today are trying to derive meaningful information from this data and convert it into information that can translate into business value as well as features and functionality for their various products. 

Huge volumes of a great variety of data, both structured and unstructured, are being generated at an unprecedented velocity and in many respects, that is the easy part!  It is the “gather, filter, derive and translate” part that has most organizations tied up in knots.  This is the genesis of today’s focus on Big Data solutions. 

Previously we have used traditional enterprise architectures consisting of one or more servers, storage arrays, and storage area networks connecting the servers and the storage arrays.  This architecture was built based on compute intensive applications that require a lot of processing cycles but mostly on a small subset of application data. 

Read More

Topics: HDFS, HADOOP, Big Data