Language Flags

Translation Disclaimer

HPCwire Enterprise Tech HPCwire Japan
Webinar Powering Research with Knowledge Discovery & Data Mining

November 18, 2011

SC11 Video Feature: Garth Gibson on RAID, Roots and Reliability


For those familiar with the storage vendor ecosystem inside high performance computing, Panasas has been a recognizable name for a decade, as has the name of the man behind the initial technologies.

Garth Gibson, cofounder and CTO at Panasas spent some time talking with us during the annual Supercomputing Conference (SC11) in Seattle. In addition to getting in depth about the file systems that can support big data, we talked more generally about the research roots of his company--as well as what is around the corner for customers with ever-growing data sets.

During our conversation below, he took some time not only to put his company’s technologies in context, but to offer a sense of differentiation between the proliferating options for file systems and storage setups. An iconic figure in high performance computing, Gibson is best known for his roots in RAID, which was born out of his research, first at the University of California, Berkeley, and then Carnegie Mellon University. According to Gibson, these initial technologies were born out of his sustained interest in large scale and high performance storage and his desire to achieve scalability and reliability.

In the video above, Gibson describes the process of getting the initial RAID technologies off the ground and into mainstream HPC, prefacing his history in high performance storage by noting that he’s simply an academic research working on storage systems who decided that to have an impact on the world, he’d have to do more than write a lot of papers.

As he described, when he had trouble even giving away the RAID technology back in the mid-to-late 1990s, he knew he “had to leap in with both feet and produce solutions that would solve customer needs.” He told us that he had always been interested in scale and reliability as well as applying these benefits to the largest-scale systems, and now is seeing direct correlations in many problems in HPC to those that arise in the big data era.

Gibson says that while the scale of the data is roughly the same between HPC and big data applications, there are some important differences. While coming from a storage standpoint, Gibson reflects on his experiences with students working on CMU Hadoop projects—and how innovative storage approaches fit into the both the big data and HPC boxes.

To close, it seems appropriate to point to another Panasas figure, Brent Welch, Director of Software Architecture who said the following about the role of Panasas in the era of big data:

“To really process big data sets well, computer applications and systems must be capable of handling massive parallelism and the underlying storage systems must be architected for parallelism, too. Simply providing client-side support for the pNFS protocol will not deliver the performance seen by extreme big data systems like Roadrunner and Cielo.

Panasas has been instrumental in enabling parallelism in scientific discovery, dramatically improving the ability to deliver extreme performance for big data. This breakthrough in core scientific research is now becoming the standard for the next generation of commercial applications and systems. Just recently we saw the acceptance of pNFS, a parallel file system standard pioneered by Dr. Garth Gibson at Panasas, into the Linux distribution."

Share Options


Subscribe

» Subscribe to our weekly e-newsletter


Discussion

There are 0 discussion items posted.

 

Most Read Features

Most Read News

Most Read This Just In

ISC'14

Sponsored Whitepapers

Planning Your Dashboard Project

02/01/2014 | iDashboards

Achieve your dashboard initiative goals by paving a path for success. A strategic plan helps you focus on the right key performance indicators and ensures your dashboards are effective. Learn how your organization can excel by planning out your dashboard project with our proven step-by-step process. This informational whitepaper will outline the benefits of well-thought dashboards, simplify the dashboard planning process, help avoid implementation challenges, and assist in a establishing a post deployment strategy.

Download this Whitepaper...

Slicing the Big Data Analytics Stack

11/26/2013 | HP, Mellanox, Revolution Analytics, SAS, Teradata

This special report provides an in-depth view into a series of technical tools and capabilities that are powering the next generation of big data analytics. Used properly, these tools provide increased insight, the possibility for new discoveries, and the ability to make quantitative decisions based on actual operational intelligence.

Download this Whitepaper...

View the White Paper Library

Sponsored Multimedia

Webinar: Powering Research with Knowledge Discovery & Data Mining (KDD)

Watch this webinar and learn how to develop “future-proof” advanced computing/storage technology solutions to easily manage large, shared compute resources and very large volumes of data. Focus on the research and the application results, not system and data management.

View Multimedia

Video: Using Eureqa to Uncover Mathematical Patterns Hidden in Your Data

Eureqa is like having an army of scientists working to unravel the fundamental equations hidden deep within your data. Eureqa’s algorithms identify what’s important and what’s not, enabling you to model, predict, and optimize what you care about like never before. Watch the video and learn how Eureqa can help you discover the hidden equations in your data.

View Multimedia

More Multimedia

NVIDIA

Job Bank

Datanami Conferences Ad

Featured Events

May 5-11, 2014
Big Data Week Atlanta
Atlanta, GA
United States

May 29-30, 2014
StampedeCon
St. Louis, MO
United States

June 10-12, 2014
Big Data Expo
New York, NY
United States

June 18-18, 2014
Women in Advanced Computing Summit (WiAC ’14)
Philadelphia, PA
United States

June 22-26, 2014
ISC'14
Leipzig
Germany

» View/Search Events

» Post an Event