Language Flags

Translation Disclaimer

HPCwire HPC in the Cloud Digital Manufacturing Report Green Computing Report
Rogue Wave

November 22, 2011

Solving Big Data Storage at CERN


Not long ago we published an article about the role of tape in the big data era, citing recent announcements from SpectraLogic that poise the company as ripe for the exabyte era.

For a thirty year-old company that has watched an endless parade of storage technologies march past, the big data hoopla could certainly be just the right buzzword at just the right time.

Tape has been receiving quite a bit more attention over the last year, in part because companies and research centers require ways to retain data at a low cost while still possessing the ability to quickly spin up needed volumes on the fly for reuse or analysis.

Some have argued that tape is not relevant for many of the storage and analytics operations, but if some recent wins from the company are correct, big tape is finding a big in with data-centric businesses and research centers—and not simply as a “backup and forget” method of socking away massive data sets.

This week SpectraLogic announced that CERN is taking a close look at the company’s T-Series tape library technology, stating that the research facility already installed the exabyte-ready line in July to handle copies of data from the Large Hadron Collider (LHC) and now plans to migrate the collider data from their T380 tape library to the Spectra T-Finity using CERN’s Advanced STORage manager (CASTOR) to achieve hierarchical storage management.

To offer a sense of the scale of the data, imagine the work that is conducted on a daily basis at the facility. The world’s largest particle accelerator generates over 25 petabytes each year of scientific data that not only needs to be stored for later use, it also must be distributed in part or parcel to the variety of related institutions that carry out their own work on the data.

This means that the data the center generates, even if it is sits idle for a time, must be quickly available in large volumes for redistribution and analysis of elements that need to be separated out from other data—or analyzed in large chunks.

According to Vladimir Bahyl, who handles the tape environment at CERN, with such vast data volumes, there was a clear need for “a solution that would provide scalability for growth while ensuring the integrity and accessibility of the data.” He says that using CASTOR made the integration of the new T-Series libraries easy and now the new platform will allow CERN “to scale both hardware and software to make capacity upgrades quick, seamless and affordable as data sets grow."

Share Options


Subscribe

» Subscribe to our weekly e-newsletter


Discussion

There are 0 discussion items posted.

 
Xyratex

Sponsored Links

Sponsored Whitepapers

Parallel Performance of the IMSL C Numerical Library with OpenMP

05/21/2013 | Rogue Wave Software

Download whitepaper containing benchmark results depicting the speedup achieved as a result of incorporating OpenMP directives in the IMSL C Numerical Library, for portable, cross platform analytics.

Download this Whitepaper...

Best Practices in Big Data Storage - Sponsored by Cleversafe, Cray, DDN, NetApp, & Panasas

05/10/2013 | Cleversafe, Cray, DDN, NetApp, & Panasas

From Wall Street to Hollywood, drug discovery to homeland security, companies and organizations of all sizes and stripes are coming face to face with the challenges – and opportunities – afforded by Big Data. Before anyone can utilize these extraordinary data repositories, however, they must first harness and manage their data stores, and do so utilizing technologies that underscore affordability, security, and scalability.

Download this Whitepaper...

View the White Paper Library

Sponsored Multimedia

SGI President and CEO, Jorge Titinger, on Big Data

SGI President and CEO, Jorge Titinger, talks about SGI's history and leadership in HPC and how that has converged into Big Data Solutions.

View Multimedia

Cray CS300-AC Cluster Supercomputer Air Cooling Technology Video

The Cray CS300-AC cluster supercomputer offers energy efficient, air-cooled design based on modular, industry-standard platforms featuring the latest processor and network technologies and a wide range of datacenter cooling requirements.

View Multimedia

More Multimedia

SGI DataRaptor with MarkLogic Database

Job Bank

Datanami Conferences Ad

Featured Events

June 4-4, 2013
The Economist's Information Forum
San Francisco, CA
United States

June 10-13, 2013
Cloud & Big Data Expo
New York City, NY
United States

June 17-18, 2013
Forecast 2013
San Francisco, CA
United States

June 19-20, 2013
GigaOM Structure
San Francisco, CA
United States

June 26-27, 2013
2013 Hadoop Summit
San Jose, CA
United States

June 26-27, 2013
Big Data World Congress
London
United Kingdom

» View/Search Events

» Post an Event