Language Flags

Translation Disclaimer

HPCwire HPC in the Cloud Digital Manufacturing Report Green Computing Report
Rogue Wave

November 02, 2012

Researchers Schooled in Big Data Management


With the rise of big data, advanced data management capabilities are becoming increasingly important in research circles.

Even the National Science Foundation and the National Institutes of Health have instituted data management plans as being central to any future research proposal. However, seeing as the big data problem is relatively new, many groups are left wondering how to put together an acceptable data management plan.

To help answer those questions, the Southeastern Universities Research Association teamed up with the Association of Southeastern Research Libraries to put together a “Step-By-Step Guide to Data Management.” The guide identifies six steps to creating a viable data management plan: assembling a data management toolkit, planning, collecting and checking data, describing and documenting data (generating metadata in other words), selecting a data repository, and storing and preserving data.

The guide consistently points at organizations like Databib, DataONE, and DMPTool (Data Management Plan Tool). According to the guide, DataONE is an environmental science organization committed to using big data to help the planet. Their “best practices primer” focuses on a “data life cycle” which pretty much involves the same steps the guide is trumpeting. Indeed, the guide itself notes that it was based on DataONE’s best practices.

DMPTool is a resource that allows research groups to compare data management plans of past accepted proposals and use them as a model.

One resource not to be overlooked, according to the guide, is the university library. While this may not come as a shock from a group that is half comprised of Research Library professionals, towering or expansive university libraries often have a significant amount of data to handle. Creating a database that can be searched hundreds of different ways of the myriad titles that exist is no small data feat. Further, according to the guide, libraries frequently have data management plan templates of their own.

With datasets growing larger, there is a renewed emphasis in the scientific community on storing and preserving one’s data. After all, every scientific discovery and paper has to be backed up by the evidence that drove the discovery. With as large as datasets can be, it would be easy to publish one’s results while neglecting the data and metadata involved. It would also be significantly cheaper. However, credited scientists do not think like this.

As such, it is important for the advancement of science in the big data era to have a standardized resource for data management. The “Step-By-Step Guide to Data Management” hopes to be that resource.

Related Articles

Yale Computer Scientists to Explore Big Data Developments

Researchers Target Storage, MapReduce Interactions

Research Aims to Automate the Impossible

Share Options


Subscribe

» Subscribe to our weekly e-newsletter


Discussion

There are 0 discussion items posted.

 
Cray CS300-LC

Sponsored Links

Sponsored Whitepapers

Best Practices in Big Data Storage - Sponsored by Cleversafe, Cray, DDN, NetApp, & Panasas

05/10/2013 | Cleversafe, Cray, DDN, NetApp, & Panasas

From Wall Street to Hollywood, drug discovery to homeland security, companies and organizations of all sizes and stripes are coming face to face with the challenges – and opportunities – afforded by Big Data. Before anyone can utilize these extraordinary data repositories, however, they must first harness and manage their data stores, and do so utilizing technologies that underscore affordability, security, and scalability.

Download this Whitepaper...

Big Data, Big Brains – Sponsored By NetApp

04/22/2013 | NetApp

Big data has proven to be one of the most promising yet challenging technologies for both government and industry. But, before IT leaders can harness the full potential of big data, there are key issues to address surrounding infrastructure, storage, personnel, and training.
MeriTalk surveyed 17 visionary big data leaders to find out what they see as the big data challenges and opportunities as well as how government can best leverage big data. Download the “Big Data, Big Brains Report”.

Download this Whitepaper...

View the White Paper Library

Sponsored Multimedia

SGI President and CEO, Jorge Titinger, on Big Data

SGI President and CEO, Jorge Titinger, talks about SGI's history and leadership in HPC and how that has converged into Big Data Solutions.

View Multimedia

Cray CS300-AC Cluster Supercomputer Air Cooling Technology Video

The Cray CS300-AC cluster supercomputer offers energy efficient, air-cooled design based on modular, industry-standard platforms featuring the latest processor and network technologies and a wide range of datacenter cooling requirements.

View Multimedia

More Multimedia



Job Bank

Datanami Conferences Ad

Featured Events

May 22-23, 2013
Business Intelligence Innovation Summit
Chicago, IL
United States

June 4-4, 2013
The Economist's Information Forum
San Francisco, CA
United States

June 10-13, 2013
Cloud & Big Data Expo
New York City, NY
United States

June 19-20, 2013
GigaOM Structure
San Francisco, CA
United States

June 26-27, 2013
2013 Hadoop Summit
San Jose, CA
United States

June 26-27, 2013
Big Data World Congress
London
United Kingdom

» View/Search Events

» Post an Event