DataTorrent
Language Flags

Translation Disclaimer

HPCwire Enterprise Tech HPCwire Japan


November 02, 2012

Researchers Schooled in Big Data Management


With the rise of big data, advanced data management capabilities are becoming increasingly important in research circles.

Even the National Science Foundation and the National Institutes of Health have instituted data management plans as being central to any future research proposal. However, seeing as the big data problem is relatively new, many groups are left wondering how to put together an acceptable data management plan.

To help answer those questions, the Southeastern Universities Research Association teamed up with the Association of Southeastern Research Libraries to put together a “Step-By-Step Guide to Data Management.” The guide identifies six steps to creating a viable data management plan: assembling a data management toolkit, planning, collecting and checking data, describing and documenting data (generating metadata in other words), selecting a data repository, and storing and preserving data.

The guide consistently points at organizations like Databib, DataONE, and DMPTool (Data Management Plan Tool). According to the guide, DataONE is an environmental science organization committed to using big data to help the planet. Their “best practices primer” focuses on a “data life cycle” which pretty much involves the same steps the guide is trumpeting. Indeed, the guide itself notes that it was based on DataONE’s best practices.

DMPTool is a resource that allows research groups to compare data management plans of past accepted proposals and use them as a model.

One resource not to be overlooked, according to the guide, is the university library. While this may not come as a shock from a group that is half comprised of Research Library professionals, towering or expansive university libraries often have a significant amount of data to handle. Creating a database that can be searched hundreds of different ways of the myriad titles that exist is no small data feat. Further, according to the guide, libraries frequently have data management plan templates of their own.

With datasets growing larger, there is a renewed emphasis in the scientific community on storing and preserving one’s data. After all, every scientific discovery and paper has to be backed up by the evidence that drove the discovery. With as large as datasets can be, it would be easy to publish one’s results while neglecting the data and metadata involved. It would also be significantly cheaper. However, credited scientists do not think like this.

As such, it is important for the advancement of science in the big data era to have a standardized resource for data management. The “Step-By-Step Guide to Data Management” hopes to be that resource.

Related Articles

Yale Computer Scientists to Explore Big Data Developments

Researchers Target Storage, MapReduce Interactions

Research Aims to Automate the Impossible

Share Options


Subscribe

» Subscribe to our weekly e-newsletter


Discussion

There are 0 discussion items posted.

 

Most Read Features

Most Read News

Most Read This Just In

Cray Supercomputer

Sponsored Whitepapers

Planning Your Dashboard Project

02/01/2014 | iDashboards

Achieve your dashboard initiative goals by paving a path for success. A strategic plan helps you focus on the right key performance indicators and ensures your dashboards are effective. Learn how your organization can excel by planning out your dashboard project with our proven step-by-step process. This informational whitepaper will outline the benefits of well-thought dashboards, simplify the dashboard planning process, help avoid implementation challenges, and assist in a establishing a post deployment strategy.

Download this Whitepaper...

Slicing the Big Data Analytics Stack

11/26/2013 | HP, Mellanox, Revolution Analytics, SAS, Teradata

This special report provides an in-depth view into a series of technical tools and capabilities that are powering the next generation of big data analytics. Used properly, these tools provide increased insight, the possibility for new discoveries, and the ability to make quantitative decisions based on actual operational intelligence.

Download this Whitepaper...

View the White Paper Library

Sponsored Multimedia

Webinar: Powering Research with Knowledge Discovery & Data Mining (KDD)

Watch this webinar and learn how to develop “future-proof” advanced computing/storage technology solutions to easily manage large, shared compute resources and very large volumes of data. Focus on the research and the application results, not system and data management.

View Multimedia

Video: Using Eureqa to Uncover Mathematical Patterns Hidden in Your Data

Eureqa is like having an army of scientists working to unravel the fundamental equations hidden deep within your data. Eureqa’s algorithms identify what’s important and what’s not, enabling you to model, predict, and optimize what you care about like never before. Watch the video and learn how Eureqa can help you discover the hidden equations in your data.

View Multimedia

More Multimedia

Leverage Big Data

Job Bank

Datanami Conferences Ad

Featured Events

May 5-11, 2014
Big Data Week Atlanta
Atlanta, GA
United States

May 29-30, 2014
StampedeCon
St. Louis, MO
United States

June 10-12, 2014
Big Data Expo
New York, NY
United States

June 18-18, 2014
Women in Advanced Computing Summit (WiAC ’14)
Philadelphia, PA
United States

June 22-26, 2014
ISC'14
Leipzig
Germany

» View/Search Events

» Post an Event