Language Flags

Translation Disclaimer

HPCwire Enterprise Tech HPCwire Japan

March 30, 2012

Government Puts $200 Million Behind Big Data Initiative

* Editor's Update 5/5 * Be sure to peruse our "7 Winners from the U.S. Big Data Initiative" feature that explores details of select funded projects. *

In 1976 when Congress formalized the Office of Science and Technology Policy (OSTP), two small companies, Microsoft and Apple, were just getting rolling, the first laser printer was wowing audiences at the IBM unveiling event and news about an amazing new technology called VHS was just hitting popular news sources.

While some might have seen it coming, it would have been impossible to predict that just over thirty years later the devices and tools that were spawned in the 1970s would be refined and culled into data-collection and even data-sharing mechanisms.

Beyond this, who would have imagined during the formal induction of OSTP that it would someday need to create a separate policy-making arm and funding allowance just to manage these ever-multiplying data?

This week, the office pushed a cool $200 million toward the funding of big data research and development projects with the announcement of the Big Data Initiative. To achieve their goals of making the most of data to aid in the country’s research, defense and economic programs, the White House and the OSTP are bringing together the efforts of six agencies.

The focus of this inter-agency collaboration is, as the White House stated, on improving “the tools and techniques needed to access, organize and glean discoveries from huge volumes of data.” OSTP officials narrowed the policy action down to three bullets that define the inter-agency approach. These include:

  • Advance state of the art core technologies needed to collect, store, preserve, manage, analyze and share huge quantities of data.
  • Harness these technologies to accelerate the pace of discovery in science and engineering, strengthen our national security and transform teaching and learning.
  • Expand the workforce needed to develop and use big data technologies.

While broad policy action items like this can often be tough to follow in terms of how the funding is filtered, there are some notable projects that are set to roll forward immediately from the agencies and departments slated as recipients for the funding.

Homeland Security, the Department of Defense (DoD), the Department of Energy (DOE), the National Institutes of Health, the Food and Drug Administration, and the U.S. Geological Survey are but a few divisions set to see their big data R&D capacity get a boost.

There are some solid projects on the table from the six agencies tasked to follow through with the initiative.

For instance, the DoD is placing what it calls a “big bet on big data” to the tune of $250 million to the table to find ways to make use of sensor data, sentiment, and decision support systems to make “truly autonomous systems that can maneuver and make decisions of their own.”

They also point to other defense projects to help soldiers on the field with sentiment, textual and predictive analytics operations that lead to better situational awareness.

In addition to the “big bet” within the main arm of the department, other DoD-fed agencies, including DARPA will receive resources to push ahead with projects like XDATA, which will receive around $25 million over the next four years to develop new techniques of analysis on diverse data across distributed stores.

Other government divisions, including the Department of Homeland Security, will explore the use of real-time data to better respond to emergency situations. As the department described this week, it will be working with researchers at Rutgers (home to its own big data investment news this week), Purdue and the Center of Excellence on Visualization and Data Analytics (CVADA) to advance techniques that will use real-time data to create instant decision-making capabilities.

The DOE will be focusing on computer science projects that focus on storage, including work on the High Performance Storage System (HPSS) , the Adaptable IO System and the Kepler Scientific Workflow System, among others.

The National Science Foundation is another key recipient of resources under the big data program. The NSF released a solicitation, "Core Techniques and Technologies for Advancing Big Data Science & Engineering," or "Big Data," jointly with NIH.  According to the NSF, the program will seek to tap large data sets in order to accelerate progress in science and engineering research. Specifically, it will fund research to develop and evaluate new algorithms, statistical methods, technologies, and tools for improved data collection and management, data analytics and e-science collaboration environments.

This includes a $10 million award under the Expeditions in Computing program to researchers at the University of California, Berkeley. The team will integrate algorithms, machines, and people to turn data into knowledge and insight. The objective is to develop new scalable machine-learning algorithms and data management tools that can handle large-scale and heterogeneous datasets, novel datacenter-friendly programming models, and an improved computational infrastructure.

According to the NSF’s director, Subra Suresh, "Data are motivating a profound transformation in the culture and conduct of scientific research in every field of science and engineering." He called on American scientists to “rise to the challenges and seize the opportunities afforded by this new, data-driven revolution,” saying that “The work we do today will lay the groundwork for new enterprises and fortify the foundations for U.S. competitiveness for decades to come."

Edward Lazowska, a computer scientist from University of Washington, summarized the sentiments of many in the academic community who spoke in the wake of the announcement when he pointed to the recognition of big data technologies as a critical first step in aiding missions related to everything from national defense to healthcare.

* Editor's Update 5/5 * Be sure to peruse our "7 Winners from the U.S. Big Data Initiative" feature that explores details of select funded projects. *

Related Stories

Big Data Cloud Delivers Military Intelligence to U.S. Army in Afghanistan

The New Era of Computing: An Interview with "Dr. Data"

JHU Sets Network Bar for Data-Intensive Science

Share Options


» Subscribe to our weekly e-newsletter


There are 0 discussion items posted.


Most Read Features

Most Read News

Most Read This Just In

Cray Supercomputer

Sponsored Whitepapers

Planning Your Dashboard Project

02/01/2014 | iDashboards

Achieve your dashboard initiative goals by paving a path for success. A strategic plan helps you focus on the right key performance indicators and ensures your dashboards are effective. Learn how your organization can excel by planning out your dashboard project with our proven step-by-step process. This informational whitepaper will outline the benefits of well-thought dashboards, simplify the dashboard planning process, help avoid implementation challenges, and assist in a establishing a post deployment strategy.

Download this Whitepaper...

Slicing the Big Data Analytics Stack

11/26/2013 | HP, Mellanox, Revolution Analytics, SAS, Teradata

This special report provides an in-depth view into a series of technical tools and capabilities that are powering the next generation of big data analytics. Used properly, these tools provide increased insight, the possibility for new discoveries, and the ability to make quantitative decisions based on actual operational intelligence.

Download this Whitepaper...

View the White Paper Library

Sponsored Multimedia

Webinar: Powering Research with Knowledge Discovery & Data Mining (KDD)

Watch this webinar and learn how to develop “future-proof” advanced computing/storage technology solutions to easily manage large, shared compute resources and very large volumes of data. Focus on the research and the application results, not system and data management.

View Multimedia

Video: Using Eureqa to Uncover Mathematical Patterns Hidden in Your Data

Eureqa is like having an army of scientists working to unravel the fundamental equations hidden deep within your data. Eureqa’s algorithms identify what’s important and what’s not, enabling you to model, predict, and optimize what you care about like never before. Watch the video and learn how Eureqa can help you discover the hidden equations in your data.

View Multimedia

More Multimedia


Job Bank

Datanami Conferences Ad

Featured Events

May 5-11, 2014
Big Data Week Atlanta
Atlanta, GA
United States

May 29-30, 2014
St. Louis, MO
United States

June 10-12, 2014
Big Data Expo
New York, NY
United States

June 18-18, 2014
Women in Advanced Computing Summit (WiAC ’14)
Philadelphia, PA
United States

June 22-26, 2014

» View/Search Events

» Post an Event