Language Flags

Translation Disclaimer

HPCwire Enterprise Tech HPCwire Japan

February 06, 2012

Big Data Cloud Delivers Military Intelligence to U.S. Army in Afghanistan

High Performance Technologies, Inc. (HPTi), a firm that focuses on the technology challenges of America's federal government, supported the design and implementation of a private cloud that conveys the latest intelligence information in near-real time to U.S. troops stationed in Afghanistan. The cloud's reach extends all the way to forward operating bases that might serve as local nodes by setting up trailers and collecting data from unmanned aerial vehicles (UAV) or other nearby sources.

The program to develop the Big Data cloud began in April 2009, after the U.S. Army determined that the architecture of a private cloud could fully meet their requirements to handle "intel" analysis, processing, and production.  The cloud went live in March 2011.  

The Army approached HPTi to be a part of the team that worked on the effort, the company told IDC, because of the firm's reputation for creating and exploiting high performance computing (HPC) platforms.  The Army considers private clouds of the type HPTi designed to be HPC environments.  The Afghanistan private cloud can handle petabytes of data today and is likely to grow quickly. Intelligence clouds need access to information going back a long way, in order to make it possible to see patterns needed for predictive models.

Semantic algorithms and graph analysis are already important components.

 In general, the Army prefers open source environments for their flexibility and agility, and to avoid dependence on large vendors.  Some of the algorithms enabling the cloud were off-the-shelf formulas, while others had to be custom-written by Digital Reasoning and others. 

HPTi assisted putting all the pieces together to produce an integrated solution, including the software stack that manages the way the algorithms securely interact with all the data. The stack uses open-source Hadoop for the file system and MapReduce.  Under the contract, HPTi also provides the support for the private cloud. Software releases happen every four months.  .

Today, the HPC cloud delivers intelligence to multi-function laptop workstations. Plans call for enabling connectivity to mobile devices such as Android-based tablets.  Today, the cloud delivers specific data to users for analysis. In the future, users will be able to mine and search all the data.

According to HPTi, the main pre-deployment challenges were as follows:

  • A lot of the software was new. Working with the Hadoop stack was not easy, especially in its early, pioneering stages.
  • Synchronizing technology milestones with the fixed DoD acquisition life cycle was another challenge.
  • Finally, it was challenging to have to release the entire integrated solution at one time, including a whole series of tightly integrated applications.

Next steps including tuning the analytics to keep "noise" from increasing in certain situations. Another future challenge is true synchronization from one constituent cloud to the next, to enable continuity of profiles and functionality when users change geographic locations.

HPTi said a movement is afoot to standardize private clouds across the U.S. Government, by certifying the cloud to be able to communicate with each other as trusted partners. This will require a common reference implementation, so that the "meta cloud" looks like a continuous data space.

HPTi's business has been on a roll for some time, and the company will soon become even larger. In June 2011, HPTi signed a definitive agreement to merge with Dynamics Research Corporation.

Please plan to attend IDC's 47th annual industry business briefing
Directions 2012

Competing for 2020: Delivering on the Promise of the Connected World
March 7, 2012 in San Jose, CA ~AND~ March 13, 2012 in Boston, MA

Contact me for more information or visit:

Related Stories

The New Era of Computing: An Interview with "Dr. Data"

Digital Reasoning Refreshes Text Analytics

GE Addresses Time Series Data Demands

Share Options


» Subscribe to our weekly e-newsletter


There are 0 discussion items posted.


Most Read Features

Most Read News

Most Read This Just In

Cray Supercomputer

Sponsored Whitepapers

Planning Your Dashboard Project

02/01/2014 | iDashboards

Achieve your dashboard initiative goals by paving a path for success. A strategic plan helps you focus on the right key performance indicators and ensures your dashboards are effective. Learn how your organization can excel by planning out your dashboard project with our proven step-by-step process. This informational whitepaper will outline the benefits of well-thought dashboards, simplify the dashboard planning process, help avoid implementation challenges, and assist in a establishing a post deployment strategy.

Download this Whitepaper...

Slicing the Big Data Analytics Stack

11/26/2013 | HP, Mellanox, Revolution Analytics, SAS, Teradata

This special report provides an in-depth view into a series of technical tools and capabilities that are powering the next generation of big data analytics. Used properly, these tools provide increased insight, the possibility for new discoveries, and the ability to make quantitative decisions based on actual operational intelligence.

Download this Whitepaper...

View the White Paper Library

Sponsored Multimedia

Webinar: Powering Research with Knowledge Discovery & Data Mining (KDD)

Watch this webinar and learn how to develop “future-proof” advanced computing/storage technology solutions to easily manage large, shared compute resources and very large volumes of data. Focus on the research and the application results, not system and data management.

View Multimedia

Video: Using Eureqa to Uncover Mathematical Patterns Hidden in Your Data

Eureqa is like having an army of scientists working to unravel the fundamental equations hidden deep within your data. Eureqa’s algorithms identify what’s important and what’s not, enabling you to model, predict, and optimize what you care about like never before. Watch the video and learn how Eureqa can help you discover the hidden equations in your data.

View Multimedia

More Multimedia


Job Bank

Datanami Conferences Ad

Featured Events

May 5-11, 2014
Big Data Week Atlanta
Atlanta, GA
United States

May 29-30, 2014
St. Louis, MO
United States

June 10-12, 2014
Big Data Expo
New York, NY
United States

June 18-18, 2014
Women in Advanced Computing Summit (WiAC ’14)
Philadelphia, PA
United States

June 22-26, 2014

» View/Search Events

» Post an Event