Tag: big data

The Big Data Behind Shell’s Super-Efficient Car Races

Apr 15, 2015 |

Most Americans are interested in the fuel efficiency of automobiles these days, a byproduct of higher gas prices and the growing acceptance of manmade climate change. But for the students who participated in last weekend’s Shell Eco-marathon in Detroit, getting 100 miles per gallon–or even 1,000 MPG–may not be enough to win. More than 1,000 high school and college students from the U.S. Canada, Mexico, Brazil, and Guatemala descended upon the Motor City last weekend to put their fuel-efficient creations Read more…

Why Cybersecurity Needs Big Data Tech, Especially Hadoop

Apr 9, 2015 |

When cyber criminals really started ramping up their activities several years ago, security experts realized they needed bigger and better tools if they had any hope of slowing them down. In the wake of 2014, or “The Year of the Data Breach,” it’s clear those efforts largely failed, which is why so many security experts today are banking their hopes on Hadoop. Cybersecurity has become a big data problem because the size and complexity of the data has simply grown Read more…

What Informatica’s Buyout Means to Big Data Integration

Apr 8, 2015 |

Yesterday’s news that Informatica has agreed to be bought out by private equity firms for $5.3 billion has stirred a frenzy of activity in the big data integration community. For those working at data integration startups, the news represented a death knell of sorts for “old style” ETL and the recognition that newer data integration technologies and techniques are here to stay. “Rest in Peace Old ETL” says Darren Cunningham, a former Informatica manager who now heads up product management Read more…

Build or Buy? That’s the Big (Data) Question

Apr 8, 2015 |

“You can learn a lot from my failures, maybe,” says Ron Van Holst, an HPC director at Ontario Centres of Excellence. With decades of experience designing and building high-end telecommunications gear and HPC systems, Van Holst has a better grasp on the tradeoffs you’ll make when you choose to build or buy your next big data system. Van Holst was into a little bit of everything when was building telecommunications gear in the 1990s. From the programming languages and the Read more…

Wanted: Intelligent Middleware That Simplifies Big Data Analytics

Mar 23, 2015 |

We’ve seen tremendous technological innovation in the data analytics space over the past 10 years. Platforms like Hadoop have emerged and machine learning techniques are going mainstream. But according respected leaders in the big data community, there’s still a sizable gap in the marketplace when it comes to intelligent middleware that can orchestrate and organizes how data flows, not just in Hadoop but the enterprise. Lars George was one of the first technologists to begin working with Hadoop in Europe Read more…

How Startups Are Using Big Data Tech to Disrupt Markets

Mar 17, 2015 |

Big data has made a dramatic impact on companies all over America, but running big data programs is only one side of the puzzle. After collecting the data, companies need to analyze it. A huge part of analysis is creating visuals that explain large amounts of seemingly abstract data in a clear, concise way. It’s no surprise then that many companies are turning to data visualization tools to streamline the transformation of their business data into something more useful. With Read more…

Qumulo Comes Out of Stealth with ‘Data-Aware’ Storage

Mar 16, 2015 |

For the past three years, a Seattle company has been working to solve what its founders consider the biggest problem affecting large-scale storage: Actually knowing what data you have and how it’s being used. Today, that company, called Qumulu, emerged from stealth with a product ready to sell. In 2012, Qumulo set out on its mission to solve storage by conducting more than 600 interviews with large-scale storage users—outfits like Hollywood special effects studios, genomic sequencers, and oil and gas Read more…

It’s Time to Think Differently About Mining Big Data

Mar 16, 2015 |

Everywhere we look today, big data is finally beginning to have an impact. Hospitals are using it to analyze patient populations, big pharma is using it to find new and better drugs faster, supply chain managers are squeezing more efficiency and timeliness out of their operations, retailers are connecting with customers in new and influential ways — the list is long and continues to grow daily.  While the headlines for big data are impressive, the use of traditional analytical methods Read more…

How Big Data Is Helping Indian Schoolchildren

Mar 13, 2015 |

We often hear how big data and analytics are helping companies make more money. But big data tech is much more than that, and can also have a positive impact on one of society’s most vulnerable groups: rural schoolchildren. Earlier this week, Hewlett-Packard shared a story about how it’s working with a non-governmental entity (NGO) called the Akshara Foundation to help improve the educational experience of schoolchildren in the Indian state of Karnataka. Akshara’s mission is to ensure that every Read more…

Beyond the 3 Vs: Where Is Big Data Now?

Mar 12, 2015 |

Once defined by the “three Vs” of volume, velocity, and variety, the term “big data” has overflowed the small buckets we gave it and taken on a life of its own. Today, big data refers not only to the ongoing information explosion, but also an entire ecosystem of new technologies, as well as a unique way of thinking about data itself. Here’s a quick recap of the short history of big data. The World Wide Web was just starting to Read more…