Features

Police Push the Limits of Big Data Technology

Jul 31, 2014 |

Big data is changing the way business is done across industries, from financial services and banking to retail and mining. As data analytic technologies mature, state and local law enforcement agencies are now using the types of sophisticated analytic tools that previously only the biggest federal agencies could afford. The question on many American’s minds is how far law enforcement will go. Technological advances are giving local and state agencies a variety of new data sources and analytical tools to Read more…

How Streaming Analytics Helps Telcos Overcome the Data Deluge

Jul 30, 2014 |

Real-time streaming analytics is all the rage these days, as organizations seek to wring value from their data as quickly as possible. While the technology is bleeding edge for many, it’s commonplace in the telecommunications industry, where vendors like Guavus are leveraging the power of Hadoop and streaming analytics to help telcos not only survive the data deluge, but thrive within it. Things are a bit different in telecommunications. While companies in other fields may experiment with new technologies, tier-one Read more…

Now and Then: The Evolution of In-Memory Computing

Jul 29, 2014 |

The history of data warehousing, big data, and analytics can be described as a constant challenge to process and analyze ever-increasing volumes of data in shorter amounts of time. Fundamentally, the single biggest factor that affects our ability to process data is the speed at which we can access it, and then do something with it. Data warehousing architectures have addressed this over the years by adopting massively parallel processing (MPP) designs, but the lower latency of in-memory computing combined Read more…

How Spark Helps ClearStory Achieve Data Harmony

Jul 28, 2014 |

When the folks at ClearStory Data set out to build a big data harmonization tool that could automatically converge diverse data streams into a single coherent view for analysis, they figured they’d have to develop much of the underlying technology themselves. Then they heard of the Apache Spark project at Cal Berkeley’s AMPlab, and the rest, as they say, is history. ClearStory Data was founded several years ago by two high-tech veterans, Sharmila Mulligan and Vaibhav Nivargi, with the idea Read more…

AutoTrader Zooms Ahead with Automated ETL

Jul 25, 2014 |

If you’re in the market for a car, you’re probably using the Internet to check inventory and compare prices. From the consumer point of view, it all appears to work seamlessly, but keeping all that automotive data accurate and up-to-date is no easy task. For the folks at AutoTrader and its data integration subsidiary, VinSolutions, the move to an automated ETL process proved beneficial. Founded in 1996, AutoTrader.com today is one of the most popular sources for market data on Read more…

Enforcing Hadoop SLAs in a Big YARN World

Jul 23, 2014 |

The Apache Hadoop community has done a truly amazing job developing a scalable and versatile platform for big data analytic workloads. And with the recent introduction of YARN in Hadoop 2, we’re now able to run multiple analytic engines on our clusters simultaneously. Unfortunately, the prospect for resource contention has also gone up, and that will likely increase demand for service level agreement (SLA) enforcement. YARN made its big introduction just as companies started to move their Hadoop deployments out Read more…

FDA Mines Billing Data for Drug Interaction Insight

Jul 22, 2014 |

The Food and Drug Administration is five years into a pilot program aimed at identifying hazardous drug interactions by mining the medical billing records of millions of Americans. The program, dubbed Mini-Sentinel, is a creative application of big data technologies that has the potential to improve people’s lives. The FDA started funding the Mini-Sentinel project in 2009 with the goal of coming up a better way to monitor for unintended side effects of prescription drugs. It’s impossible to eliminate all Read more…

Streaming Analytics Ready for Prime Time, Forrester Says

Jul 22, 2014 |

Analytic platforms that generate insights from data in real time are mature enough for enterprises to begin adopting them, Forrester says in its latest report. While open source streaming analytic products like Apache Storm are proving popular, Forrester says they lack key functionality found in the offerings of proprietary vendors, such as top-rated Software AG. You don’t need a Forrester analyst to know that streaming analytics is red hot at the moment. If Hadoop has opened our eyes to what Read more…

Slicing and Dicing Music Data for Fun and Profit

Jul 21, 2014 |

The advent of big data analytics promises to have a profound impact on many aspects of human life, including how we work and play. Big data is even influencing the arts, where the field of music data science is rearranging our relationship with music. We’re in the midst of a boom in music data science that can be traced back to 1999, when two important events occurred. First, Shawn Fanning unleashed Napster to the world, thereby giving people the power Read more…

For Esri, Analytics All About Location, Location, Location

Jul 18, 2014 |

Certain analytic tools excel at manipulating with certain types of data. When it comes to data with a geographic bent, there may be no more influential vendor than Esri, a Southern California company that has quietly gobbled up a majority share of the geographic information systems (GIS) market. But now the company is positioning GIS as powerful way to visualize all types of data. Esri owns anywhere from 40 to 70 percent of the market for GIS software, according to Read more…