Tag: Hadoop

Apache Spark Gets IBM Mainframe Connection

Sep 1, 2015 |

IBM’s recent embrace of Apache Spark is beginning to generate dividends in the form of open source contributions for a mainframe big data link to Spark. Big data software vendor Syncsort, Woodcliff Lake, N.J., said Tuesday (Sept. 1) it is contributing an IBM z System mainframe connector for Apache Spark that would allow easier access to mainframe data using Spark’s analytics and Spark SQL. The company described its latest mainframe connector as being similar to the Apache Sqoop link it Read more…

The Dark Web Gets a Little Brighter, Thanks to Big Data

Sep 1, 2015 |

Illegal drugs. Stolen credit card numbers. Hitmen for hire. These are some of things you can find on the Dark Web, a part of the Internet that’s not indexed by traditional search engines and where people browse in complete anonymity. Now a group of security researchers in Maryland is using big data technology to shine a light on some of the Dark Web’s seedier neighborhoods. The public Internet can be a creepy place, but it’s nothing compared to the Dark Read more…

Intel Investments Seek to Speed Big Data Rollouts

Aug 27, 2015 |

Chipmaker Intel Corp. is expanding its push into big data with an equity investment and a technology partnership with BlueData, the startup that specializes in generating virtualized big data clusters. Along with the strategic technology alliance, BlueData, Mountain View, Calif., announced a $20 million funding round this week led by Intel Capital. Amplify Partners, Atlantic Bridge, Ignition Partners and an undisclosed investor joined the Series C funding round. The partnership calls for BlueData to tailor its big data infrastructure software Read more…

Medical Insight Set to Flow from Semantic Data Lakes

Aug 26, 2015 |

The potential for data analytics to disrupt healthcare delivery is large, and getting larger by the day. But in many cases, the need to hammer data into a structured format creates a barrier to productivity. Now a hospital chain in New York City is hoping to change that by adopting a Hadoop-based semantic data lake. Located in the Bronx, Montefiore Health System is the first hospital to implement a semantic data lake as part of the New York City Clinical Read more…

Hortonworks Boosts Streaming Analytics, IoT Plays with NiFi Deal

Aug 25, 2015 |

Hortonworks today announced a definitive agreement to acquire Onyara, the company behind the data routing and streaming technology called Apache NiFi. The Hadoop heavy also announced NiFi will be the basis for its second major product line, Hortonworks DataFlow, which will underlie real-time streaming analytics and Internet of Things (IoT) applications. The National Security Agency created Apache NiFi eight years ago to address its real-time data collection needs. Short for Niagrafiles (a play on Niagara Falls), the technology was designed Read more…

How Spark Democratizes Analytic Value from Hadoop Lakes

Aug 24, 2015 |

So you’ve installed Hadoop and built a data lake to house all the bits and bytes that your organization previously discarded. So now what? If you follow the advice from industry experts, the next step on your analytics journey is to add Apache Spark to the mix. It’s common for people to confuse Hadoop with analytics, says Rob Thomas, vice president of product development at IBM Analytics. “Hadoop itself doesn’t do analytics,” Thomas tells Datanami. “Hadoop is the data storage Read more…

Beware the Dangers of Dark Data

Aug 18, 2015 |

The amount of data we’re generating is doubling roughly every 18 months, which is eerily similar to Moore’s Law scale for the growth of processing power. But much of that new data will remain invisible to those who would use it. The situation around this dark data threatens to derail big data initiatives before they can get off the ground. Gartner defines dark data as “the information assets organizations collect, process and store during regular business activities, but generally fail Read more…

Three Ways Zoomdata Makes Big Data Pop

Aug 11, 2015 |

When it comes to big data visualization tools, there’s no shortage of players. Tableau, Qlik, Spotfire, and Microstrategy are established incumbents with big followings. But there’s a fresh crop of visualization tools making waves, including one from Zoomdata that’s helping to change how we think about big data analysis. Here are three ways that Zoomdata is helping to change the field of big data analytics and visualization: 1. Micro Queries and Data Sharpening Zoomdata’s flagship analytics and visualization tool embraces Read more…

HP Updates Big Data Strategy

Aug 11, 2015 |

Hewlett-Packard fleshed out its big data strategy this week with the roll out of a new version of its analytics platform at a company event along with an “accelerator” program that would give developers access to APIs on its Haven big data platform at a discounted rate. The new addition to the Haven platform called “Excavator” targets analysis of high-speed streaming data from a variety of sources, including the Internet of Things. It is also designed to improve SQL and Read more…

Three Tips for Building a Big-Data Back-End for Your Mobile App

Aug 7, 2015 |

With more companies striving to become data-driven, many businesses are developing mobile applications and integrating big data analytics for their products or services. As companies expand, along with their user bases, they must be prepared to handle the massive data influxes those mobile apps are causing. As virtual architecture becomes more widely adopted to manage large datasets of mobile data, companies need to find a solution that will allow them to focus on the valuable insights hidden in these datasets, Read more…