Follow Datanami:

Tag: storm

Cascading Now Supports Tez–Spark and Storm Up Next

May 13, 2014 |

Concurrent, the company behind the open source Cascading framework, today unveiled a major update that will allow its customers to migrate their Hadoop applications from using MapReduce to use the new Apache Tez engine, without rewriting any business logic. Read more…

Crossing the Big Data Stream with DataTorrent

Apr 23, 2014 |Enterprises eager for a competitive edge are turning to in-memory stream processing technologies to help them analyze big data in real time. The Apache Spark and Storm projects have gained lots of momentum in this area, as have some analytic NoSQL databases and in-memory data grids. Another streaming technology worth keeping an eye on is DataTorrent. Read more…

How Fast Data is Driving Analytics on the IoT Superhighway

Apr 15, 2014 |The promise of big data is morphing into the fast data opportunity. Unless you have the capability to respond to the Internet of Things and the trillions of data points generated by smartphones, sensors, and social media, the business opportunities of fast data can pass you by. Read more…

Hortonworks Drives Stinger Home with HDP 2.1

Apr 2, 2014 |Hortonworks today unveiled a major new release of its Hadoop distribution that puts significant new capabilities into the hands of its customers. The speed and scale of SQL processing in Apache Hive were improved with the final phase of the Stinger initiative, while the additions of Apache Storm and Apache Solr in HDP 2.1 open up new ways for customers to manipulate their data. Security and data governance were bolstered with Apache Knox and Apache Falcon, respectively, while Apache Spark is now available as a tech preview. Read more…

Shining a Light on Hadoop’s ‘Black Box’ Runtime

Feb 4, 2014 |Let's face it: Writing MapReduce processes is not very fun. That's the main reason that the Cascading framework is gaining such a big following--because it abstracts away the difficult part of MapReduce with an easy-to-use Java API and library. With today's launch of a new product called Driven, the company behind Cascading is enabling users to instrument the data analytic apps developed with Cascading, in pursuit of faster troubleshooting and higher performance. Read more…

Zooming Through Historical Data with Streaming Micro Queries

Jan 17, 2014 |Stream processing engines, such as Storm and S4, are commonly used to analyze real-time data as it flows into an organization. But did you know you can use this technology to analyze historical data too? A company called ZoomData recently showed how. Read more…

Yahoo Unveils SAMOA to Mine Multiple Data Streams

Nov 25, 2013 |Yahoo last month unveiled a new streaming processing framework called Scalable Advanced Massive Online Analysis (SAMOA) that it says will simplify the process of developing and executing machine learning algorithms against multiple data streams. The open source software works with individual stream processing engines, such as Storm and S4, and is available for download now. Read more…

HDP 2.0: Rise of the Hadoop Data Lake

Oct 23, 2013 |Hortonworks became the first Hadoop distributor to ship the new Hadoop version 2 software today when it announced the general availability of Hortonworks Data Platform (HDP) 2.0. The update will enable customers with small Hadoop clusters to upgrade their big data platform into a shared Hadoop service, or a data lake, a Hortonworks executive explains. Read more…

Hadoop Version 2: One Step Closer to the Big Data Goal

Oct 17, 2013 |The wait for Hadoop 2.0 ended yesterday when the Apache Software Foundation (ASF) announced the availability of the new big data platform. Among the most anticipated features is the new YARN scheduler, which will make it easier for users to run different workloads--such as MapReduce, HBase, SQL, graph analysis, and stream processing--on the same hardware, and all at the same time. Better availability and scalability, and a smoother upgrade process, round out the new platform, as Hadoop creator Doug Cutting explains, but still not everybody is happy with Hadoop. Read more…

Apache Takes Storm Into Incubation

Sep 19, 2013 |On Wednesday night, Doug Cutting, Director for the Apache Software Foundation (ASF), announced that the organization will be adding the distributed real time computation system known as Storm as the foundations newest Incubator podling. Read more…
Do NOT follow this link or you will be banned from the site!