Follow Datanami:

Tag: storm

LinkedIn Open Sources Samza Stream Processor

LinkedIn has donated Samza, its lightweight, real-time stream processing framework, to the Apache Software Foundation, thereby putting a promising new Hadoop engine into the open source realm for anybody to use. Read more…

Twitter Conjures Up a Hadoop-Storm Hybrid, Ponders IPO

This week, Twitter released to the open source community a new data platform called "Summingbird" that glues the batch-oriented processing of Hadoop with the real-time event processing of its own Storm framework. The release comes on the heels of a report about a possible initial public offering of stock for the San Francisco company. Read more…

Yahoo! Spinning Continuous Computing with YARN

YARN was the big news this week, with the announcement that the Hadoop resource manager is finally hitting the streets as part of the Hortonworks Data Platform (HDP) “Community Preview.” According to Bruno Fernandez-Ruiz, who spoke at Hadoop Summit this week, Yahoo! has been able to leverage YARN to transform the processing in their Hadoop cluster from simple, stodgy MapReduce, to a nimble micro-batch engine processing machine – a change which they refer to as “continuous computing.” Read more…

Infochimps Leap to Open Source Branches

Open source projects like LinkedIn's Kafka and the Twitter-developed Storm have found a new home in the Infochimps tree. We spoke with the company's co-founder, Flip Kromer and their CEO, Jim Kaskade, about how these introduce performance and reliability, even among the clouds.... Read more…

Datanami