Follow Datanami:

Tag: Spark Streaming

RISELab Replaces AMPLab with Secure, Real-Time Focus

Oct 31, 2016 |

UC Berkeley AMPLab will shut its doors in December after six years of delivering major technological innovations like Apache Spark, Apache Mesos, and Alluxio. Taking its place is the RISELab, which will focus its efforts on delivering a secure real-time decision stack, dubbed SRDS. Read more…

Spark 2.0 to Introduce New ‘Structured Streaming’ Engine

Feb 25, 2016 |

The folks at Databricks last week gave a glimpse of what’s to come in Spark 2.0, and among the changes that are sure to capture the attention of Spark users is the new Structured Streaming engine that leans on the Spark SQL API to simplify the development of real-time, continuous big data apps. Read more…

Real-Time Streaming Gone ‘Bananas’

Jan 26, 2016 |

Akuda Labs is touting the throughput and power of a real-time stream data processing system it released last week. The company says the software, dubbed Bananas, runs 10 times faster that Apache Spark Streaming, with considerably less latency. Read more…

Meet Your Friendly Neighborhood Spark Sherpa

Dec 9, 2015 |

Apache Spark is the most popular big data project at the moment, with thousands of contributors cranking out code on a weekly basis. Keeping up with Spark releases is hard, and it’s why Hadoop distributor Hortonworks views itself as a Sherpa that guides customers on how best to use the explosive big data tech. Read more…

3 Major Things You Should Know About Apache Spark 1.6

Nov 30, 2015 |

Hundreds of fixes and new features made their way into Apache Spark 1.6, which was announced last week and is expected to ship in mid-December. But here are the three main things in Spark 1.6 that are most likely to affect you, according to the head of engineering and product at Databricks. Read more…

Spark Streaming: What Is It and Who’s Using It?

Nov 30, 2015 |

A recent study of over 1,400 Spark users conducted by Databricks, the company founded by the creators of Spark, showed that compared to 2014, 56 percent more Spark users globally ran Spark Streaming applications in 2015. Read more…

Taming Apache Storm for Real-Time Analytics

Mar 5, 2015 |

Apache Storm is gaining a foothold among organizations looking to do real-time analytics on streaming data. However, the difficulty in working with the distributed processing framework is proving to be a major hurdle to Storm adoption. Read more…

Do NOT follow this link or you will be banned from the site!