Tag: real-time processing

A Peek Inside Kafka’s New ‘Exactly Once’ Feature

Jul 3, 2017 |

Here’s some great news for Apache Kafka users: The open source software will support exactly once semantics for stream processing with the upcoming version 0.11 release, thereby eliminating the need for application developers to code the important feature themselves. Read more…

Google Lauds Outside Influence on Apache Beam

Jan 10, 2017 |

Apache Beam started life as a decidedly Google-ish technology designed to mask the complexity inherent in building sophisticated analytic pipelines that run across distributed systems. But over the course of becoming a top level project at the Apache Software Foundation during the past year, the unified big data programming framework now boasts a more varied cast of supporting characters. Read more…

Flink: Worth a Second Look

Sep 16, 2016 |

The big data ecosphere has evolved to the point where there are clear technology leaders. In the category of SQL engines that run on Hadoop, Hive and Spark are clearly the dominant products among open source developers. Read more…

Apache Flink Gears Up for Emerging Stream Processing Paradigm

Aug 3, 2016 |

We’re close to the next release of Apache Flink, the stream processing engine developed by the Apache Software Foundation. Flink version 1.1.0 will bring new SQL interface for working with streaming data, while bigger changes, like dynamic scaling, are set for the subsequent release. Read more…

Concord Claims 10x Performance Edge on Spark Streaming

Jul 14, 2016 |

Organizations that are looking for a stream processing engine upon which to build fast data applications featuring high-throughput and low-latency may want to check out Concord, a new framework that emerged from the ad-tech world and reportedly runs 10 times faster than Spark Streaming and Storm. Read more…

Apache Beam’s Ambitious Goal: Unify Big Data Development

Apr 22, 2016 |

If you’re tired of using multiple technologies to accomplish various big data tasks, you may want to consider Apache Beam, a new distributed processing tool from Google that’s now incubating at the ASF. Read more…

Lockheed Aims to Make Apache Storm Easier to Use

Jan 9, 2015 |

The data analytics arm of defense contractor Lockheed Martin yesterday announced that it’s making a big data analysis tool available as open source. Dubbed StreamFlow, the tool is designed to make it easier for beginner programmers to work with Apache Storm. Read more…