Follow Datanami:

Tag: stream processing

Open Source Provides Path to Real-Time Stream Processing

Consumers expect immediate, personalized gratification. Real-time distributed stream processing enables companies to meet those expectations. However, many see the technology as being out of reach for all but the biggest Read more…

Five Drivers Behind the Rapid Rise of Apache Flink

In 2022 alone, a total of at least $55 million has been invested by venture capitalists into startups building companies around Apache Flink, the open source project that’s used to process data streams at large scale a Read more…

RisingWave Emerges to Tackle Tsunami of Real-Time Data

Only the most advanced companies have overcome the technical complexity involved with processing streaming data in real time. One of the vendors aiming to reduce this complexity and make stream data processing available Read more…

Hazelcast Platform to Bring Historical, Real-Time Data Together

Hazelcast is best known as a developer of in-memory data grid (IMDB) technology, a RAM-loving layer for speeding up operational applications. But with the Hazelcast Platform launch currently slated for September, the San Read more…

The Past and Future of In-Memory Computing

When Nikita Ivanov co-founded GridGain Systems back in 2005, he envisioned in-memory computing going mainstream and becoming a massive category unto itself within a few years. That obviously didn’t pan out, but on the Read more…

Stream Processing Is a Great Addition to Data Grid, Hazelcast Finds

In-memory data grids (IMDGs) historically have exceled in applications that require the fastest processing times and the lowest latencies. By adding a stream processing engine, called Jet, to its IMDG, Hazelcast is findi Read more…

Real-Time Data Streaming, Kafka and Analytics Part 3: Effective Planning for Data Streaming Improves Data Analytics

Data stream processing is defined as a system performing transformations for creating analytics on data inside a stream. In Part 1 of this series, we defined data streaming to provide an understanding of its importance. Read more…

Apache Flink Powers Cloudera’s New Streaming Analytics Product

Cloudera today launched Cloudera Streaming Analytics (CSA), a new subset of the Cloudera DataFlow (CDF) platform that is based on the Apache Flink stream processing engine. The new software runs on existing Hadoop cluste Read more…

Confluent Reveals ksqlDB, a Streaming Database Built on Kafka

Confluent narrowed the distance separating Kafka-esque stream data processing and traditional database technology with today’s unveiling of ksqlDB, a new database built atop Kafka that the company intends to be the fut Read more…

AI And Data Streaming In The Enterprise: A Marriage Made In Heaven?

As the adoption of artificial intelligence in the enterprise hits a decisive moment, it is worth examining its relationship with data streaming and how the two technologies share similar adoption challenges. Artificial I Read more…

Google Brings Kubernetes Operator for Spark to GCP

Those looking to run Apache Spark on clusters managed with Kubernetes will be interested in the new Spark operator for Kubernetes unveiled by Google today. The software, which is in beta, will be supported on the Google Read more…

Alibaba Acquires Apache Flink Backer data Artisans

Chinese Internet giant Alibaba Group has acquired data Artisans, the German company behind the Apache Flink data processing framework. Alibaba is one of the biggest users of Flink, and plans to continue developing and Fl Read more…

Apache Pulsar Goes Cloud Native

Apache Pulsar, the distributed messaging and storage system that emerged two years ago from Yahoo, joins the growing list of analytics tools being made available via the Kubernetes cluster orchestrator—in this case run Read more…

Red Hat Adds Kafka Streaming to OpenShift

Red Hat is adding data streaming capability to its OpenShift container platform with the addition of a distribution based on Apache Kafka. AMQ Streams is described as a high-end data streaming tool built on Kafka stre Read more…

Apache Pulsar Ready for Prime Time

A streaming and messaging system aimed at stream processing has been elevated from incubator to “top-level project” status by the Apache Foundation. Apache Pulsar was released as open source by Yahoo in 2016 and Read more…

Flink Delivers ACID Transactions on Streaming Data

The folks behind Apache Flink just delivered something you may not have realized you needed: ACID guarantees in a stream processing framework. According to data Artisans, its new Streaming Ledger offering could even repl Read more…

Agile Integration Comes to Microservices

As enterprises shift from the “waterfall” software development model to agile microservices architectures, integrators are offering new frameworks for easing the transition. Among them is WSO2, the open source integr Read more…

Streaming SQL for Real-Time Analytics

Streaming analytics is moving into the mainstream as more enterprises capitalize on the technology to gain greater efficiency, competitiveness, and profitability. In fact, the streaming analytics market will grow to $13. Read more…

Talend Unveils Free Data Streaming Solution

Talend today launched a data streaming solution based on Apache Beam that is free of charge for users. The company says Talend Data Streams makes it easy for non-technical users to build data pipelines in the AWS cloud t Read more…

How Netflix Optimized Flink for Massive Scale on AWS

When it comes to streaming data, it's tough to find a company operating on a more massive scale than Netflix, which streams more than 125 million hours of TV shows and movies --  per day. Netflix captures billions of pi Read more…

Older Entries
Datanami