Follow BigDATAwire:

Tag: stream processing

DeltaStream Dreams: Bringing Batch, Streaming, and Real-Time Together

Companies have long dreamed of a single data platform that can handle their real-time and batch data and workloads, without some clunky interface in between. However, unless your name is Uber or Netflix, you probably don Read more…

AI Agents and The Trust Equation: When Does Real-Time Data Matter Most?

As Artificial Intelligence (AI) evolves from offering suggestions to making autonomous decisions, organizations face a fundamental shift in their data requirements. This transition from exploratory AI to agentic AI—sys Read more…

Stream Processing at the Edge: Why Embracing Failure is the Winning Strategy

As a former network and storage systems administrator, it’s been amazing to watch the cloud abstract away the complexity of infrastructure. Managed services today allow enterprises to scale systems without needing to g Read more…

Ververica CEO Alex Walden Joins the Big Data Debrief

Ververica CEO Alex Walden knows a thing or two about streaming data. As the head of the leading commercial outfit behind Apache Flink, Walden has a front-row seat to witness the impact that stream data processing can hav Read more…

Confluent Goes On Prem with Apache Flink Stream Processing

Organizations that want to take advantage of Apache Flink’s class-leading stream processing capabilities but don’t want to run the setup in the cloud were given another option today when Confluent announced the gener Read more…

Using Streaming Data Applications to Power Decision-Making

How do businesses make timely decisions with efficiency? One approach uses streaming (real-time) data applications that collect, analyze, and offer insights about data as it is generated, as opposed to systems that store Read more…

Open Source Provides Path to Real-Time Stream Processing

Consumers expect immediate, personalized gratification. Real-time distributed stream processing enables companies to meet those expectations. However, many see the technology as being out of reach for all but the biggest Read more…

Five Drivers Behind the Rapid Rise of Apache Flink

In 2022 alone, a total of at least $55 million has been invested by venture capitalists into startups building companies around Apache Flink, the open source project that’s used to process data streams at large scale a Read more…

RisingWave Emerges to Tackle Tsunami of Real-Time Data

Only the most advanced companies have overcome the technical complexity involved with processing streaming data in real time. One of the vendors aiming to reduce this complexity and make stream data processing available Read more…

Hazelcast Platform to Bring Historical, Real-Time Data Together

Hazelcast is best known as a developer of in-memory data grid (IMDB) technology, a RAM-loving layer for speeding up operational applications. But with the Hazelcast Platform launch currently slated for September, the San Read more…

The Past and Future of In-Memory Computing

When Nikita Ivanov co-founded GridGain Systems back in 2005, he envisioned in-memory computing going mainstream and becoming a massive category unto itself within a few years. That obviously didn’t pan out, but on the Read more…

Stream Processing Is a Great Addition to Data Grid, Hazelcast Finds

In-memory data grids (IMDGs) historically have exceled in applications that require the fastest processing times and the lowest latencies. By adding a stream processing engine, called Jet, to its IMDG, Hazelcast is findi Read more…

Real-Time Data Streaming, Kafka and Analytics Part 3: Effective Planning for Data Streaming Improves Data Analytics

Data stream processing is defined as a system performing transformations for creating analytics on data inside a stream. In Part 1 of this series, we defined data streaming to provide an understanding of its importance. Read more…

Apache Flink Powers Cloudera’s New Streaming Analytics Product

Cloudera today launched Cloudera Streaming Analytics (CSA), a new subset of the Cloudera DataFlow (CDF) platform that is based on the Apache Flink stream processing engine. The new software runs on existing Hadoop cluste Read more…

Confluent Reveals ksqlDB, a Streaming Database Built on Kafka

Confluent narrowed the distance separating Kafka-esque stream data processing and traditional database technology with today’s unveiling of ksqlDB, a new database built atop Kafka that the company intends to be the fut Read more…

AI And Data Streaming In The Enterprise: A Marriage Made In Heaven?

As the adoption of artificial intelligence in the enterprise hits a decisive moment, it is worth examining its relationship with data streaming and how the two technologies share similar adoption challenges. Artificial I Read more…

Google Brings Kubernetes Operator for Spark to GCP

Those looking to run Apache Spark on clusters managed with Kubernetes will be interested in the new Spark operator for Kubernetes unveiled by Google today. The software, which is in beta, will be supported on the Google Read more…

Alibaba Acquires Apache Flink Backer data Artisans

Chinese Internet giant Alibaba Group has acquired data Artisans, the German company behind the Apache Flink data processing framework. Alibaba is one of the biggest users of Flink, and plans to continue developing and Fl Read more…

Apache Pulsar Goes Cloud Native

Apache Pulsar, the distributed messaging and storage system that emerged two years ago from Yahoo, joins the growing list of analytics tools being made available via the Kubernetes cluster orchestrator—in this case run Read more…

Red Hat Adds Kafka Streaming to OpenShift

Red Hat is adding data streaming capability to its OpenShift container platform with the addition of a distribution based on Apache Kafka. AMQ Streams is described as a high-end data streaming tool built on Kafka stre Read more…

BigDATAwire