Follow Datanami:

Tag: real-time streaming

Open Source Provides Path to Real-Time Stream Processing

Consumers expect immediate, personalized gratification. Real-time distributed stream processing enables companies to meet those expectations. However, many see the technology as being out of reach for all but the biggest Read more…

Is Real-Time Streaming Finally Taking Off?

Like commercial fusion reactors, real-time streaming is a tantalizing technology, but one that perpetually needs just a few more years (or decades) of R&D. But some in the industry are sensing that something has shif Read more…

Kx Systems: A Historical Need for Speed

There are a few things that Kx Systems is not. It’s not a new company, for starters, and it’s not a big supporter of open source technology. But if there’s one thing that defines Kx Systems and its approach to help Read more…

Confluent Goes ‘Infinite’ with Kafka Cloud Storage

Companies that want to store oodles of event data in Kafka but don’t want to pay oodles of dollars may be interested in the new “infinite storage” option unveiled today by Confluent. The Kafka company says the new Read more…

Streaming Analytics: The Silver Bullet for Predictive Business Decisions

Streaming analytics has become an indispensable tool for companies to gain precise insights into their current business information from their ever-growing volumes of data. But is the high-performance streaming technolog Read more…

Top Four Features in Confluent Platform 5.4

Apache Kafka sits at the heart of the Confluent Platform, but the platform is much more than just Kafka. And with today’s launch of Confluent Platform version 5.4. the system gets more features demanded by enterprises, Read more…

Understanding Your Options for Stream Processing Frameworks

Real-time stream processing isn't a new concept, but it's experiencing renewed interest from organizations tasked with finding ways to quickly process large volumes of streaming data. Luckily for you, there are a handful Read more…

Water Co. Exploring Use of ML to Detect Quality Issues

Everybody expects to have clean drinking water. But as the lead crises in Michigan has shown, that's not always the case. Now American Water, the largest publicly traded water company in the country, is actively research Read more…

DataOps Hiring Surges Thanks to ML, Real-Time Streaming

Nearly three-quarters of companies plan to hire a data operations (DataOps) professional in 2018, according to a new survey commissioned by Nexla, which says investment and interest in machine learning, artificial intell Read more…

Six Reasons Why Enterprises Need a Modern Data Integration Architecture

Data is instigating change and giving rise to a new data-driven economy that is still in its infancy. Organizations across industries increasingly recognize that monetizing data is crucial to maintaining a competitive ed Read more…

Streamlio Claims Pulsar Performance Advantages Over Kafka

Streamlio, a startup created a real-time streaming analytics platform on top of Apache Pulsar and Apache Heron, today published results of stream processing benchmark that claims Pulsar has up to a 150% performance impro Read more…

Fueled by Kafka, Stream Processing Poised for Growth

Once a niche technique used only by the largest organizations, stream processing is emerging as legitimate technique for dealing with massive amounts of data generated every day. While it's not needed for every data chal Read more…

The SQL Service at the Heart of Amazon Kinesis Analytics

Amazon Web Services gave real-time application developers a boost last week when it unveiled Amazon Kinesis Analytics, a new service for continuously querying streaming data using good old SQL. The service hooks into the Read more…

Concord Claims 10x Performance Edge on Spark Streaming

Organizations that are looking for a stream processing engine upon which to build fast data applications featuring high-throughput and low-latency may want to check out Concord, a new framework that emerged from the ad-t Read more…

Merging Batch and Stream Processing in a Post Lambda World

It wasn't long ago that developers looked to the Lamba architecture for hints on how to design big data applications that needed elements of both batch and streaming data. But already, the Lamba architecture is falling o Read more…

The Real-Time Rise of Apache Kafka

Shiny new objects are easy to find in the big data space. So when the industry's attention shifted towards processing streams of data in real time--as opposed to batch-style processing that was popular with first-generat Read more…

Reporter’s Notebook: 6 Key Takeaways from Strata + Hadoop World

The big data ecosystem was on full display at last week's Strata + Hadoop World conference in San Jose. At the ripe old age of 10, Hadoop is still the driving force, but newer frameworks like Spark and Kafka are gaining Read more…

Apache Flink Creators Get $6M to Simplify Stream Processing

Real-time stream processing is one of the hottest topics this week at Strata + Hadoop World, and one of the new frameworks turning heads is Apache Flink. Developed by the German company data Artisans, Flink is unique in Read more…

Confluent Gives Kafka More Enterprise Chops

Confluent today unveiled a major new release of its commercial product based on Kafka, the open source data messaging platform that's quickly gaining momentum. With better security, new data connectors, and simplified in Read more…

MapR Introduces Streams to Compete with Kafka

MapR Technologies today unveiled MapR Streams, a new component of its integrated platform designed to move large amounts of data. MapR Streams uses the same publish-and-subscribe technique that underlies Apache Kafka, a Read more…

Datanami