Follow Datanami:

Tag: Kafka

Kafka Gets Streaming SQL Engine, KSQL

Confluent today unveiled KSQL, a SQL engine for Apache Kafka designed to enable users to run continuous interactive SQL queries on streaming data. The new software, which is currently in developer preview, will lower the Read more…

How Kafka Helped Rabobank Modernize Alerting System

Customers of Rabobank now receive alerts on bank account activity in a matter of seconds, as opposed to the hours it would take with its existing transactional platform, and it's all because of the speed and simplicity o Read more…

Hortonworks Shifts Focus to Streaming Analytics

Hortonworks started life providing a Hadoop distribution that allowed customers to process big data at rest. But these days, the company has shifted its much of its attention and resources to streaming analytics, or proc Read more…

Application Management Gets Unraveled

It's all about enterprise applications, we are told, with big data apps among the most critical. Hence, a growing focus on managing application performance has fueled new monitoring approaches such as operational data sc Read more…

Google/ASF Tackle Big Computing Trade-Offs with Apache Beam 2.0

Trade-offs are a part of life, in personal matters as well as in computers. You typically cannot have something built quickly, built inexpensively, and built well. Pick two, as your grandfather would tell you. But appare Read more…

Confluent Moves Kafka to the Cloud

As adoption of the Apache Kafka accelerates, the company behind the data pipeline is rolling a cloud service designed to boost "developer velocity" while IT operations are handled in the background. Confluent said Mon Read more…

The Real-Time Future of ETL

We're on the cusp of a huge uptick in data generation thanks to the IoT, but most of that data will never be landed in a central repository or stored for any length of time. To get a handle on this morass of data, enterp Read more…

Kafka ‘Massively Simplifies’ Data Infrastructure, Report Says

What's behind the rapid rise in Apache Kafka? According to a new survey of Kafka users by Confluent, the commercial venture behind Kafka, the data pipeline's capability to "massively simplify" the IT infrastructure of en Read more…

Masking Technical Complexity in the Security Data Lake

Today's growing cybersecurity threat demands a sophisticated response, one that increasingly involves the utilization of big data technologies like parallel file systems and machine learning. However, some security exper Read more…

Iguazio Re-Architects the Stack for Continuous Analytics

When it comes to modern big data architectures, you will typically find lots of different components, engines, and moving parts, each of which tackles part of the problem. One vendor with bold vision of re-architecting t Read more…

MapR Extends Its Platform to the Edge

MapR Technologies today unveiled MapR Edge, an extension of its converged data platform that lets customers install MapR nodes practically anywhere they want. The new offering runs on small portable PCs like the Intel Read more…

Hadoop Has Failed Us, Tech Experts Say

The Hadoop dream of unifying data and compute in a distributed manner has all but failed in a smoking heap of cost and complexity, according to technology experts and executives who spoke to Datanami. "I can't find a Read more…

2017 Is the Year of AI. Or Is It?

The media often likes to proclaim "The Year of This" or "The Year of That." With the greater attention given to advancing capabilities in artificial intelligence and machine learning, it seemed like a no-brainer to decla Read more…

Can Big Data Tame the Chaos of Virtualized IT?

The "software-defined" revolution is driving private data centers toward AWS-like efficiency. However, the virtualization of hardware, storage, and networking—not to mention agile coding techniques and a rapid-fire "De Read more…

Yelp Open Sources Data Pipeline That Saved It $10M

Yelp today open sourced a key piece of code that helped it migrate from a monolithic code base to a distributed services-based architecture. Called Data Pipeline, the Python-based product saved the crowd-sourced review w Read more…

Why Data Science is a Team Sport at AOL

As the world's fifth largest digital advertising network, AOL chews through a lot of data. That's not surprising. What may surprise you, however, is the unconventional way that the company goes about assembling its data Read more…

Converged Platform or Federated Data Plane? The Debate Heats Up

"Bring the compute to the data." That was Hadoop's calling card and solution for the problem of moving big data. However, the rise of cloud repositories and streaming technologies is causing Hadoop distributors to questi Read more…

MemSQL Delivers an ‘Exactly Once’ Real-Time Pipeline

MemSQL today unveiled a new release of its in-memory relational database that can process a real-time flow of messages from Apache Kafka using "exactly once" semantics. The NewSQL database accomplished the feat by creati Read more…

Investments in Fast Data Analytics Surge

Companies are quickly ramping up their investments fast data analytics and real-time stream processing frameworks and lowering spending on batch technologies in an attempt to get on top of growing data volumes and veloci Read more…

Merging Batch and Stream Processing in a Post Lambda World

It wasn't long ago that developers looked to the Lamba architecture for hints on how to design big data applications that needed elements of both batch and streaming data. But already, the Lamba architecture is falling o Read more…

Datanami