Follow Datanami:

Tag: Kafka

Apache Kafka Gains Traction Among Enterprise Users

The embrace of stream processing and real-time data access is driving enterprise adoption of the Apache Kafka distributed messaging system, according to an industry survey released at a Kafka summit this week. Conflue Read more…

Reporter’s Notebook: 6 Key Takeaways from Strata + Hadoop World

The big data ecosystem was on full display at last week's Strata + Hadoop World conference in San Jose. At the ripe old age of 10, Hadoop is still the driving force, but newer frameworks like Spark and Kafka are gaining Read more…

Distributed Stream Processing with Apache Kafka

We’re only three months into 2016, but it has been an exciting year in open source and big data. With a marked jump in growth, usage and queries on Apache Kafka (Redmonk), the demand for engineering and DevOps jobs req Read more…

Confluent Gives Kafka More Enterprise Chops

Confluent today unveiled a major new release of its commercial product based on Kafka, the open source data messaging platform that's quickly gaining momentum. With better security, new data connectors, and simplified in Read more…

MapR Introduces Streams to Compete with Kafka

MapR Technologies today unveiled MapR Streams, a new component of its integrated platform designed to move large amounts of data. MapR Streams uses the same publish-and-subscribe technique that underlies Apache Kafka, a Read more…

Teradata Puts Aster in Hadoop for IoT Analytics

The Internet of Things (IoT) is simultaneously a colossal data management challenge and the analytic opportunity of a lifetime. Teradata (NYSE: TDC) addressed both of those today with two product announcements, including Read more…

Kafka Tops 1 Trillion Messages Per Day at LinkedIn

There is data in motion, and then there is really big data in motion. The folks at LinkedIn gave us a compelling example of the latter today when it announced that it's using the distributed messaging system Kafka to pro Read more…

Hortonworks Boosts Streaming Analytics, IoT Plays with NiFi Deal

Hortonworks today announced a definitive agreement to acquire Onyara, the company behind the data routing and streaming technology called Apache NiFi. The Hadoop heavy also announced NiFi will be the basis for its second Read more…

Yahoo Casts Real-Time OLAP Queries with Druid

Yahoo is in the process of implementing a big data tool called Druid to power high-speed real-time queries against its massive Hadoop-based data lake. Engineers at the Web giant say the open source database's combination Read more…

Inside WebTrends’ Big Data Analytics Pipeline

WebTrends has been collecting and analyzing Web data on behalf of its customers since it was founded way back in 1993. Considering the exponenetial growth of the Net since then, it's not a stretch to say WebTrends was do Read more…

Wanted: A Plug-In Architecture for Hadoop Development

Hadoop is hard. There's just no way around that. Setting up and running a cluster is hard, and so is developing applications that make sense of, and create value from, big data. What Hadoop really needs now, says former Read more…

The Hadoop Behind Autodesk’s Cloud Ambitions

Autodesk is best known for AutoCAD, the powerful tool that architects and engineers use to design stuff on beefy workstations and PCs. But like most enterprise software companies, the cloud is beckoning for Autodesk in 2 Read more…

Why Kafka Should Run Natively on Hadoop

Apache Kafka has become an instrumental part of the big data stack at many organizations, particularly those looking to harness fast-moving data. But Kafka doesn't run on Hadoop, which is becoming the de-facto standard f Read more…

LinkedIn Spinoff Confluent to Extend Kafka

The LinkedIn team that built the Apache Kafka real-time messaging service has left to form a new company called Confluent. The startup said it would offer a "real-time data platform" built around Apache Kafka. Along w Read more…

LinkedIn Centralizing Data Plumbing with Kafka

As company data grows, so too grows the complexity of the data-stream. This can lead to a convoluted crisscross of specialized pipelines that don’t scale or play well with each other. Recently at the Hadoop Summit, engineer, Joel Koshy discussed how LinkedIn attacked this problem and built a real-time data pipeline that they manage to keep current across geography in their disparate datacenters. Read more…

Infochimps Leap to Open Source Branches

Open source projects like LinkedIn's Kafka and the Twitter-developed Storm have found a new home in the Infochimps tree. We spoke with the company's co-founder, Flip Kromer and their CEO, Jim Kaskade, about how these introduce performance and reliability, even among the clouds.... Read more…

Newer Entries
Datanami