Follow Datanami:

Tag: Kafka

Confluent Reveals ksqlDB, a Streaming Database Built on Kafka

Nov 20, 2019 |

Confluent narrowed the distance separating Kafka-esque stream data processing and traditional database technology with today’s unveiling of ksqlDB, a new database built atop Kafka that the company intends to be the future of stream processing. Read more…

Kafka Transforming Into ‘Event Streaming Database’

Oct 1, 2019 |

Don’t look now, but Kafka is transforming into a database. That’s the new direction the popular event streaming platform is headed, according to Confluent CEO Jay Kreps keynote this morning, in which he gave a glimpse into new KSQL’s new “pull” Read more…

Neo4j Gets Hooks Into Kafka

Oct 1, 2019 |

Today at the Kafka Summit, Neo4j unveiled a new product called Neo4j Streams that will make it easier to connect streaming data from Apache Kafka with the company’s graph database. Read more…

When Not to Use a Database, As Told by Jun Rao

Oct 1, 2019 |

Databases are powerful abstractions that allow people and programs to manipulate large amounts of data in a predictable, repeatable way. There’s a good reason why SQL is so important to modern data processing. Read more…

Kafka Spawns Open-Source KarelDB

Sep 30, 2019 |

Apache Kafka and its accompanying key-value store are being used to provide persistent storage for a growing list of relational databases. Most used a key-value store as a foundation.

Among the latest to emerge is KarelDB, a relational database built almost entirely on open source components, including Apache Calcite for the SQL engine along with Apache Omid for transactions and control features. Read more…

Rockset Connects Kafka with SQL

Sep 27, 2019 |

Rockset, the serverless search and analytics startup, is extending the ability to run SQL on NoSQL data with real-time event analysis on Apache Kafka.

The company, based in San Mateo, Calif., said it is coming at the ingestion, analysis and serving of data from a different angle to allow users of the Kafka to run SQL analytics on raw data from the distributed streaming platform. Read more…

LinkedIn Unleashes ‘Nearline’ Data Streaming

Jul 22, 2019 |

LinkedIn is releasing its Brooklin data ingestion service to the open source community.

Brooklin has been running in production on the social media platform since 2016. The stateless and distributed service is used primarily for streaming data in near real time—also known as “nearline”—at scale. Read more…

Cassandra, Kafka Help Scale Anomaly Detection

Jun 3, 2019 |

The scaling of open-source platforms continues apace with the demonstration of an anomaly detection application capable of processing tens of billions of events per day using Apache Cassandra and Apache Kafka running on the Kubernetes container orchestrator. Read more…

What’s Behind Lyft’s Choices in Big Data Tech

May 10, 2019 |

Lyft was a late entrant to the ride-sharing business model, at least compared to its competitor Uber, which pioneered the concept and remains the largest provider. That delay in starting out actually gave Lyft a bit of an advantage in terms of architecting its big data infrastructure in the cloud, as it was able to sidestep some of the challenges that Uber faced in building out its on-prem system. Read more…

Real-Time Streaming for ML Usage Jumps 5X, Study Says

May 7, 2019 |

A new survey sponsored by Lightbend found that implementations of real-time stream data processing systems for machine learning and AI applications jumped by 500% over the past two years. It also found that Kafka is almost ubiquitous, that concerns about state handling must be addressed, and that containers are prime locations for fast data systems. Read more…

Do NOT follow this link or you will be banned from the site!