Follow Datanami:

Tag: Kafka

What’s Behind Lyft’s Choices in Big Data Tech

May 10, 2019 |

Lyft was a late entrant to the ride-sharing business model, at least compared to its competitor Uber, which pioneered the concept and remains the largest provider. That delay in starting out actually gave Lyft a bit of an advantage in terms of architecting its big data infrastructure in the cloud, as it was able to sidestep some of the challenges that Uber faced in building out its on-prem system. Read more…

Real-Time Streaming for ML Usage Jumps 5X, Study Says

May 7, 2019 |

A new survey sponsored by Lightbend found that implementations of real-time stream data processing systems for machine learning and AI applications jumped by 500% over the past two years. It also found that Kafka is almost ubiquitous, that concerns about state handling must be addressed, and that containers are prime locations for fast data systems. Read more…

Data Engineering Continues to Move the Employment Needle

Mar 5, 2019 |

Interested in a career in big data? You could do well by investing your time and effort in acquiring data science skills. But you may do even better by turning yourself into a data engineer, which is a title that continues to see substantial demand in the job market. Read more…

Want Kafka on Kubernetes? Confluent Has It Made

May 3, 2018 |

If the idea of streaming massive amounts of data on a virtual server platform that spans public cloud and on-premise clusters piques your interest, you’re not alone. Many organizations have attempted to wire Apache Kafka to run on the Kubernetes cluster manager, but it’s a challenging technical feat that few have succeeded at. Read more…

Confluent Adds KSQL Support to Kafka Platform

Mar 7, 2018 |

The latest version of Confluent’s Kafka-based platform incorporates an open source streaming engine for Apache Kafka designed to allow developers using SQL to build real-time, streaming applications.

Confluent, the company behind open source Kafka and developer of the Confluent Platform, announced the general availability of its KSQL streaming engine on Wednesday (March 7). Read more…

Streamlio Claims Pulsar Performance Advantages Over Kafka

Mar 6, 2018 |

Streamlio, a startup created a real-time streaming analytics platform on top of Apache Pulsar and Apache Heron, today published results of stream processing benchmark that claims Pulsar has up to a 150% performance improvement over Apache Kafka. Read more…

Weighing Open Source’s Worth for the Future of Big Data

Feb 26, 2018 |

The open source software movement began in earnest 20 years ago, when a group of technology leaders in Silicon Valley coined the term as an alternative to the repugnant “free software.” Read more…

DataTorrent Glues Open Source Componentry with ‘Apoxi’

Feb 22, 2018 |

Building an enterprise-grade big data application with open source components is not easy. Anybody who has worked with Apache Hadoop ecosystem technology can tell you that. But the folks at DataTorrent say they’ve found a way to accelerate the delivery of secure and scalable big data applications with Apoxi, a new framework they created to stitch together major open source components like Hadoop, Spark, and Kafka, in an extensible and pluggable fashion. Read more…

Fueled by Kafka, Stream Processing Poised for Growth

Jan 18, 2018 |

Once a niche technique used only by the largest organizations, stream processing is emerging as legitimate technique for dealing with massive amounts of data generated every day. While it’s not needed for every data challenges, organizations are increasingly finding ways to incorporate stream processing into their plans — Read more…

Attunity Relishes Role as Connective Tissue for Big Data

Oct 18, 2017 |

In the big data world, there are a few patterns that repeat themselves over and over again. One of those is the need to move data from one place to another. Read more…

Do NOT follow this link or you will be banned from the site!