Apache Beam Cuts Processing Time 94% for LinkedIn

Like many large companies, LinkedIn relied on the Lamba architecture to run separate batch and streaming workloads, with a form of reconciliation at the end. After implementing Apache Beam, it was able to combine batch a Read more…

To Improve Data Availability, Think ‘Right-Time’ Not ‘Real-Time’

To improve data quality, cost, and access to information, streaming should be a central component of all data infrastructure, regardless of “real-time” adoption. When defining their data strategy, organizations ofte Read more…

Merging Batch and Stream Processing in a Post Lambda World

It wasn't long ago that developers looked to the Lamba architecture for hints on how to design big data applications that needed elements of both batch and streaming data. But already, the Lamba architecture is falling o Read more…