Apache Pulsar Goes Cloud Native
Apache Pulsar, the distributed messaging and storage system that emerged two years ago from Yahoo, joins the growing list of analytics tools being made available via the Kubernetes cluster orchestrator—in this case running on the Google Cloud Platform.
Cloud access to Pulsar via Kubernetes comes courtesy of startup Streamlio’s real-time streaming analytics platform running on top of Apache Pulsar. The company said this week the latest version of its platform leverages Pulsar for cloud-native application management using the Google Kubernetes Engine.
Streamlio, founded in 2017 by the architects who created Apache Pulsar, said the new cloud analytics platform reflects the shift away from batch to real-time processing, enabling users to analyze data as it arrives. Meanwhile, the transition to cloud-native microservices and application containers is boosting demand for emerging tools like Pulsar, proponents say.
Apache Pulsar was released as open source by Yahoo in 2016 and has since been promoted by its creators who went on to form Streamlio. The Apache Foundation released the 2.0 version of Apache Pulsar in June, elevating it to operational status. Promoters note that the publish-and-subscribe messaging system has run in production at Yahoo for more than three years, delivering millions of messages per second across a myriad of topics.
Along with Apache Pulsar, Streamlio’s platform is built upon two other big data frameworks: Apache Heron, the real-time analytics system that emerged from Twitter (NYSE: TWTR); and Apache BookKeeper, a scalable storage system.
Integrating the three frameworks into an “open core” with a proprietary user interface on top is intended to reduce operational complexity and risk that enterprise users would otherwise encounter if attempting to combine the technologies on their own, the company recently told Datanami.
Streamlio, Palo Alto, Calif., said Tuesday (Dec. 11) the community edition of its data platform is available now on the Google (NASDAQ: GOOG) cloud marketplace.