cnvrg.io Releases New Streaming Endpoints Solution

TEL AVIV, Israel, May 26, 2020 — cnvrg.io announced its streaming endpoints solution, a new capability for deploying ML models to production with Apache Kafka in one click. cnvrg.io is the first ML platform to enable one click streaming endpoint deployment for large-scale and real-time predictions with high throughput and low latency.

85% of machine learning models don’t get to production due to the technical complexity of deploying the model in the right environment and architecture. Models can be deployed in a variety of different ways. Batch deployment for offline inference and web service for more real-time scenarios. These two approaches cover most of the ML use cases, but they both fall short in an enterprise setting when you need to scale and stream millions of predictions in real time. Enterprises require fast, scalable predictions to execute critical and time sensitive business decisions.

cnvrg.io is thrilled to announce its new capability of deploying ML models to production with a streaming architecture of producer/consumer interface with native integration to Apache Kafka and AWS Kinesis. In just one click, data scientists and engineers can deploy any kind of model as an endpoint that can receive data as stream and output predictions as streams.

Deployed models will be tracked with advanced model management and model monitoring solutions including alerts, retraining, A/B testing and canary rollout, autoscaling and more.

This new capability allows engineers to support and predict millions of samples in a real-time environment. This architecture is ideal for time sensitive or event-based predictions, recommender systems, and large-scale applications that require high throughput, low latency and fault tolerant environments.

“Playtika has 10 million daily active users (DAU), 10 billion daily events and over 9TB of daily processed data for our online games. To provide our players with a personalized experience, we need to ensure our models run at peak performance at all times,” says Avi Gabay, Director of Architecture at Playtika. “With cnvrg.io we were able to increase our model throughput by up to 50% and on average by 30% when comparing to RESTful APIs. cnvrg.io also allows us to monitor our models in production, set alerts and retrain with high-level automation ML pipelines.”

The new cnvrg.io release extends the market footprint and enhances the prior announcements of NVIDIA DGX-Ready partnership and Red Hat unified control plane.

About cnvrg.io

cnvrg.io is an AI OS, transforming the way enterprises manage, scale and accelerate AI and data science development from research to production. The code-first platform is built by data scientists, for data scientists and offers unrivaled flexibility to run on-premise or cloud.

Source: cnvrg.io