Machine learning developers face an expanded set of management issues beyond merely getting the code right, including the testing and validation of data used in ML models while handling an additional set of infrastructure dependencies. After deployment, those models will degrade over time as use cases evolve.
In response to growing calls for standardization of machine learning operations, cloud and tool vendors are promoting new services aimed at making life a bit easier for data scientists and machine learning developers. Among them is Google Cloud, which this week dropped a batch of cloud AI tools that include data pipelines, metadata and a “prediction backend” for automating steps in the MLOps workflow.
“Creating an ML model is the easy part—operationalizing and managing the lifecycle of ML models, data and experiments is where it gets complicated,” Craig Wiley, director of product management for Google’s cloud AI platform, noted in a blog post unveiling the MLOps services.
The “MLOps foundation” is perhaps the most compelling of the cloud AI tools unveiled this week by the public cloud and AutoML vendor (NASDAQ: GOOGL).
For starters, Google said Tuesday (Sept. 1) it would release a managed service for machine learning pipelines in October. Introduced earlier this year, the service uses pre-built TensorFlow components and templates to develop ML pipelines—a feature the company asserts would reduce the time and labor required to deploy and manage models.
Google noted that machine learning has complicated traditional DevOps practices such as continuous integration and delivery. ML models also require constant training and monitoring; the former for retraining candidate models for testing and deployment; the latter for error detection along with monitoring inference data and tracking the performance of production models.
“Our goal is to make machine learning act more like computer science so that it becomes more efficient and faster to deploy,” Wiley said.
The expanded AI platform also includes a machine language “metadata management” service designed to help developers monitor MLOps workflows and “model lineage.” Google said its metadata service is scheduled to preview by the end of September.
As for machine learning applications, the AI platform package also includes development tools for conversational AI applications such as chatbots and interactive voice response (IVR) bots. In one contact center AI use case, IVR bots can hand off customer service calls to live agents.
The development suite dubbed DialogflowCX provides app developers with access to machine learning models for natural language processing and text-to-speech. It also connects to telecom and cloud platforms, including, of course, Google’s.
The AI platform package also addresses the proliferation of internal MLOps systems among hyper-scalers like LinkedIn and Uber. Data science vendors such as Cloudera and Anaconda have noted that managing machine learning models in production has proven difficult due to “technology sprawl” and the relatively short shelf-life of production ML models.
Hence, MLOps advocates are seeking to place continuous model training and monitoring on the same plane as open source software and application interfaces.
Others such as Algorithmia are also offering MLOps suites with controls and features designed to monitor machine learning models in production.
Recent items:
An Open Source Alternative to AWS SageMaker
Growing Focus on MLOps as AI Projects Stall
It’s Time for MLOps Standards, Cloudera Says
April 19, 2024
- Carahsoft to Showcase Cutting-Edge Solutions with 70+ Partners at GEOINT 2024
- BrainChip Highlights the 2nd Generation Akida at tinyML Summit 2024
- MathCo Named Microsoft Solutions Partner for Data and AI
- Salesforce Survey: Data Will Make or Break Workers’ Trust in AI
- Weights & Biases Announces Expanded Integration with NVIDIA NIM
- Dataminr Introduces ReGenAI to Enhance Real-Time Event Monitoring
- Cisco Reimagines Security for Data Centers and Clouds in Era of AI
- Gurucul Enhances Federated Search Capabilities Across Multiple Data Sources
- SAS-Sponsored Study Highlights Talent Shortages and Strategic Gaps in GenAI Adoption
- Redgate Launches Enterprise Edition of Redgate Monitor for Large-Scale Databases
April 18, 2024
- SAS Viya Expands Generative AI Capabilities with New Data Maker and Industry-Specific Assistants
- Moveworks Partners with Microsoft to Deliver Secure, Scalable Generative AI Solutions to Customers
- Rockset Announces 2024 Index Conference, Industry Event for Engineers Building Search, Analytics, and AI Applications at Scale
- SAS Advances Industry Solutions with Packaged AI Models
- Altair Acquires Cambridge Semantics, Powering Next-Gen Enterprise Data Fabrics and GenAI
- SAS Adds to Its Trustworthy AI Offerings with Model Cards and AI Governance Services
- Fujitsu and Oracle Collaborate to Deliver Sovereign Cloud and AI Capabilities in Japan
- Kore.ai Introduces Experience Optimization Platform V11.0, Accelerating AI Deployment
- Volumez Expands Collaboration with AWS, Joins ISV Accelerate Program
- AI Squared Raises $13.8M to Accelerate Widespread AI Adoption Within Organizations
Most Read Features
Sorry. No data so far.
Most Read News In Brief
Sorry. No data so far.
Most Read This Just In
Sorry. No data so far.
Sponsored Partner Content
-
Get your Data AI Ready – Celebrate One Year of Deep Dish Data Virtual Series!
-
Supercharge Your Data Lake with Spark 3.3
-
Learn How to Build a Custom Chatbot Using a RAG Workflow in Minutes [Hands-on Demo]
-
Overcome ETL Bottlenecks with Metadata-driven Integration for the AI Era [Free Guide]
-
Gartner® Hype Cycle™ for Analytics and Business Intelligence 2023
-
The Art of Mastering Data Quality for AI and Analytics
Sponsored Whitepapers
Contributors
Featured Events
-
Call & Contact Center Expo
April 24 - April 25Las Vegas NV United States -
AI & Big Data Expo North America 2024
June 5 - June 6Santa Clara CA United States -
AI Hardware & Edge AI Summit 2024
September 10 - September 12San Jose CA United States -
CDAO Government 2024
September 18 - September 19Washington DC United States