Google Joins the MLOps Crusade
Machine learning developers face an expanded set of management issues beyond merely getting the code right, including the testing and validation of data used in ML models while handling an additional set of infrastructure dependencies. After deployment, those models will degrade over time as use cases evolve.
In response to growing calls for standardization of machine learning operations, cloud and tool vendors are promoting new services aimed at making life a bit easier for data scientists and machine learning developers. Among them is Google Cloud, which this week dropped a batch of cloud AI tools that include data pipelines, metadata and a “prediction backend” for automating steps in the MLOps workflow.
“Creating an ML model is the easy part—operationalizing and managing the lifecycle of ML models, data and experiments is where it gets complicated,” Craig Wiley, director of product management for Google’s cloud AI platform, noted in a blog post unveiling the MLOps services.
The “MLOps foundation” is perhaps the most compelling of the cloud AI tools unveiled this week by the public cloud and AutoML vendor (NASDAQ: GOOGL).
For starters, Google said Tuesday (Sept. 1) it would release a managed service for machine learning pipelines in October. Introduced earlier this year, the service uses pre-built TensorFlow components and templates to develop ML pipelines—a feature the company asserts would reduce the time and labor required to deploy and manage models.
Google noted that machine learning has complicated traditional DevOps practices such as continuous integration and delivery. ML models also require constant training and monitoring; the former for retraining candidate models for testing and deployment; the latter for error detection along with monitoring inference data and tracking the performance of production models.
“Our goal is to make machine learning act more like computer science so that it becomes more efficient and faster to deploy,” Wiley said.
The expanded AI platform also includes a machine language “metadata management” service designed to help developers monitor MLOps workflows and “model lineage.” Google said its metadata service is scheduled to preview by the end of September.
As for machine learning applications, the AI platform package also includes development tools for conversational AI applications such as chatbots and interactive voice response (IVR) bots. In one contact center AI use case, IVR bots can hand off customer service calls to live agents.
The development suite dubbed DialogflowCX provides app developers with access to machine learning models for natural language processing and text-to-speech. It also connects to telecom and cloud platforms, including, of course, Google’s.
The AI platform package also addresses the proliferation of internal MLOps systems among hyper-scalers like LinkedIn and Uber. Data science vendors such as Cloudera and Anaconda have noted that managing machine learning models in production has proven difficult due to “technology sprawl” and the relatively short shelf-life of production ML models.
Hence, MLOps advocates are seeking to place continuous model training and monitoring on the same plane as open source software and application interfaces.
Others such as Algorithmia are also offering MLOps suites with controls and features designed to monitor machine learning models in production.
October 22, 2021
October 21, 2021
- Dremio Announces New Dart Initiative Release
- Hex Technologies Raises $16 Million Series A to Help Data Teams Do More
- 2021 GigaOm Radar Report for Data Warehouses Names Yellowbrick Data an Outperformer
- DataRobot Research Finds 86% of Organizations Prioritize AI and ML
- Terrafuse AI Launches New Platform to Visualize California Wildfire Risk
- New Relic Launches In-IDE Observability and Code Collaboration Experience
- KX Announces Launch of KX Academy On-Demand Training Portal
- KDD 2021 Celebrates Winning Teams of 25th Annual KDD Cup
- Global Survey Reveals 8 in 10 Companies Struggle to Unify Data Assets
October 20, 2021
- OctoML Announces Collaboration with Arm for ML Models
- VAST Data Introduces VASTOS Version 4
- DAS42 and AtScale Partner to Deliver Advanced Data Technology Solutions
- Iguazio MLOps Platform Now Supports Amazon FSx for NetApp ONTAP
- Credo AI Emerges from Stealth to Help Organizations Build Ethical AI
- Exxact Partners with SoftIron to Provide Ceph-Based Software Defined Storage Solutions
- TigerGraph, HPE, and Xilinx Announce Graph Analytics Solution for the Enterprise
October 19, 2021
- Quantum Announces Partnership with IBM for Next Generation of LTO Technology
- Scality Delivers Comprehensive Portfolio for Splunk SmartStore Deployments
- Splunk Announces Enhancements to its Enterprise Observability Portfolio
Most Read Features
- Google Cloud Gives Spanner a PostgreSQL Interface
- What Is Data Science? A Turing Award Winner Shares His View
- Big Data File Formats Demystified
- We’re In the Moneyball 3.0 Era. Here’s What It Means for Live Sports
- One on One with Google Cloud Product Director Irina Farooq
- What’s the Difference Between AI, ML, Deep Learning, and Active Learning?
- Who’s Winning In the $17B AIOps and Observability Market
- Composite AI: What Is It, and Why You Need It
- OpenTelemetry Gains Momentum as Observability Standard
- Five Real-World Applications for Sports Analytics
- More Features…
Most Read News In Brief
- Data and AI Salaries Continue Upward March, O’Reilly Says
- Bigeye Observes $45 Million in Funding
- Data Prep Still Dominates Data Scientists’ Time, Survey Finds
- Why Is SAS Going Public?
- Gartner Shuffles the Technology Deck with Latest ‘Hype Cycle’ Report
- LinkedIn Open Sources Tech Behind 10,000-Node Hadoop Cluster
- Feature Stores Emerging as Must-Have Tech for Machine Learning
- The Next Breakthrough in Long-Term Data Storage is….Gold?
- Sisu Nabs $62M to Grow Data Analytics Biz
- Here’s What Splunk Announced Today at .conf21
- More News In Brief…
Most Read This Just In
- Esri Releases ArcGIS GeoBIM, Bringing Spatial Context to AEC Operations
- Databricks Acquires Low-code/No-code Company to Expand its Lakehouse Platform
- PrivaceraCloud 4.0 Enables Governed Data Sharing Across the Open Cloud
- BriefCam Introduces Video Analytics Enabled on Deep Learning Cameras from Axis Communications
- NetApp to Acquire CloudCheckr and Expand its Spot by NetApp CloudOps Platform
- Dremio Announces New Dart Initiative Release
- MicroAI to Bring AI Training to Renesas MCUs
- TIBCO Delivers a Comprehensive, Connected Platform for the Adaptable Digital Business
- OneTrust Enhances First-Party Data Solution to Strengthen Holistic Consent and Preference Management Platform
- Datatron Awarded U.S. Patent for Methodology for Modeling Machine Learning and Analytics
- More This Just In…
Sponsored Partner Content
October 27 - October 28
November 29 - December 3
December 6 - December 10San Diego CA United States
February 7, 2022 - February 9, 2022Houston TX United States
June 26, 2022 - June 30, 2022Hollywood FL United States