Google Joins the MLOps Crusade
Machine learning developers face an expanded set of management issues beyond merely getting the code right, including the testing and validation of data used in ML models while handling an additional set of infrastructure dependencies. After deployment, those models will degrade over time as use cases evolve.
In response to growing calls for standardization of machine learning operations, cloud and tool vendors are promoting new services aimed at making life a bit easier for data scientists and machine learning developers. Among them is Google Cloud, which this week dropped a batch of cloud AI tools that include data pipelines, metadata and a “prediction backend” for automating steps in the MLOps workflow.
“Creating an ML model is the easy part—operationalizing and managing the lifecycle of ML models, data and experiments is where it gets complicated,” Craig Wiley, director of product management for Google’s cloud AI platform, noted in a blog post unveiling the MLOps services.
The “MLOps foundation” is perhaps the most compelling of the cloud AI tools unveiled this week by the public cloud and AutoML vendor (NASDAQ: GOOGL).
For starters, Google said Tuesday (Sept. 1) it would release a managed service for machine learning pipelines in October. Introduced earlier this year, the service uses pre-built TensorFlow components and templates to develop ML pipelines—a feature the company asserts would reduce the time and labor required to deploy and manage models.
Google noted that machine learning has complicated traditional DevOps practices such as continuous integration and delivery. ML models also require constant training and monitoring; the former for retraining candidate models for testing and deployment; the latter for error detection along with monitoring inference data and tracking the performance of production models.
“Our goal is to make machine learning act more like computer science so that it becomes more efficient and faster to deploy,” Wiley said.
The expanded AI platform also includes a machine language “metadata management” service designed to help developers monitor MLOps workflows and “model lineage.” Google said its metadata service is scheduled to preview by the end of September.
As for machine learning applications, the AI platform package also includes development tools for conversational AI applications such as chatbots and interactive voice response (IVR) bots. In one contact center AI use case, IVR bots can hand off customer service calls to live agents.
The development suite dubbed DialogflowCX provides app developers with access to machine learning models for natural language processing and text-to-speech. It also connects to telecom and cloud platforms, including, of course, Google’s.
The AI platform package also addresses the proliferation of internal MLOps systems among hyper-scalers like LinkedIn and Uber. Data science vendors such as Cloudera and Anaconda have noted that managing machine learning models in production has proven difficult due to “technology sprawl” and the relatively short shelf-life of production ML models.
Hence, MLOps advocates are seeking to place continuous model training and monitoring on the same plane as open source software and application interfaces.
Others such as Algorithmia are also offering MLOps suites with controls and features designed to monitor machine learning models in production.
October 26, 2020
- The Linux Foundation’s AI Foundation and ODPi Merge to Drive Open Source Collaboration
- LexisNexis InterAction and Foundation Software Group Partner to Help Firms Improve Business Development
- DNA Behavior Announces Launch of Next Gen Behavior Tech Stack Platform
- Oracle Expands Support for UK Public Sector with Dual-Region Government Cloud
- Millions of Users’ Unencrypted Location Data Being Shared with Twitter-Owned MoPub
- C3.ai, Microsoft and Adobe Combine Forces to Re-invent CRM with AI
October 23, 2020
- GoodData Adds Enhanced Self-Service Tools to Drive Business Intelligence Adoption
- IBM and R3 Collaborate to Expand Blockchain Capabilities and Services Across Hybrid Cloud
- Amperity and Zendesk to Help Brands Offer Customer Personalization
- Quantum Tape Systems Safeguard Scientific Data for British Antarctic Survey
October 22, 2020
- Minitab Launches Launches New Solutions to Help Organizations Accelerate Digital Transformation
- AccuWeather Sponsors Climate Change Machine Learning Research Competition at University of Toronto
- Precisely Delivers First End-to-End Data Integrity Suite for Confident Business Decisions
- Centerity Recognized for Market-Leading AIOps Platform with Integrated Cyber Security
- Protegrity Unveils Vision for the Secure AI Era
- Qlik Acquires Blendr.io to Drive Real-time Data into SaaS Applications and Automate Enterprise Processes
October 21, 2020
- The AA Executes Hybrid Cloud Strategy for Data Analytics with Actian’s Avalanche Cloud Data Warehouse
- Exasol and Nuqleous Join Up to Bring Data Analytics to Retail and Consumer Product Companies
- InterSystems Partners with AtScale on New Adaptive Analytics Within IRIS Data Platform
- YottaDB Announces Octo 1.0, a Plugin for Using SQL to Query Data
Most Read Features
- Big Data File Formats Demystified
- Systemic Data Errors Still Plague Presidential Polling
- Do You Need a Chief Data Scientist?
- Data Culture ‘Disconnect’ Identified in New Index
- How to Build a Better Machine Learning Pipeline
- VC Ben Horowitz Dishes on Hadoop, AI, and Data Culture
- How Geospatial Data Drives Insight for Bloomberg Users
- Is Python Strangling R to Death?
- 10 Big Data Statistics That Will Blow Your Mind
- Understanding Your Options for Stream Processing Frameworks
- More Features…
Most Read News In Brief
- Qubole is Latest Acquisition Target
- Testing Data Literacy on Main Street
- Informatica Likes Its Chances in the Cloud
- Pandemic Driving ‘Back to Basics’ in Big Data, Study Suggests
- TigerGraph Offers Free Graph Database for On-Prem Analysis
- Palantir Looks to Build on Snowflake’s IPO Success
- AI Startup Uses FPGAs to Speed Training, Inference
- Patchwork of Data Privacy Laws Sows Confusion
- Splunk Makes a Whirlwind of News at .conf20
- Researchers Demonstrate Less-than-One Shot Machine Learning
- More News In Brief…
Most Read This Just In
- Datanami Reveals Winners of Fifth Annual Readers’ and Editors’ Choice Awards
- Tableau Launches Free Data Literacy Training Program
- NASA, ICIJ, ATPCO, Lyft and More Choose Neo4j for their Knowledge Graphs
- Hazelcast to Provide Additional Capabilities to IBM Cloud Pak for Multicloud Management
- Fujitsu Enters Strategic Alliance with Palantir Technologies
- Collibra Launches New Partner Program
- Alida Integrates Stratifyd AI-powered Analytics Engine into New CXM Platform
- KNIME and H2O.ai Accelerate and Simplify End-to-end Data Science Automation
- Data Science Professor Receives $1.25 Million Grant from Department of Defense
- Nutanix Delivers Advanced Data Management Platform for Hybrid and Multicloud Environments
- More This Just In…