Google Joins the MLOps Crusade
Machine learning developers face an expanded set of management issues beyond merely getting the code right, including the testing and validation of data used in ML models while handling an additional set of infrastructure dependencies. After deployment, those models will degrade over time as use cases evolve.
In response to growing calls for standardization of machine learning operations, cloud and tool vendors are promoting new services aimed at making life a bit easier for data scientists and machine learning developers. Among them is Google Cloud, which this week dropped a batch of cloud AI tools that include data pipelines, metadata and a “prediction backend” for automating steps in the MLOps workflow.
“Creating an ML model is the easy part—operationalizing and managing the lifecycle of ML models, data and experiments is where it gets complicated,” Craig Wiley, director of product management for Google’s cloud AI platform, noted in a blog post unveiling the MLOps services.
The “MLOps foundation” is perhaps the most compelling of the cloud AI tools unveiled this week by the public cloud and AutoML vendor (NASDAQ: GOOGL).
For starters, Google said Tuesday (Sept. 1) it would release a managed service for machine learning pipelines in October. Introduced earlier this year, the service uses pre-built TensorFlow components and templates to develop ML pipelines—a feature the company asserts would reduce the time and labor required to deploy and manage models.
Google noted that machine learning has complicated traditional DevOps practices such as continuous integration and delivery. ML models also require constant training and monitoring; the former for retraining candidate models for testing and deployment; the latter for error detection along with monitoring inference data and tracking the performance of production models.
“Our goal is to make machine learning act more like computer science so that it becomes more efficient and faster to deploy,” Wiley said.
The expanded AI platform also includes a machine language “metadata management” service designed to help developers monitor MLOps workflows and “model lineage.” Google said its metadata service is scheduled to preview by the end of September.
As for machine learning applications, the AI platform package also includes development tools for conversational AI applications such as chatbots and interactive voice response (IVR) bots. In one contact center AI use case, IVR bots can hand off customer service calls to live agents.
The development suite dubbed DialogflowCX provides app developers with access to machine learning models for natural language processing and text-to-speech. It also connects to telecom and cloud platforms, including, of course, Google’s.
The AI platform package also addresses the proliferation of internal MLOps systems among hyper-scalers like LinkedIn and Uber. Data science vendors such as Cloudera and Anaconda have noted that managing machine learning models in production has proven difficult due to “technology sprawl” and the relatively short shelf-life of production ML models.
Hence, MLOps advocates are seeking to place continuous model training and monitoring on the same plane as open source software and application interfaces.
Others such as Algorithmia are also offering MLOps suites with controls and features designed to monitor machine learning models in production.
September 29, 2020
- PyTorch / XLA now generally available on Cloud TPUs
- Data Science to Accelerate Drug Discovery with Artificial Intelligence and Machine Learning, Says Frost & Sullivan
- DDN Tops the Ratings in Intersect360 User Survey for Technical and Operational Satisfaction and Future Vision for Storage
- New Denodo Platform 8.0 Accelerates Hybrid/Multicloud Integration, Automates Data Management with AI/ML, and Boosts Performance
- Intel Enters into Strategic Collaboration with Lightbits Labs
- Pepperdata Announces Query Spotlight Now Supports Apache Impala
- Oracle Helps Marketers Simplify the Management and Activation of Customer Data
- Datadobi Launches Pre-Migration Assessment Service
- Signals Analytics Awarded Wide-Ranging Patent Grant for Automatic Extraction of Information from Unstructured Data Sources
September 28, 2020
- Cohesity Announces Automated Disaster Recovery that Minimizes Application Downtime and Data Loss
- DataStax Co-Founder and CTO Jonathan Ellis to Keynote at ApacheCon 2020 on Open Source in the Cloud Era with DataStax Astra and Apache Cassandra
September 25, 2020
- PostgreSQL 13 Released: Performance Gains, Space Savings, Enhanced Security, Developer Experience
- WANdisco Announces Global Agreement with Infosys to De-Risk and Accelerate Data Lake Migration to the Cloud
- Matillion Partner Ecosystem Identifies Trends Driving Data Transformation Market
- TIBCO Simplifies Data Unification With TIBCO Any Data Hub
- Trifacta Named Leader in G2’s Fall Grid Report for Data Preparation
- Seagate’s New Solutions Equip Enterprises for the New Data Economy
September 24, 2020
- Spectra Logic Announces Industry’s First Tape Library to Store One Exabyte of Uncompressed Data Leveraging LTO-9 Technology
- QDA Miner 6 Powers Businesses with New Qualitative Analysis Capabilities
- Cambridge Semantics Appoints Brian D. Owen as Chief Executive Officer
Most Read Features
- How Facebook Accelerates SQL at Extreme Scale
- 10 Big Data Statistics That Will Blow Your Mind
- Big Data File Formats Demystified
- VC Ben Horowitz Dishes on Hadoop, AI, and Data Culture
- Microsoft Now Developing Its Own Hadoop
- How to Build a Better Machine Learning Pipeline
- The CDO’s Role in Leading Data-Driven Transformation
- How the Coronavirus Response Is Aided by Analytics
- The Future of Labor in an AI World
- Is Python Strangling R to Death?
- More Features…
Most Read News In Brief
- Snowflake to Make it SNOW on NYSE
- Aerospike Gives Legacy Infrastructure a Real-Time Boost
- Google Joins the MLOps Crusade
- A ‘Breakout Year’ for ModelOps, Forrester Says
- Snowflake Pops in ‘Largest Ever’ Software IPO
- New AI Tool Maps the Families of the Bible, A Song of Ice and Fire
- Microsoft Launches Spatial Analytics, Other AI Services at Ignite
- Air Force Expands Predictive Maintenance
- Cassandra Gets an Indexing Upgrade
- Fivetran Launches Pay-As-You-Go Option for ETL
- More News In Brief…
Most Read This Just In
- Monte Carlo Raises $16M to Build the World’s First Data Reliability Platform
- Talend Introduces Industry-First Measure of Data Health to Bring Clarity and Confidence to Every Business Decision
- Tabor Communications, Inc. Announces Expansion of the Editorial Team
- ScyllaDB Unveils One-Step Migration from Amazon DynamoDB to Scylla NoSQL Database
- IBM Cognos Analytics-Based Business Transformation Going Strong
- Tamr Data Mastering Platform Now Available on Microsoft Azure
- Scality RING8 on All-Flash Delivers File and Object Storage Performance 10x Faster Than Competitive Solutions
- Domino Data Lab Named a Leader in Notebook-Based Predictive Analytics and Machine Learning Evaluation by Global Research Firm
- Yugabyte Announces Speaker Lineup for Distributed SQL Summit 2020
- Kinetica Releases New Version of The Kinetica Streaming Data Warehouse Platform
- More This Just In…