AWS Looks to ‘Demystify’ Machine Learning
Amazon Web Services used a big data conference in the backyard of some of its largest government customers to showcase its AI and machine learning tools that are helping to funnel ever-larger volumes of data into its storage and computing infrastructure.
Making a pitch for better data management tools like metadata systems, AWS executives addressing a big data conference in Tysons Corner, Va., said the the public cloud giant aims to go beyond democratizing big data to “demystify” AI and machine learning.
The combination of organized data and analytics will accelerate the building and deployment of machine learning models, many that currently never make it to production. Those that are deployed often require up to 18 months to roll out, noted Ben Snively, a solution architect at AWS (NASDAQ: AMZN).
Open source tools for model development often advance a generation or two in the time it takes many enterprises to develop, train and launch a machine learning model, he added.
Snively asserted that the combination of big data and analytics along with AI and machine learning creates a “flywheel effect” in which organized, accessible data leads to faster insights, better products and—completing the cycle—more data.
(Hence, the cloud vendor forecasts as much as 180 zettabytes of widely varied and fast-moving data by 2025.)
As it seeks to demystify machine automation technologies and move beyond the current technology “hype phase,” AWS executives note that deployment of machine learning models and, eventually, full-blown platforms, remains hard. Among the reasons are “dirty” data that must be cleansed to foster access. The company estimates that 80 percent of data lakes currently lack metadata management systems that help determine data sources, formats and other attributes needed to wrangle big data.
That makes the heavy investments in data lakes “inefficient,” stressed Alan Halamachi, a senior manager for AWS solution architectures. “If data is not in a format where it can be widely consumed and accessible,” Halamachi stressed, machine learning developers will find themselves in “data jail.”
Once big data is wrangled and secured—“Hackers would like nothing more than to engineer a single breach with access to all of it,” Hamachi said—it can be combined with analytics on the inference side to accelerate training of machine learning models, Snively said.
Noting that most machine learning models built by enterprises never make it to production, the AWS engineers pitched several new tools including its SageMaker machine and deep learning stack introduced in November. Described as a tool for taking the “muck” out of developing machine learning models, Snively said Sagemaker is also designed to free data scientists from IT chores like standing up a server for model development.
The cloud giant is seeing more experimentation among its customers as they seek to connect big data with machine learning development. “Voice [recognition] systems are here to stay,” Snively asserted, and developers are investigating “new ways of interacting with those systems.”
“It’s really about demystifying AI and machine learning” and getting beyond the “magic box” phase, he added.
July 23, 2021
- Observable Introduces Data Visualization Stack for the Enterprise
- Collibra Named a Leader in Data Governance Solutions by Independent Research Firm
- Mindtech Raises $3.25M to Accelerate Growth of Synthetic Data Training Platform for AI Vision Systems
July 22, 2021
- LigaData Now Certified on Cloudera Data Platform
- Adobe Launches Adobe Analytics for Higher Education to Advance Digital Literacy
- Anaconda Releases 2021 State of Data Science Survey Results
- Alation Supports Next Generation of Data Enthusiasts, Provides Free Software and Training
- NASA Expands Access to Planet Data to All US Federal Civilian Agencies
- Google Cloud Announces Healthcare Data Engine to Enable Interoperability in Healthcare
July 21, 2021
- Deloitte, US Chamber of Commerce Report Highlights How Public Policy Can Enable Trustworthy AI
- WHO Issues First Global Report on AI in Health
- New Data Science Platform Speeds Up Python Queries
- Teradata Joins TM Forum to Support the Cloud Journeys of Global Communications Services Providers
- Confluent Named Google Cloud Technology Partner of the Year for Third Year in a Row
- Lucata Raises $11.9M Series B to Introduce Next-Gen Computing Platform
- Securonix Announces ‘Bring Your Own Snowflake’ Program to Power Security Data Lake for Snowflake Customers
- Rensselaer Team Aims to Pave Way for Robust AI in Medical Imaging
- Dremio Launches SQL Lakehouse Service to Accelerate BI and Analytics
- Spectra Logic, StorMagic Announce Active Archive Repository for Video Surveillance
- Quobyte Releases Hadoop Native Driver to Unlock the Power of Analytics, ML, Streaming
- Big Data File Formats Demystified
- Who’s Winning In the $17B AIOps and Observability Market
- Tuplex Gives Python UDFs a Performance Boost
- What’s the Difference Between AI, ML, Deep Learning, and Active Learning?
- Presto the Future of Open Data Analytics, Foundation Says
- The Data Mesh Emerges In Pursuit of Data Harmony
- Why Data Scientists and ML Engineers Shouldn’t Worry About the Rise of AutoML
- Composite AI: What Is It, and Why You Need It
- What’s Holding Us Back Now? ‘It’s the Data, Stupid’
- The Multiple Faces of Digital Twins
- More Features…
- Hiring, Pay for Data Science and Analytics Pros Picks Up Steam
- Starburst Backs Data Mesh Architecture
- Confluent Raises More Than $800M in IPO
- Off the Couch: Database Maker Seeks $160 Million In IPO
- Data Prep Still Dominates Data Scientists’ Time, Survey Finds
- Let It Go: The Financial Benefits of Data Deletion
- Global DataSphere to Hit 175 Zettabytes by 2025, IDC Says
- Teradata: We’ve Outsourced Some Hardware Support for Years
- Databricks Edges Closer to IPO with $1B Round
- Qumulo Debuts QaaS, a File Lake on the Azure Cloud
- More News In Brief…
- Splunk Launches New Security Cloud
- Red Hat Expands Workload Possibilities Across Hybrid Cloud with Latest Version of OpenShift
- JetBrains Announces Datalore Enterprise, Enabling Data Science Teams to Collaborate On-Prem
- Alluxio v2.6 Release Brings Performance, Ease of Use Improvements to AI/ML Workloads
- TigerGraph Expands Partner Ecosystem to Bring the Power of Graph to More Businesses
- MariaDB Collaborates with AWS to Deliver SkySQL on AWS
- DDN Selected by Bytesnet to Provide ‘Pay-Per-Use’ Storage for Data-Intensive Organizations
- Vertica Announces Vertica 11, Delivering on Vision of Unified Analytics
- Immuta Becomes First Data Access Control Solution for Snowflake Partner Connect
- Finalists Begin Building Projects for OpenCV AI Competition 2021
- More This Just In…
Sponsored Partner Content
August 25 @ 12:00 pm - 5:00 pm
November 29 - December 3
December 6 - December 10San Diego CA United States