It’s that time of year again – time for predictions! Thank you for patiently waiting while Datanami compiled 2021 predictions from the assorted predicters. We’ll kick things off with predictions about a most pertinent topic: data science.
If there’s one thing that the COVID-19 pandemic in 2020 made clear, it’s that organizations are relying on data more than ever before. To get the most out of that data, shops are going to need to increase their spending on data science, argues Domino Data Lab CEO Nick Elprin.
“Organizations are making dramatic budget cuts in many areas in an effort to overcome the effects of COVID-19 and keep their business viable,” Elprin says. “Yet, in 2021 we predict that many will sustain or actually increase their investment in data science to help drive the critical business decisions that may literally make the difference between survival and liquidation.”
You will see more people with the title of chief data scientist (CDS), says Ira Cohen, who is the co-founder and (naturally) CDS at Anodot. In fact, Cohen says that, by 2022, 90% of large global companies will have a CDS in place. CDSs will also allocate their time differently in 2021. “Fifty percent will be more focused on value creation and revenue generation while 28% will focus on cost savings and 22% on risk mitigation,” he says.
Josh Patterson, the senior director of RAPIDS engineering at Nvidia, says 2021 will bring empowerment to data scientists.
“For too long, enterprise data scientists have been relegated to sampling data or only pre-production development. People with titles such as data engineer and machine learning engineer are the ones who scale workflows into production, often translating code from Python to Java,” Patterson says. In 2021, “data scientists will be able to process massive amounts of data quickly, drastically reducing the need to have code translators.”
Alan Jacobson, chief data and analytics officer at Alteryx, is bullish on the potential to upskill data analysts into full-blown data scientists.
“While it is always important for companies to offer training to employees, the fields of data science and digital transformation are challenging companies to break the mold and deliver new and constantly evolving ways to upskill and deliver ROI” Jacobson says. “Data science has evolved to the point where people don’t need to go back to college to learn. They’ll learn on the job or while at home by encountering new tools and technologies. And with a huge shortage of those with analytic skills, many will start new jobs and careers based on the new skills.”
Tracking changes in data generated by SaaS-based business applications will be the feedstock for more intelligent AI and machine learning, says Joe Gaska, CEO of GRAX.
“Organizations with a focus on artificial intelligence and machine learning will continue to hunger for meaningful training datasets that can be fed into their ML algorithms to spot cause-and-effect change patterns over time,” Gaska says. “To do this, they will turn to their ever-changing datasets in 3rd party cloud/SaaS applications as inputs into these algorithms. This will create pressure for them to capture and ingest every single change in that data over time into their DataOps ecosystem.”
Rachel Roumeliotis, vice president of AI and data content at O’Reilly Media, says machine learning operations, or MLOps, will be important in 2021, as organizations look to connect the last mile in data science.
“ML presents a problem for CI/CD for several reasons,” she writes. “The data that powers ML applications is as important as code, making version control difficult; outputs are probabilistic rather than deterministic, making testing difficult; training a model is processor intensive and time consuming, making rapid build/deploy cycles difficult. None of these problems are unsolvable, but developing solutions will require substantial effort over the coming years.”
Instead of spending time and money building machine learning systems, in 2021, organizations will take a big step forward in terms of using ML systems, says Clemens Mewald, director of product management for machine learning and data science at Databricks.
“In the future, we’ll see enterprise customers moving away from building their own machine learning platforms, recognizing that it’s not their core competency,” Mewald says. “They’ll realize that more value comes from applying ML to business problems versus spending the time to build and maintain the tools themselves.”
We’re still a ways from having intelligent AI robots walking among us. But the conjunction of neuroscience and data science is a rich playground for new ideas, says Biju Dominic, the chief evangelist at Fractal Analytics and chairman at FinalMile Consulting.
“As AI makes rapid strides into unsupervised learning, one-shot learning, and artificial general intelligence, the field will seek inspiration and validation from system neuroscience and computational neuroscience,” Dominic says. “The interaction between the fields of AI and neuroscience will help the rapid growth of both these fields of knowledge.”
Here is a very specific data science prediction from James Bednar, senior manager of technical consulting at Anaconda: Python data visualization libraries will synch up.
“We’re finally starting to see Python data visualization libraries work together, and this work will continue in 2021,” Bednar says. “Python has had some really great visualization libraries for years, but there has been a lot of variety and confusion that make it difficult for users to choose appropriate tools. Developers at many different organizations have been working to integrate Anaconda-developed capabilities like Datashader’s server-side big data rendering and HoloViews’ linked brushing into a wide variety of plotting libraries, making more power available to a wider user base and reducing duplication of efforts. Ongoing work will further aid this synchronization in 2021 and beyond.”
Which is more valuable: metadata or the data itself? The answer from Petteri Vainikka, the president of product marketing for Cognite, may surprise you.
“As the cost and value of data storage continues to gravitate towards zero, and data science teams simultaneously scrambling to convert their existing data warehouse and data lakes into business value, the mountain of evidence pointing to ‘no correlation’ between volume and value of data keeps growing,” Vainikka says. “Whether through manual tagging of images, AI-driven data set matching to uncover data relationships, or OCR/NLP methods to convert unstructured data into structured data, the focus and value of metadata will exceed that of the data itself. Data contextualization will be at the centre of metadata curation.”
Big problems require big tools to solve, and that will be how data science differentiates itself in 2021, says Alicia Frame, lead data science product manager at Neo4j.
“With the computation power to crunch data getting cheaper and easier to access, and severless technology making it easier to develop and deploy code, we’ll see data scientists getting back to focusing on the basics: solving big problems more effectively than anyone else,” she says.
Amid data science practitioners, there will be a strong emphasis on the possibilities of feature engineering in 2021, predicts Ryohei Fujimaki, Ph.D., founder and CEO of dotData.
“While predictions are one of most valuable outcomes, AI and ML must produce actionable insights beyond predictions, that businesses can consume,” Fujimaki says. “AutoML 2.0 automates hypothesis generations (a.k.a. feature engineering) and explores thousands or even millions of hypothesis patterns that were never possible with the traditional manual process. AutoML 2.0 platforms that provide for automated discovery and engineering of data ‘features’ will be used to provide more clarity, transparency and insights as businesses realize that data features are not just suited for predictive analytics, but can also provide invaluable insights into past trends, events and information that adds value to the business by allowing businesses to discover the ‘unknown unknowns, trends and data patterns that are important, but that no one had suspected would be true.”
Stay tuned for our next batch of 2021 predictions, on advanced analytics.
Related Items:
2020: A Big Data Year in Review
Big Data Predictions: What 2020 Will Bring
April 17, 2024
- Immuta Launches Domains Policy Enforcement Capability to Simplify Enterprise-wide Data Security and Governance
- ThoughtSpot Makes Embedding AI-Powered Analytics Easy and Ubiquitous for Everyone
- Cribl Ushers in a New Era of Data Storage Simplicity with Cribl Lake
- Neo4j Welcomes New GQL International Standard in Major Milestone for Database Industry
- General Assembly Report: Tech Firms Pay Top Dollar to Secure Competent AI Professionals
- Appen Named a Leader in Everest Group’s Data Annotation and Labeling Solutions for AI/ML PEAK Matrix Assessment 2024
- Loft Labs Raises $24M in Series A Funding to Enhance Multi-Cloud and AI Infrastructure Capabilities
- Hitachi Vantara Unveils Virtual Storage Platform One, Providing the Data Foundation for Unified Hybrid Cloud Storage
April 16, 2024
- NeuReality Launches Developer Portal for NR1 Inference Platform, Expanding Affordable AI Access
- Docker AI Trends Report 2024 Unveils Key AI Insights for Developers and IT Leaders
- Appian Partners with AWS to Deliver Private AI for End-to-End Process Automation
- Qlik Sets the Pace for Real-World AI Business Transformations Across Industries
- Linux Foundation Launches Margo to Deliver Long-Awaited Edge Interoperability
- Rivos Raises More Than $250M Targeting Data Analytics and Generative AI Markets
- Apache Software Foundation Announces New Top-Level Project Apache Paimon
- Hakkōda 2024 Financial Services & Insurance State of Data Report: 97% Say Generative AI Matters for Success
- MinIO Partners with Carahsoft to Bring High-Performance Object Storage to the Public Sector
- Stravito Unveils New AI Assistant to Transform Enterprise Insight Access
- Qdrant Announces an Industry-First Hybrid Cloud Offering for Enterprise AI Applications
- Confluent Announces Accelerate with Confluent, a Revamped and Services-Led Partner Program for System Integrators
Most Read Features
Sorry. No data so far.
Most Read News In Brief
Sorry. No data so far.
Most Read This Just In
Sorry. No data so far.
Sponsored Partner Content
-
Get your Data AI Ready – Celebrate One Year of Deep Dish Data Virtual Series!
-
Supercharge Your Data Lake with Spark 3.3
-
Learn How to Build a Custom Chatbot Using a RAG Workflow in Minutes [Hands-on Demo]
-
Overcome ETL Bottlenecks with Metadata-driven Integration for the AI Era [Free Guide]
-
Gartner® Hype Cycle™ for Analytics and Business Intelligence 2023
-
The Art of Mastering Data Quality for AI and Analytics
Sponsored Whitepapers
Contributors
Featured Events
-
Call & Contact Center Expo
April 24 - April 25Las Vegas NV United States -
AI & Big Data Expo North America 2024
June 5 - June 6Santa Clara CA United States -
AI Hardware & Edge AI Summit 2024
September 10 - September 12San Jose CA United States -
CDAO Government 2024
September 18 - September 19Washington DC United States