Syncsort Survey Reveals Disconnect Between Data Trust and Data Quality
PEARL RIVER, N.Y., July 17, 2019 – Syncsort, the global leader in Big Iron to Big Data software, today announced results of a survey exploring data quality and organizations’ confidence in data across their enterprise. Though most respondents rated their organization’s data quality either as “good” (38%) or “very good” (27%), the survey revealed a disconnect around understanding and trust in the data and how it informs business decisions.
69% of respondents stated their leadership trusts data insights enough to inform business decisions, yet they also said only 14% of stakeholders had a very good understanding of the data. Of the 27% who reported sub-optimal data quality, 72% said it negatively impacted business decisions.
Multiple Data Sources, Governance and Volume Are Top Data Quality Challenges
- The top three challenges companies face when ensuring high quality data are multiple sources of data (70%), applying data governance processes (50%) and volume of data (48%).
- About three quarters (78%) have challenges profiling or applying data quality to large data sets.
- 29% say they have a partial understanding of the data that exists across their organization, while 48% say they have a good understanding.
Data Profiling Tool Adoption Low, Leading to Lack of Visibility into Data Attributes
- Fewer than 50% of respondents take advantage of a data profiling tool or data catalog.
- Instead, respondents rely on other methods to gain understanding of data, with more than 50% using SQL queries and over 40% using a BI tool.
- Of those who reported partial, minimal or very little understanding of their data, the top three attributes respondents lacked visibility into were: relationship between data sets (63%), completeness of data (56%) and validation of data against defined rules (56%).
The Consequences of Poor Data Quality Are Wide-Ranging, from Customer Dissatisfaction to Barriers to Emerging Technology Adoption
- Of those who reported fair or poor data quality, wasted time was the number one consequence (92%), followed by ineffective business decisions (72%) and customer dissatisfaction (67%).
- 25% of respondents who reported sub-optimal data quality say it has prevented their organization from adopting emerging technology and methods (such as AI, Machine Learning (ML) and blockchain).
- Only 16% of respondents are confident they aren’t feeding bad data into AI and ML applications.
- 73% are using cloud computing for strategic workloads, but 48% of them have partial to no understanding of the data that exists in the cloud. 22% rate the quality of their data in the cloud as fair or poor.
“This survey confirms what we’ve been seeing with our customers – that good data simply isn’t good enough anymore,” said Tendü Yoğurtçu, CTO, Syncsort. “Sub-optimal data quality is a major barrier, especially to the successful, profitable use of artificial intelligence and machine learning. The classic phrase ‘garbage-in, garbage-out’ has long been used to describe the importance of data quality, but it has a multiplier effect with machine learning — first in the historical data used to train the predictive model, and second in the new data used by that model to make future decisions.” For more information on the survey results, read our blog.
Syncsort polled 175 respondents, 69% of whom work for organizations with over 1,000 employees. Participants represented a range of industries, with the largest percentage coming from Financial Services (25%), as well as a range of positions, ranging from CDO to Data Analyst, with the majority in data-focused roles (29%).
Syncsort is the global leader in Big Iron to Big Data software. We organize data everywhere to keep the world working – the same data that powers machine learning, AI and predictive analytics. We use our decades of experience so that more than 7,000 customers, including 84 of the Fortune 100, can quickly extract value from their critical data anytime, anywhere. Our products provide a simple way to optimize, assure, integrate, and advance data, helping to solve for the present and prepare for the future. Learn more at syncsort.com