Follow Datanami:

Tag: data quality

Achieving Data Quality at Scale Requires Data Observability

Is it possible for enterprises to improve data quality at scale in the face of ever-increasing data collection? The answer is yes, but to do it, data teams need a data observability solution with advanced AI/ML capabilit Read more…

It’s Time for the All-in-One Data Stack

"Best-of-breed” or “all-in-one”? This is a common trade-off when choosing technology solutions. However, every once in a while it becomes possible for the two to converge into a single product. The iPhone (or s Read more…

Unleash the 2023 Big Data Predictions!

It’s that time of year again--time for big data predictions! We have a bumper crop of them to share with you this year, so sit down, grab a beverage of your choice, and buckle up for the predictive onslaught. We kic Read more…

Mastering the Mesh: Finding Clarity in the Data Lake

Data lakes are great in theory, but their application in the real world often leaves the user wanting more. A data mesh is one approach to cleaning up chaos left by data lakes and the resulting swing back to data decentr Read more…

AWS Bolsters Glue ETL Tool with Data Observability, Ray Support

AWS has made a big push into data management during re:Invent this week, with the unveiling of DataZone and launch of zero-ETL capabilities in Redshift. But AWS also bolstered its ETL tool with the launch of Amazon Glue Read more…

How Snowplow Breaks Down Data Barriers

If you have suspicions about your data, you’re not alone. The AI and data analytics dreams of many a company have been broken by poor data management and defective ETL pipelines. But by enforcing data schema at the poi Read more…

Talend Data Health Barometer Reveals Trouble in Reaching Full Data Potential

Talend has released results from its second annual Data Health Barometer global survey that found 97% of respondents are facing challenges in using data to its full potential. Talend says a company’s overall data he Read more…

Cloud Migrations Negatively Impacting Data Estates, Capital One Says

We’re in the midst of a massive migration of data to the cloud at the moment, driven in large part by the promises of advanced analytics and AI and the competitive advantages they can bring. However, before getting thi Read more…

Monte Carlo Survey Finds Data Engineers Spend 40% of Their Workday on Bad Data

Monte Carlo released a report this week that found that data engineers spend 40% of their workday on average evaluating or checking data quality. For its 2022 State of Data Quality Survey, Monte Carlo joined Wakefield Read more…

Data Sourcing Still a Major Bottleneck for AI, Appen Says

Data is the lifeblood of machine. You’re not building anything AI-related without it. But organizations continue to struggle to obtain good, clean data to sustain their AI and machine learning initiatives, according to Read more…

How ML-Based Data Mastering Saves Millions for Clinical Trial Business

As the country’s largest provider of clinical trial services, WCG has a sizable impact on the route to market for many drugs and medical devices. But as a conglomeration of more than 30 previously separate companies, W Read more…

IBM Acquires Observability Platform Databand.ai

IBM has announced the acquisition of data observability software vendor Databand.ai. Today’s announcement marks IBM’s fifth acquisition of 2022. The company says the acquisition “further strengthens IBM’s softwar Read more…

Data Quality Study Reveals Business Impacts of Bad Data

If your data warehouse is starting to look like Miss Havisham’s decaying mansion, you may have a data quality problem. A new survey of 500 data professionals from open source data quality tool Great Expectations rev Read more…

Monte Carlo Raises $135 Million to Grow Data Observability Biz

Data observability has emerged as one of the hottest sectors in the big data market, thanks to its focus on fixing broken data pipelines. One of the hottest players in the field is Monte Carlo, which this week announced Read more…

The Rise and Fall of Data Governance (Again)

Data governance has had more than its fair share of spins through the hype cycle. It burst on the scene in the late 90s with metadata management as a seemingly silver bullet for making data actionable and trustworthy. Read more…

The Modernization of Data Engineering at Capital One

Like many enterprises, Capital One Financial Corp. is in the process of democratizing employee access to data to improve profitability, lower risk, and increase customer satisfaction. But lowering the barriers to data ac Read more…

How Data-Centric AI Bolsters Deep Learning for the Small-Data Masses

It’s no coincidence that deep learning became popular in the AI community following the rise of big data, since neural networks require huge amounts of data to train. But organizations with much smaller data sets can b Read more…

The Data Is Not All Right

A funny thing happened on our quest to be data-driven and data-centered beings and organizations--we discovered how bad our data really is. And like a self-help program stuck in an endless Groundhog Day-like loop, we see Read more…

Regs Making Legit Data More Valuable, Neutronian Says

The market for third-party data has exploded in recent years, giving companies an abundance of sources to choose from. That’s even more critical today in light of the demise of third-party cookies and Apple’s new pri Read more…

Datanami