Follow Datanami:

Tag: data cleansing

Numbers Station Sees Big Potential In Using Foundation Models for Data Wrangling

A startup called Numbers Station is applying the generative power of pre-trained foundation models such as GPT-4 to help with data wrangling. The company, which is based on research conducted at the Stanford AI Lab, has Read more…

AWS Launches Visual Data Prep Tool

AWS this week unveiled Glue DataBrew, a new visual data preparation tool for AWS Glue that’s designed to help users clean and normalize data without writing code. Data preparation is the Achille’s Heel of advanced Read more…

Informatica Likes Its Chances in the Cloud

Quick: Name a company that made its name in the 1990s and 2000s by providing data integration tools for enterprise analytics running in on-prem data centers, but has since pivoted the cloud and was even named Snowflake� Read more…

ICIJ Turns to Big Data Tech to Unravel FinCEN Files

Unraveling financial crimes like money laundering is a notoriously difficult task, especially when criminals purposely cover their tracks. It gets a little easier when you have advanced tools, such as text analytics, mac Read more…

Data Prep Still Dominates Data Scientists’ Time, Survey Finds

Data scientists spend about 45% of their time on data preparation tasks, including loading and cleaning data, according to a survey of data scientists conducted by Anaconda. The company also analyzed the gap between what Read more…

Syncsort Doubles Down on Data Quality with Pitney Bowes Buy

Here’s a stat to ponder: With its $700-million acquisition of Pitney Bowes' software and data business now complete, Syncsort becomes the second biggest vendor in the data quality space, per 2018 figures from IDC. But Read more…

The Anatomy of AI: Understanding Data Processing Tasks

So you're collecting lots of data with the intention to automate decision-making through the strategic use of machine learning. That's great! But as your data scientists and data engineers quickly realize, building a pro Read more…

Big Data Meltdown: How Unclean, Unlabeled, and Poorly Managed Data Dooms AI

We may be living in the fourth industrial age and on cusp of huge advances in automation powered by AI. But according to the latest data, our great future will be less rosy if enterprises don't start doing something abou Read more…

Data Management: Still a Major Obstacle to AI Success

Data is the lifeblood of AI. Without good data, machine learning algorithms have no way to determine a normal distribution of activities, occurrences, or events. However, only about one in five businesses have data that' Read more…

Self-Service Data Preparation – At Scale or Sampling?

The phrase “data is the new oil” has become the favorite business transformation cliché of the past 10 years. The truth is that data in its raw form is about as useful for decision making as oil is for propelling a Read more…

The Seven Sins of Data Prep

Data preparation is often considered a necessary precursor to the “real” work found in visualizing or analyzing data, but this framing sells data prep short. The ways in which we cleanse and shape data for downstream Read more…

The Role of Self-Service Data Preparation in Analytics Modernization

It’s no secret that data is playing an increasingly important role in not only today’s business environment but also within our society as a whole. In a May 2017 article, The Economist laid out why data has overtaken Read more…

Carts & Horses: Why You Need to Focus on Data First

Like most of us, I love shiny new objects and learning about how successful companies are building them into their operations. Google’s use of Neural Nets for Translate? Tell me more. Got some data about Uber using art Read more…

Breaking Down the Seven Tenets of Data Unification

One of the longstanding challenges in analytics is data unification. While federated approaches are gaining some favor, the vast majority of analytic practitioners want the data to be present in one place before analyzin Read more…

Data Quality Unites with Integration at Syncsort

Syncsort has established itself as a major player in the market for big data integration software with its DMX-h product. Following its acquisition of Trillium last year, the company is taking the next step of giving cus Read more…

Data Quality Remains Low, Report Finds

Even as corporate spending on data collection and analytics increases, confidence in the quality of data is decreasing as CEOs worry that messy data and questionable results will hamper future technology efforts centered Read more…

Why Self-Service Prep Is a Killer App for Big Data

If you're embarking upon a big data analytics project, you're likely considering some sort of self-service data preparation tool to help you cleanse, transform, and standardize your data. And if you aren't, you probably Read more…

Data Quality Trending Down? C’est La Vie

One of the biggest impediments to becoming a data-driven organization is tackling the problem of data quality. Data is often too dirty and discombobulated for use in high-end decision-making, and the increasing volume an Read more…

How This Instrument Firm Tackled Big Data Blending

Thanks to the ongoing digitalization of the world, we're constantly awash in data of all types. From structured data like sales reports and customers list to semi-structured data like photographs and clickstreams, nearly Read more…

How to Talk to Your Boss About Needing Better Data Quality Tools

Accessing, correcting, and organizing data can add hours to your workday, limiting your ability to accurately report on initiatives and unlock the business insights that can help your company perform at its peak. You kno Read more…

Older Entries
Datanami