Follow Datanami:

Tag: cleaning

Big Data Is Still Hard. Here’s Why

Jul 15, 2019 |

We’re over a decade into the big data era that emerged from the tectonic collision of mobile, Web 2.0, and cloud forces. Bolstered by progress in machine learning, we stand at the cusp of a new AI era that promises even greater automation of rudimentary tasks. Read more…

Keeping on Top of Data Drift

Feb 3, 2016 |

Data is often thought to be constant and immutable. A given piece of data is defined by 1s and 0s, and it never changes. But there’s an emerging school of thought in the big data world that sees data as constantly drifting and mutating in response to forces around it. Read more…

Automating the Pain Out of Big Data Transformation

Jan 24, 2014 |Having a big data set is a bit like owning a big house. There are many more activities available to you and your friends, but at the end of the day, keeping the house clean and tidy is a major expense. What the world really needs right now is a way to automate the process of cleaning, normalizing, and preparing the big data set (the house) for the next analysis (party). Luckily, the big data community has responded with new offerings that take data transformations to new automated heights. Read more…