Tag: cleaning
Big Data Is Still Hard. Here’s Why
We're over a decade into the big data era that emerged from the tectonic collision of mobile, Web 2.0, and cloud forces. Bolstered by progress in machine learning, we stand at the cusp of a new AI era that promises even Read more…
Keeping on Top of Data Drift
Data is often thought to be constant and immutable. A given piece of data is defined by 1s and 0s, and it never changes. But there's an emerging school of thought in the big data world that sees data as constantly drifti Read more…
Automating the Pain Out of Big Data Transformation
Having a big data set is a bit like owning a big house. There are many more activities available to you and your friends, but at the end of the day, keeping the house clean and tidy is a major expense. What the world really needs right now is a way to automate the process of cleaning, normalizing, and preparing the big data set (the house) for the next analysis (party). Luckily, the big data community has responded with new offerings that take data transformations to new automated heights. Read more…
