Follow Datanami:

Tag: ETL

How ML Helps Solve the Big Data Transform/Mastering Problem

Oct 10, 2019 |

Despite the astounding technological progress in big data analytics, we largely have yet to move past manual techniques for important tasks, such as data transformation and master data management. As data volumes grow, the productivity gap posed by manual methods grows wider, putting the dreams of AI- and machine learning-powered automation further out of reach. Read more…

Dremio Noses Into Cloud Lakes with Analytics Speedup

Sep 17, 2019 |

Most of today’s big data action is occurring in the cloud, where companies are building massive data lakes atop object storage systems like AWS S3 and Microsoft ADLS. While object stores offer tremendous scalability, they’re notoriously slow. Read more…

StreamSets Eases Spark-ETL Pipeline Development

Sep 5, 2019 |

Apache Spark gives developers a powerful tool for creating data pipelines for ETL workflows, but the framework is complex and can be difficult to troubleshoot. StreamSets is aiming to simplify Spark pipeline development with Transformer, the latest addition to its DataOps platform. Read more…

Can We Stop Doing ETL Yet?

Sep 3, 2019 |

Despite the advances we’ve made in data science and advanced analytics in recent years, many projects still are beholden to a technological holdover from the 1980s: extract, transform, and load, or ETL. Read more…

Skills Are Critical in Data Science Job Hunt

Aug 22, 2019 |

Those planning a career in data science have a healthy job outlook, as demand for data scientists continues to grow. While an advanced data science degree can definitely help, it’s becoming increasingly apparent that having the right skills is a more critical factor in landing your dream job. Read more…

The Critical Element for a Successful Digital Transformation? HTAP Powered by In-Memory Computing

Aug 8, 2019 |

Many of today’s digital transformation and omnichannel customer experience initiatives demand real-time analysis of data. For example, banks need to analyze transactions across their systems in real time to detect and prevent fraud. Read more…

The Anatomy of AI: Understanding Data Processing Tasks

Aug 6, 2019 |

So you’re collecting lots of data with the intention to automate decision-making through the strategic use of machine learning. That’s great! But as your data scientists and data engineers quickly realize, building a production AI system is a lot easier said than done, and there are many steps to master before you get that ML magic. Read more…

Great Cloud Migration Opens Data Opportunities

Jun 12, 2019 |

We’re in the midst of a massive cloud migration at the moment, as companies look to take advantage of the scalability and simplicity of storing and processing data in the cloud. Read more…

From Big Beer to Big Data: Inside AB InBev’s Digital Transformation

Apr 11, 2019 |

With more than 500 beer brands and $55 billion in sales, Anheuser-Busch InBev is already the world’s biggest beer company. And if all goes as planned with its digital transformation project, it will be the best beer company in the world, too. Read more…

Rockset Cranks Up Serverless Analytics Engine

Mar 20, 2019 |

Cloud-based serverless data preparation tools are gaining traction among data analysts seeking to move beyond traditional approaches to organizing low-quality but potentially valuable data. That approach promises to provide data scientists with an alternative to standard ETL routines developed to plumb data warehouses. Read more…

Do NOT follow this link or you will be banned from the site!