Follow Datanami:

Tag: ETL

Matillion Bringing AI to Data Pipelines

Data engineers historically have toiled away in the virtual basement, doing the dirty work of spinning raw data into something usable by data scientists and analysts. The advent of generative AI is changing the nature of Read more…

Unlock Your Data Initiatives with DataOps

Across every industry, companies continue to put increased focus on gathering data and finding innovative ways to garner actionable insights. Organizations are willing to invest significant time and money to make that ha Read more…

EDB Puts Postgres in the Middle of Analytics Workflow with New Lakehouse Stack

EnterpriseDB next month is expected to formally launch a new lakehouse that puts Postgres at the center of analytics workflows, with an eye toward future AI workflows. Currently codenamed Project Beacon, EDB’s new data Read more…

Salesforce In Talks To Buy Informatica: Report

Informatica, one of the preeminent names in ETL, is considering a deal to be acquired by enterprise cloud software provider Salesforce, according to a report by the Wall Street Journal last week. If completed, the deal w Read more…

Data Quality Getting Worse, Report Says

For as long as “big data” has been a thing, data quality has been a big question mark. Working with data to make it suitable for analysis was the task that data professionals spent the bulk of their time doing 15 yea Read more…

Voltron Aims to Unblock AI with GPU-Accelerated Data Processing

Data is at the heart of artificial intelligence, but it’s also emerging as one of its biggest bottlenecks. Without sufficient quantities of good, clean data to feed into models, companies simply can’t reap the reward Read more…

AWS Plots Zero-ETL Connections to Azure and Google

At the recent re:Invent show, AWS unveiled new zero-ETL connections that will eliminate the need for customers to build and maintain data pipelines between various AWS data services, including Redshift, Aurora, DynamoDB, Read more…

Matillion Looks to Unlock Data for AI

The rise of generative AI has put renewed focus on the importance of data. Without data that’s high in quality and up-to-date, an AI model simply will not generate output that’s as good as a model that has data with Read more…

Databricks Make a CDC Play with Arcion Acquisition

The quicker you can access transactional data directly from the change log of a database, the quicker you can do analytics or AI on it. That’s the basic math behind Databricks’ announcement today that it intends to a Read more…

Tristan Handy’s Audacious Vision of the Future of Data Engineering

Tristan Handy is a lot of things: co-creator of dbt, founder and CEO of dbt Labs, and self-described “startup person.” But besides leading dbt Labs to a $4 billion valuation, he is one more thing: An audacious dreame Read more…

In Search of Data Model Repeatability

Everybody wants to be data-driven--that much is clear. But that desire doesn’t necessarily translate into real business results, especially in competitive industries like ecommerce. Data quality has long been a burr Read more…

Salesforce Goes BYOM for AI

Salesforce today launched Einstein Studio, a bring-your-own-model (BYOM) AI development tool that allows customers to bring AI models they have already developed on Amazon SageMaker or Google Cloud Vertex AI to bear on t Read more…

High Costs Obstructing Your Data Plans? How Real-Time Access Removes Barriers to Data Unification

Enterprise data is expected to more than double by 2026, with cloud data storage growing by nearly 20% annually. In today's data-driven economy, organizations are tasked with managing and extracting insights and generati Read more…

The Age of Data Productivity is Here

Black Swan events like extreme weather, financial crises, pandemics, or war used to be an anomaly. Today, these events occur at a surprisingly regular cadence, and such life-altering disruptions can induce extreme stress Read more…

Bigeye Sounds the Alarm on Data Quality

In the past six months, 20% of companies have faced two or more severe data incidents that directly impacted the business’s bottom line, according to a new report on data quality issued today by Bigeye, a provider of d Read more…

Airbyte Launches Premium Support for Its Open Source Data Integration Platform

Data integration platform Airbyte has announced the launch of its first premium support offering for Airbyte Open Source. Airbyte Open Source is a deeply customizable version of the company’s data integration platfo Read more…

Meet George Fraser, a 2023 Datanami Person to Watch

Death, taxes, and ETL: Some things are just inevitable. But give credit to Fivetran co-founder and CEO George Fraser with creating a product and company that is trying to make the process of building pipelines that move Read more…

Semantic Layer Belongs in Middleware, and dbt Wants to Deliver It

The folks at dbt Labs think the data transformation tool is the proper place to implement and manage a semantic data layer, as opposed to the BI tool or the data warehouse, where it has traditionally resided. And later t Read more…

Three Tips for Avoiding Pitfalls in Your Data Supply Chain

Data governance used to be a side hustle that Data Engineers would tackle as they were doing their “real jobs”–building their pipelines or warehouse size corrections or indexes, their views, raw zone, presentation Read more…

Datanami