Follow Datanami:

Tag: ETL

Matillion Looks to Unlock Data for AI

The rise of generative AI has put renewed focus on the importance of data. Without data that’s high in quality and up-to-date, an AI model simply will not generate output that’s as good as a model that has data with Read more…

Databricks Make a CDC Play with Arcion Acquisition

The quicker you can access transactional data directly from the change log of a database, the quicker you can do analytics or AI on it. That’s the basic math behind Databricks’ announcement today that it intends to a Read more…

Tristan Handy’s Audacious Vision of the Future of Data Engineering

Tristan Handy is a lot of things: co-creator of dbt, founder and CEO of dbt Labs, and self-described “startup person.” But besides leading dbt Labs to a $4 billion valuation, he is one more thing: An audacious dreame Read more…

In Search of Data Model Repeatability

Everybody wants to be data-driven--that much is clear. But that desire doesn’t necessarily translate into real business results, especially in competitive industries like ecommerce. Data quality has long been a burr Read more…

Salesforce Goes BYOM for AI

Salesforce today launched Einstein Studio, a bring-your-own-model (BYOM) AI development tool that allows customers to bring AI models they have already developed on Amazon SageMaker or Google Cloud Vertex AI to bear on t Read more…

High Costs Obstructing Your Data Plans? How Real-Time Access Removes Barriers to Data Unification

Enterprise data is expected to more than double by 2026, with cloud data storage growing by nearly 20% annually. In today's data-driven economy, organizations are tasked with managing and extracting insights and generati Read more…

The Age of Data Productivity is Here

Black Swan events like extreme weather, financial crises, pandemics, or war used to be an anomaly. Today, these events occur at a surprisingly regular cadence, and such life-altering disruptions can induce extreme stress Read more…

Bigeye Sounds the Alarm on Data Quality

In the past six months, 20% of companies have faced two or more severe data incidents that directly impacted the business’s bottom line, according to a new report on data quality issued today by Bigeye, a provider of d Read more…

There Are Four Types of Data Observability. Which One is Right for You?

Suppose you maintain a large set of data pipelines from external and internal systems, data warehouses, and streaming sources. How do you ensure that your data meets expectations after every transformation? That's where Read more…

Airbyte Launches Premium Support for Its Open Source Data Integration Platform

Data integration platform Airbyte has announced the launch of its first premium support offering for Airbyte Open Source. Airbyte Open Source is a deeply customizable version of the company’s data integration platfo Read more…

Meet George Fraser, a 2023 Datanami Person to Watch

Death, taxes, and ETL: Some things are just inevitable. But give credit to Fivetran co-founder and CEO George Fraser with creating a product and company that is trying to make the process of building pipelines that move Read more…

Semantic Layer Belongs in Middleware, and dbt Wants to Deliver It

The folks at dbt Labs think the data transformation tool is the proper place to implement and manage a semantic data layer, as opposed to the BI tool or the data warehouse, where it has traditionally resided. And later t Read more…

Three Tips for Avoiding Pitfalls in Your Data Supply Chain

Data governance used to be a side hustle that Data Engineers would tackle as they were doing their “real jobs”–building their pipelines or warehouse size corrections or indexes, their views, raw zone, presentation Read more…

Wanted: An Integration Layer for Data Management That Actually Works

As data silos continues to expand and data management difficulties continue to compound, a consensus is starting to build that what the industry needs now is a standard, repeatable, and efficient way of managing all that Read more…

Forrester Shares the 411 on Data Fabric 2.0

Since the data fabric concept debuted a few years ago, it has become a popular method for enterprises to integrate disparate data management tools. Fabrics are yielding dividends for users, but nothing stays still in big Read more…

Starburst Bolsters Trino Platform as Datanova Begins

Starburst today rolled out a host of enhancements to its Trino-based analytics platform for the cloud, called Galaxy, including support for Python, new caching and indexing features, and a new data catalog. The company u Read more…

It’s Time for the All-in-One Data Stack

"Best-of-breed” or “all-in-one”? This is a common trade-off when choosing technology solutions. However, every once in a while it becomes possible for the two to converge into a single product. The iPhone (or s Read more…

AWS Bolsters Glue ETL Tool with Data Observability, Ray Support

AWS has made a big push into data management during re:Invent this week, with the unveiling of DataZone and launch of zero-ETL capabilities in Redshift. But AWS also bolstered its ETL tool with the launch of Amazon Glue Read more…

AWS Seeks an End to ETL

Extract, transform, and load. It’s a simple and ubiquitous thing in IT. And yet everybody seems to hate it. The latest company to pile on to ETL is AWS, which declared an effort to end ETL yesterday at re:Invent. Ad Read more…

Microsoft Bolsters Azure Integration with SQL Server 2022

SQL Server 2022 customers will see benefits in the areas of data integration, analytics, governance, and high availability thanks to the database’s enhanced connectivity to the Azure cloud, Microsoft announced today. Read more…

Older Entries
Datanami