
Tag: ETL
Matillion Looks to Unlock Data for AI
The rise of generative AI has put renewed focus on the importance of data. Without data that’s high in quality and up-to-date, an AI model simply will not generate output that’s as good as a model that has data with Read more…
Databricks Make a CDC Play with Arcion Acquisition
The quicker you can access transactional data directly from the change log of a database, the quicker you can do analytics or AI on it. That’s the basic math behind Databricks’ announcement today that it intends to a Read more…
Tristan Handy’s Audacious Vision of the Future of Data Engineering
Tristan Handy is a lot of things: co-creator of dbt, founder and CEO of dbt Labs, and self-described “startup person.” But besides leading dbt Labs to a $4 billion valuation, he is one more thing: An audacious dreame Read more…
In Search of Data Model Repeatability
Everybody wants to be data-driven--that much is clear. But that desire doesn’t necessarily translate into real business results, especially in competitive industries like ecommerce. Data quality has long been a burr Read more…
Salesforce Goes BYOM for AI
Salesforce today launched Einstein Studio, a bring-your-own-model (BYOM) AI development tool that allows customers to bring AI models they have already developed on Amazon SageMaker or Google Cloud Vertex AI to bear on t Read more…
High Costs Obstructing Your Data Plans? How Real-Time Access Removes Barriers to Data Unification
Enterprise data is expected to more than double by 2026, with cloud data storage growing by nearly 20% annually. In today's data-driven economy, organizations are tasked with managing and extracting insights and generati Read more…
The Age of Data Productivity is Here
Black Swan events like extreme weather, financial crises, pandemics, or war used to be an anomaly. Today, these events occur at a surprisingly regular cadence, and such life-altering disruptions can induce extreme stress Read more…
Bigeye Sounds the Alarm on Data Quality
In the past six months, 20% of companies have faced two or more severe data incidents that directly impacted the business’s bottom line, according to a new report on data quality issued today by Bigeye, a provider of d Read more…
Airbyte Launches Premium Support for Its Open Source Data Integration Platform
Data integration platform Airbyte has announced the launch of its first premium support offering for Airbyte Open Source. Airbyte Open Source is a deeply customizable version of the company’s data integration platfo Read more…
Meet George Fraser, a 2023 Datanami Person to Watch
Death, taxes, and ETL: Some things are just inevitable. But give credit to Fivetran co-founder and CEO George Fraser with creating a product and company that is trying to make the process of building pipelines that move Read more…
Semantic Layer Belongs in Middleware, and dbt Wants to Deliver It
The folks at dbt Labs think the data transformation tool is the proper place to implement and manage a semantic data layer, as opposed to the BI tool or the data warehouse, where it has traditionally resided. And later t Read more…
Three Tips for Avoiding Pitfalls in Your Data Supply Chain
Data governance used to be a side hustle that Data Engineers would tackle as they were doing their “real jobs”–building their pipelines or warehouse size corrections or indexes, their views, raw zone, presentation Read more…
Wanted: An Integration Layer for Data Management That Actually Works
As data silos continues to expand and data management difficulties continue to compound, a consensus is starting to build that what the industry needs now is a standard, repeatable, and efficient way of managing all that Read more…
Starburst Bolsters Trino Platform as Datanova Begins
Starburst today rolled out a host of enhancements to its Trino-based analytics platform for the cloud, called Galaxy, including support for Python, new caching and indexing features, and a new data catalog. The company u Read more…
It’s Time for the All-in-One Data Stack
"Best-of-breed” or “all-in-one”? This is a common trade-off when choosing technology solutions. However, every once in a while it becomes possible for the two to converge into a single product. The iPhone (or s Read more…
AWS Bolsters Glue ETL Tool with Data Observability, Ray Support
AWS has made a big push into data management during re:Invent this week, with the unveiling of DataZone and launch of zero-ETL capabilities in Redshift. But AWS also bolstered its ETL tool with the launch of Amazon Glue Read more…
AWS Seeks an End to ETL
Extract, transform, and load. It’s a simple and ubiquitous thing in IT. And yet everybody seems to hate it. The latest company to pile on to ETL is AWS, which declared an effort to end ETL yesterday at re:Invent. Ad Read more…
Microsoft Bolsters Azure Integration with SQL Server 2022
SQL Server 2022 customers will see benefits in the areas of data integration, analytics, governance, and high availability thanks to the database’s enhanced connectivity to the Azure cloud, Microsoft announced today. Read more…