Follow Datanami:
January 18, 2024

Ascend.io Automates dbt Pipeline Orchestration with New Integration

MENLO PARK, Calif., Jan. 18, 2024  — Ascend.io, a leader in data pipeline automation, today announced an integration that allows users to painlessly scale and run sophisticated dbt models in production with a single command. Ascend for dbt represents the industry’s first automation and optimization controller for dbt models, giving data and analytics engineers access to Ascend’s advanced orchestration capabilities with no added overhead.

Ascend for dbt allows analytics engineers to continue to build with dbt Core while deploying their models to Ascend for intelligent execution. This solves a major challenge with dbt Core, the open-source version of dbt, which requires users to bring in a separate orchestration tool to execute their models. By automating the process of deploying dbt models with DataAware™ intelligence, Ascend helps data teams deliver data products faster and more efficiently.

“With data teams under pressure to innovate faster and generate more value for their organizations, they need systems to automate traditionally manual processes that deploy and maintain data products at scale,” said Sean Knapp, founder and CEO, Ascend.io. “This new integration eliminates the pain of operationalizing dbt models, providing a smooth journey from design to production.”

With Ascend for dbt, Ascend automatically tracks lineage across multiple dbt projects. By profiling the data against the generated dbt code, Ascend’s automation controller identifies every change in code or data that affects a pipeline. This enables Ascend to auto-generate the jobs required to operate a sophisticated network of pipelines with maximum efficiency. Its dynamic intelligence limits unnecessary data processing, reducing cloud bills by up to 30% and engineering operations work by up to 80%.

Ascend’s data pipeline automation allows engineers to continue to build ontop of dbt Core. Once the updated models are compiled and pushed into Ascend, the platform automatically identifies any change from previous versions and autonomously orchestrates pipeline operation in response to those changes.

“In addition to the cost and time saving benefits, we see this integration as a critical step in organizations’ AI readiness strategy,” said Knapp. “AI projects often require entirely new datasets at a speed most data engineering teams are currently not equipped to meet. By launching dbt pipelines in a fraction of the time it traditionally takes, data teams can create and manage new data products at scale and ultimately become more efficient and responsive.”

Visit Ascend.io to learn more.

About Ascend.io

Ascend is the leader in Data Pipeline Automation for building the world’s most intelligent data pipelines. It’s a single platform with intelligence to detect and propagate change across your ecosystem, ensure data accuracy and quantify the cost of your data products. Customers automate up to 90% of repetitive data engineering and reduce infrastructure costs with one place for end-to-end observability and automated lineage tracing. The Ascend intelligent control plane enables customers to automatically detect, manage and propagate change, maintain data integrity, accuracy and prevent errors. Customers can accurately cost data products with metadata-driven insights into team and solution resources used across their landscape. Ascend partners at every step of the data journey with product innovation and expert support that frees customers to focus on achieving goals. Learn more at Ascend.io.


Source: Ascend.io

Datanami