Tag: data pipeline
With $17M in Funding, DataBahn Pushes AI Agents to Reinvent the Enterprise Data Pipeline
The world is creating more data than enterprises can realistically manage. In 2024, global data creation is expected to hit 149 zettabytes. By 2028, that number is projected to nearly triple, reaching more than 394 zetta Read more…
Are Data Engineers Sleepwalking Towards AI Catastrophe?
Since the earliest days of big data, data engineers have been the unsung heroes doing the dirty work of moving, transforming, and prepping data so highly paid data scientists and machine learning engineers can do their t Read more…
dbt Labs Cranks the Performance Dial with New Fusion Engine
Dbt became one of the most used data tools thanks to its extensibility and simplicity. Now the folks behind dbt are taking the tool to the next level with the launch of a new Rust-powered Fusion engine, which dbt Labs CE Read more…
The Data Hat Trick: Three Winning Plays for AI-Ready Data
If you’ve ever watched a hockey game, you know that a hat trick—scoring three goals in a single game—is a major feat. It requires precision, teamwork, and a deep understanding of the game. When it comes to artifici Read more…
Will GenAI Modernize Data Engineering?
Generative AI is being asked to do many things, from replacing call center workers to enhancing developer productivity. There’s also an intriguing possibility that it will supercharge data engineering, if a new survey Read more…
Campspot Scores Data Pipeline Win with Apache Airflow and Astronomer
Searching for the perfect campsite can be a hit-and-miss affair, as one seeks the perfect combination of a view, sufficient parking, and proximity to neighbors and services, among other factors. When it came to selecting Read more…
Nodepay Secures $7M to Advance Decentralized AI
The decentralized AI space is rapidly evolving, with innovative platforms finding new ways to optimize resources and enhance machine learning (ML) capabilities. Nodepay is one such platform. It allows users to contri Read more…
AI Has a Data Problem, Appen Report Says
AI may be a priority at American companies, but the difficulty in managing data and obtaining high quality data to train AI models is becoming a bigger hurdle to achieving AI aspirations, according to Appen’s State of Read more…
Astronomer’s High Hopes for New DataOps Platform
Astronomer last month rolled out a new observability product called Astro Observe that’s aimed at giving customers the full picture of how their data is flowing using Apache Airflow, the open source data orchestration Read more…
Cutting-Edge Infrastructure Best Practices for Enterprise AI Data Pipelines
The ability to harness, process, and leverage vast amounts of data sets leading organizations apart in today's data-driven landscape. To stay ahead, enterprises must master the complexities of artificial intelligence (AI Read more…
Data Is the Foundation for GenAI, MIT Tech Review Says
Pretrained large language models (LLMs) like GPT-4 and Gemini are great, but real competitive advantage comes from combining LLMs with private data. Unfortunately, there are questions as to how well companies have prepar Read more…
Data Quality Is A Mess, But GenAI Can Help
A recurring theme in big data over the past two decades is the poor quality of data. No matter how much ink is spilled on the topic, organizations continually seem surprised that the data they want to use for analytics o Read more…
Data Observability in 2024: A Guide
In today's data-driven world, data observability is a critical concept for organizations aiming to effectively manage their data. Simply put, it means having the ability to constantly monitor and understand the status of Read more…
How Airflow 2.8 Makes Building and Running Data Pipelines Easier
Apache Airflow is one of the world’s most popular open source tools for building and managing data pipelines, with around 16 million downloads per month. Those users will see several compelling new features that help t Read more…
AWS Plots Zero-ETL Connections to Azure and Google
At the recent re:Invent show, AWS unveiled new zero-ETL connections that will eliminate the need for customers to build and maintain data pipelines between various AWS data services, including Redshift, Aurora, DynamoDB, Read more…
Pantomath on a Mission To Enhance End-To-End Data Pipeline Observability Across Complex Data Ecosystems
In our data-intensive business world, organizations are striving to use new and innovative methods to derive valuable and actionable insights from the data. Unfortunately, data quality issues are a major challenge and re Read more…
Six Common Signs It’s Time to Invest in Data Reliability
Every enterprise relies heavily on data to make decisions. This makes data reliability crucial. Without it, you may not find the path to streamlined customer experience and revenue generation. However, data reliability Read more…
Meet Maxime Beauchemin, a 2023 Person to Watch
When it comes to prolific contributors to open source projects in the big data space, Maxime Beauchemin is definitely somebody you should know. As a data engineer at Airbnb, Beauchemin created multiple tools that he subs Read more…
Data Mesh Creator Takes Next Data Step
Zhamak Dehghani, who is credited with popularizing the data mesh concept, announced earlier this month the founding of Nextdata. The new outfit will develop software designed to help customers implement “data product c Read more…
Data Integration and Observability Provider Crux Nabs $50m in Funding
Crux, a cloud-based provider of data integration and observability tools that claims to have more than 250 data connectors, today announced that it raised $50 million in a Series B round of venture capital. The San Franc Read more…
Leading Solution Providers
Tabor Network
