Follow Datanami:
March 25, 2024

Bigeye Launches Bigeye Dependency Driven Monitoring to Ensure Reliable Analytics

SAN FRANCISCO, March 25, 2024 — Bigeye announced today the availability of Bigeye Dependency Driven Monitoring. With this launch, Bigeye becomes the first data observability platform to allow enterprise data teams to connect their analytics dashboards, map every dependency across modern and legacy data sources, and deploy targeted data observability to ensure they stay reliable by default.

According to Bigeye’s 2023 State of Data Quality Report, 70% of business leaders don’t trust analytics dashboards to make critical decisions due to regular data quality incidents.

Regarding this challenge Kyle Kirwan, CEO and Co-founder of Bigeye, said, “We’ve spoken with hundreds of enterprise data leaders and, despite investing heavily in data quality tools and processes, they still struggle to deliver reliable data analytics to business users. Something the data observability industry hasn’t yet solved is how to handle the complexity and size of large enterprise data pipelines. This is because enterprise dashboards have a long list of dependencies that span modern and legacy technologies and data observability platforms have yet to offer true support for the types of hybrid environments nearly all Fortune 500 companies have.”

Bigeye Dependency Driven Monitoring uniquely solves this challenge by combining enterprise-grade lineage technology with data observability to automatically trace the entire enterprise data pipeline at column-level precision through traditional and modern technologies, ETL stages, and even across the boundary from cloud to on-premises environments.

Bigeye Dependency Driven Monitoring Improves Data Observability ROI

Without a clear understanding of which columns are critical dependencies for business operations and which are not, data engineering teams are left with no choice but to deploy broad, blanket monitoring across a large number of tables and columns to reach adequate coverage. While this approach helps engineers identify anomalies anywhere they occur in the data environment, it also requires them to manage higher compute costs, unwanted alert noise, and additional overhead as a result of deploying unnecessary monitoring.

Bigeye Dependency Driven Monitoring turns this paradigm on its head by allowing data analysts and business users to start from their critical dashboard and—in just a few clicks—enable data observability on each column that matters, and none that don’t.

When compared with other data observability approaches, Bigeye Dependency Driven Monitoring provides:

  • Faster time to value and improved trust for data consumers.
  • Clear visibility into the health of the entire analytics data pipeline for analysts.
  • Reduced alert noise and faster issue resolution for data engineers.
  • Lower total cost of ownership and less compute overhead for data leaders.

When a data issue is detected, Bigeye will instantly notify each data source owner impacted through Slack or Microsoft Teams. Bigeye can also automatically create a bi-directional ticket in ITSM tools like JIRA and ServiceNow for integrated incident management.

For data consumers, Bigeye will display data health updates directly in their analytics dashboard, providing instant insight into whether or not their analytics are reliable. Data engineering teams can then use Bigeye’s lineage-powered root cause and impact analysis to quickly trace the data problem to the source for fast triage and resolution.

Powered by Bigeye Lineage Plus—Complete Lineage for Enterprise Data Stacks

Data lineage has become a ubiquitous feature for many types of data operations tools. Due to the complexity of mapping lineage in legacy or on-premises environments, most tools require the customer to use complex, custom APIs or manual entry to try and capture a full picture of an enterprise pipeline.

Bigeye Dependency Driven Monitoring is powered by Bigeye Lineage Plus, a complete data lineage technology built to handle the largest, most complex enterprise pipelines. Bigeye Lineage Plus includes 50 connectors for transactional databases, cloud data warehouses, data lakes, ETL platforms, analytics tools, and more. Each connector includes parsers that trace lineage at the column level even as it moves from cloud to on-premises sources. As a result, data analysts and data engineers can view a single lineage map of their entire pipeline all the way through to an analytics dashboard or data product.

Bigeye Lineage Plus includes:

  • 50+ connectors covering modern and legacy enterprise data sources
  • Support for cloud and on-premises infrastructure
  • ETL job information capture so no step in the pipeline is lost

“Bigeye’s new capabilities will let us surface the health of critical Power BI dashboards in real-time to our data consumers who use them to make critical decisions daily in the field,” said Ash Smith, Manager, Data Platform, South32. “Before Bigeye, we considered building this capability ourselves and we’re confident that using Bigeye’s pre-built Lineage Plus connectors will save us significant time and resources while speeding time-to-value.”

About Bigeye

Bigeye is enterprise-grade data observability for modern and legacy data stacks. Bigeye brings together data observability, end-to-end lineage, and scalability and security to give enterprise data teams unmatched insight into the reliability of data powering their business—no matter if it’s on-prem, in the cloud, or hybrid.


Source: Bigeye

Datanami