Apache Kafka has emerged as a leading platform for the management of data transaction streaming. Hence, users are placing a premium on maintaining Kafka uptime by anticipating and resolving issues before Kafka clusters go down, with the resulting loss of data.
Confluent Inc., the company behind Apache Kafka continues to expand its offerings with a monitoring tool that seeks to reduce the risk of Kafka downtime and data loss by identifying and resolving issues before an instance is lost. It is also promoted as a way of preserving Kafka instances without large infrastructure investments.
The “proactive support” platform dubbed Reliable is part of Confluent’s Project Metamorphosis launched earlier this year as a next-generation event streaming platform running in the Confluent Cloud. The initiative is designed to help users scale Kafka deployments while Reliable aims to keep the event streamer up and running.
Confluent said Tuesday (Nov. 10) its Kafka support platform provides real-time analysis of cluster metadata, alerting operators of potential issues before a crash. The monitoring tool also provides performance metrics that would allow support staff to trace the root cause of a Kafka performance issues.
The company said the impetus for the Kafka platform was about 1,000 support tickets that helped it gain insights into detecting performance issues. “We proactively tell you about issues we find with [customers’ deployments] based on experience running literally thousands of clusters,” said Tim Bergland, Confluent’s senior director of developer advocacy.
Hence, the company developed a framework by which cluster metadata is fed through its collection of algorithms to gauge performance and anticipate potential problems. Real-time “health metrics” are promoted as helping support engineers identify root causes faster, cutting the time to resolve support issues by as much as 25 percent, the company claimed.
Among the most common issues affecting the scaling of Kafka’s real-time performance and the threat of data loss are network and storage bottlenecks. Overloaded networks or storage media often bring down Kafka clusters, taking with them business events and other critical data.
The managed service also is designed to help IT administrators reduce the amount of time and resources devoted to operating the relatively complex, distributed Kafka environment.
In launching Project Metamorphosis this past spring, Confluent said it planned a series of monthly product and feature upgrades through the end of the year as it fleshes out its real-time streaming platform. The managed support service is the latest in that series of offerings.
Customers running Confluent 6.0 can opt in to use the initial release of the managed Kafka service. Alerts can be sent via integration with the Confluence control center. Alternatively, users can set up alerts via email or Slack.
Recent items:
Step One in Kafka’s Metamorphosis Revealed
Real-Time Data Streaming, Kafka and Analytics, Part 1: Data Streaming 101
Real-Time Data Streaming, Kafka and Analytics, Part 2: Going Beyond Pure Streaming
May 10, 2024
May 9, 2024
- Lightning AI Launches Its Studio Platform in AWS Marketplace
- Precisely Continues to Expand Reach and Capabilities for Data Enrichment and Geo Addressing
- Databricks Enhances Enterprise AI with RAG Applications and Improved Model Serving
- StarTree Extends Real-Time Analytics Capabilities for Observability and Anomaly Detection Use Cases
- Snowflake Unveils the Future of AI and Data at 6th Annual Data Cloud Summit
May 8, 2024
- IBM and SAP Announce New Generative AI Capabilities to Transform Business Processes
- Alteryx: Businesses Embrace Generative AI, but General Public Remains Wary
- Atlan’s Control Plane to Power Data & AI Governance Attracts $105M
- Cisco Unlocks AI-Powered Intelligence for Self-Hosted Observability
- Boomi Accelerates Enterprise Data Connectivity with Advanced API Management Acquisitions
- Elastic Security Labs Releases Guidance to Avoid LLM Risks and Abuses
- Neo4j Empowers Syracuse University with $250K Grant to Tackle Misinformation in 2024 Elections
- Cloudera Unveils New Flow Management and Streaming Operators at Red Hat Summit
- DataForge Open-Sources First Functional Data Programming Framework
May 7, 2024
- Datadog Launches IT Event Management to Enhance AIOps Capabilities
- Panasas Rebrands as VDURA: A New Chapter in Software-Defined Storage for AI Applications
- Niobium Secures $5.5M in Venture Financing to Commercialize FHE Accelerator Chip
- Oracle Code Assist Can Help Developers Build Applications Faster with AI
Most Read Features
Sorry. No data so far.
Most Read News In Brief
Sorry. No data so far.
Most Read This Just In
Sorry. No data so far.
Sponsored Partner Content
-
Get your Data AI Ready – Celebrate One Year of Deep Dish Data Virtual Series!
-
Supercharge Your Data Lake with Spark 3.3
-
Learn How to Build a Custom Chatbot Using a RAG Workflow in Minutes [Hands-on Demo]
-
Overcome ETL Bottlenecks with Metadata-driven Integration for the AI Era [Free Guide]
-
Gartner® Hype Cycle™ for Analytics and Business Intelligence 2023
-
The Art of Mastering Data Quality for AI and Analytics
Sponsored Whitepapers
Contributors
Featured Events
-
AI & Big Data Expo North America 2024
June 5 - June 6Santa Clara CA United States -
CDAO Canada Public Sector 2024
June 18 - June 19 -
AI Hardware & Edge AI Summit Europe
June 18 - June 19London United Kingdom -
AI Hardware & Edge AI Summit 2024
September 10 - September 12San Jose CA United States -
CDAO Government 2024
September 18 - September 19Washington DC United States