Confluent Moves to Boost Kafka Reliability
Apache Kafka has emerged as a leading platform for the management of data transaction streaming. Hence, users are placing a premium on maintaining Kafka uptime by anticipating and resolving issues before Kafka clusters go down, with the resulting loss of data.
Confluent Inc., the company behind Apache Kafka continues to expand its offerings with a monitoring tool that seeks to reduce the risk of Kafka downtime and data loss by identifying and resolving issues before an instance is lost. It is also promoted as a way of preserving Kafka instances without large infrastructure investments.
The “proactive support” platform dubbed Reliable is part of Confluent’s Project Metamorphosis launched earlier this year as a next-generation event streaming platform running in the Confluent Cloud. The initiative is designed to help users scale Kafka deployments while Reliable aims to keep the event streamer up and running.
Confluent said Tuesday (Nov. 10) its Kafka support platform provides real-time analysis of cluster metadata, alerting operators of potential issues before a crash. The monitoring tool also provides performance metrics that would allow support staff to trace the root cause of a Kafka performance issues.
The company said the impetus for the Kafka platform was about 1,000 support tickets that helped it gain insights into detecting performance issues. “We proactively tell you about issues we find with [customers’ deployments] based on experience running literally thousands of clusters,” said Tim Bergland, Confluent’s senior director of developer advocacy.
Hence, the company developed a framework by which cluster metadata is fed through its collection of algorithms to gauge performance and anticipate potential problems. Real-time “health metrics” are promoted as helping support engineers identify root causes faster, cutting the time to resolve support issues by as much as 25 percent, the company claimed.
Among the most common issues affecting the scaling of Kafka’s real-time performance and the threat of data loss are network and storage bottlenecks. Overloaded networks or storage media often bring down Kafka clusters, taking with them business events and other critical data.
The managed service also is designed to help IT administrators reduce the amount of time and resources devoted to operating the relatively complex, distributed Kafka environment.
In launching Project Metamorphosis this past spring, Confluent said it planned a series of monthly product and feature upgrades through the end of the year as it fleshes out its real-time streaming platform. The managed support service is the latest in that series of offerings.
Customers running Confluent 6.0 can opt in to use the initial release of the managed Kafka service. Alerts can be sent via integration with the Confluence control center. Alternatively, users can set up alerts via email or Slack.
July 23, 2021
- Observable Introduces Data Visualization Stack for the Enterprise
- Collibra Named a Leader in Data Governance Solutions by Independent Research Firm
- Mindtech Raises $3.25M to Accelerate Growth of Synthetic Data Training Platform for AI Vision Systems
July 22, 2021
- LigaData Now Certified on Cloudera Data Platform
- Adobe Launches Adobe Analytics for Higher Education to Advance Digital Literacy
- Anaconda Releases 2021 State of Data Science Survey Results
- Alation Supports Next Generation of Data Enthusiasts, Provides Free Software and Training
- NASA Expands Access to Planet Data to All US Federal Civilian Agencies
- Google Cloud Announces Healthcare Data Engine to Enable Interoperability in Healthcare
July 21, 2021
- Deloitte, US Chamber of Commerce Report Highlights How Public Policy Can Enable Trustworthy AI
- WHO Issues First Global Report on AI in Health
- New Data Science Platform Speeds Up Python Queries
- Teradata Joins TM Forum to Support the Cloud Journeys of Global Communications Services Providers
- Confluent Named Google Cloud Technology Partner of the Year for Third Year in a Row
- Lucata Raises $11.9M Series B to Introduce Next-Gen Computing Platform
- Securonix Announces ‘Bring Your Own Snowflake’ Program to Power Security Data Lake for Snowflake Customers
- Rensselaer Team Aims to Pave Way for Robust AI in Medical Imaging
- Dremio Launches SQL Lakehouse Service to Accelerate BI and Analytics
- Spectra Logic, StorMagic Announce Active Archive Repository for Video Surveillance
- Quobyte Releases Hadoop Native Driver to Unlock the Power of Analytics, ML, Streaming
- Big Data File Formats Demystified
- Who’s Winning In the $17B AIOps and Observability Market
- Tuplex Gives Python UDFs a Performance Boost
- What’s the Difference Between AI, ML, Deep Learning, and Active Learning?
- Presto the Future of Open Data Analytics, Foundation Says
- The Data Mesh Emerges In Pursuit of Data Harmony
- Why Data Scientists and ML Engineers Shouldn’t Worry About the Rise of AutoML
- What’s Holding Us Back Now? ‘It’s the Data, Stupid’
- Achieving Data Literacy: Businesses Must First Learn New ABCs
- Composite AI: What Is It, and Why You Need It
- More Features…
- Hiring, Pay for Data Science and Analytics Pros Picks Up Steam
- Starburst Backs Data Mesh Architecture
- Confluent Raises More Than $800M in IPO
- Data Prep Still Dominates Data Scientists’ Time, Survey Finds
- Off the Couch: Database Maker Seeks $160 Million In IPO
- Let It Go: The Financial Benefits of Data Deletion
- Global DataSphere to Hit 175 Zettabytes by 2025, IDC Says
- Confluent Files to Go Public. Who Could Be Next?
- Databricks Edges Closer to IPO with $1B Round
- Teradata: We’ve Outsourced Some Hardware Support for Years
- More News In Brief…
- Splunk Launches New Security Cloud
- Red Hat Expands Workload Possibilities Across Hybrid Cloud with Latest Version of OpenShift
- JetBrains Announces Datalore Enterprise, Enabling Data Science Teams to Collaborate On-Prem
- Alluxio v2.6 Release Brings Performance, Ease of Use Improvements to AI/ML Workloads
- Yugabyte and Hasura Integration Provides Cloud Elasticity, Frictionless Application Development
- Vertica Announces Vertica 11, Delivering on Vision of Unified Analytics
- TigerGraph Expands Partner Ecosystem to Bring the Power of Graph to More Businesses
- MariaDB Collaborates with AWS to Deliver SkySQL on AWS
- DDN Selected by Bytesnet to Provide ‘Pay-Per-Use’ Storage for Data-Intensive Organizations
- Half of Financial Services Organisations Say they’ll Need ‘Intelligent Data Automation’ to Survive
- More This Just In…
Sponsored Partner Content
August 25 @ 12:00 pm - 5:00 pm
November 29 - December 3
December 6 - December 10San Diego CA United States