Operations | Monitoring | ITSM | DevOps | Cloud

Auto-Instrumenting OpenTelemetry for Kafka

Apache Kafka, born at LinkedIn in 2010, has revolutionized real-time data streaming and has become a staple in many enterprise architectures. As it facilitates seamless processing of vast data volumes in distributed ecosystems, the importance of visibility into its operations has risen substantially. In this blog, we’re setting our sights on the step-by-step deployment of a containerized Kafka cluster, accompanied by a Python application to validate its functionality. The cherry on top?

Introduction to Klaw

This video goes over a few problems faced by Kafka based projects and how an open source toolkit like Klaw helps in addressing the issues. Klaw is an open source toolkit / a web application designed to automate the process of creating and managing Apache Kafka topics, authorizations, avro schemas and connectors. Useful links: ABOUT AIVEN Aiven’s cloud data platform helps your business reach its highest potential by making your data work for you.

Complete Guide to tracing Kafka clients with OpenTelemetry in Go

OpenTelemetry can be used to trace Go applications that use Kafka to find performance issues and bugs. OpenTelemetry is an open-source project under the Cloud Native Computing Foundation (CNCF) that aims to standardize the generation and collection of telemetry data. Telemetry data includes logs, metrics, and traces. Apache Kafka introduced the ability to add headers to Kafka messages from version 0.11 onwards.