Operations | Monitoring | ITSM | DevOps | Cloud

Talk by Pranay on Scaling OpenTelemetry collectors with Kafka by Pranay in Conf42 SRE summit in 2024. Pranay talks about challenges with scaling Otel collectors and how Kafka can help solve it. He also shares how they use this architecture at SigNoz to scale their cloud service.

Watch this webinar to gain insights on building the next generation of data-streaming platforms and how by reframing your current approach you can reduce operational complexity and Kafka costs.

Have you heard about Apache Kafka but aren’t quite sure about its functions or applications? This webinar is tailored for you. Apache Kafka is more than just a buzzword in the tech community; it’s a critical tool for data processing and management. Join our expert-led webinar to explore the world of Apache Kafka, a powerful distributed event streaming platform. Learn how Canonical simplifies Kafka operations, offering secure, automated deployments and maintenance across various clouds.

What's in the Workshop Recipe? Apache Kafka is the industry de-facto standard for data streaming. An open-source, scalable, highly available and reliable solution to move data across companies' departments, technologies or micro-services. In this workshop you'll learn the basics components of Apache Kafka and how to get started with data streaming using Python. We'll dive deep, with the help of some prebuilt Jupyter notebooks, on how to produce, consume and have concurrent applications reading from the same source, empowering multiple use-cases with the same streaming data.

Get an introduction to Apache Kafka® Tiered Storage which enables more effective data management by utilizing two different storage types—local disk and remote cloud storage solutions such as Amazon S3, Google Cloud Storage, and Azure Blob Storage. This feature offers a tailored approach to data storage, allowing you to allocate frequently accessed data to high-speed local disks while offloading less critical or infrequently accessed data to more cost-effective remote storage solutions. Tiered storage enables you to indefinitely store data on specific topics without running out of space. Once enabled, it is configured per topic, giving you granular control over data storage needs.