Operations | Monitoring | ITSM | DevOps | Cloud

influxdata

Building Real-Time Data Pipelines with Kafka, Telegraf, and InfluxDB 3

Sep 23, 2025 By Suyash Joshi In InfluxData
When milliseconds matter and data never stops flowing, you need a pipeline that can handle high-velocity streaming data with reliability and scale. The modern streaming stack of Kafka, Telegraf, and InfluxDB 3 Core delivers exactly that. To give you a concrete example, this blog works with a fictitious use case: “Papa Giuseppe’s Pizzeria.” Every oven, prep station, and order in this pizza restaurant generates data. Our workflow looks like this.
Read Post

Grafana & Friends Stockholm meetup at 0+X

Sep 22, 2025 By Grafana In Grafana
In this talk, we’ll introduce the Kafka Data Source plugin we developed for Grafana, which enables users to query and visualise Kafka topic data directly in their dashboards—without the need for intermediate storage or external services. We'll share how the idea came about, how we collaborated with the Grafana community and developers to bring it to life, and the challenges we faced along the way. We'll also discuss our vision for the plugin’s future and its role in the evolving observability landscape.
View Video
Aiven

Diskless 2.0: Unified, Zero-Copy Apache Kafka

Sep 11, 2025 By Filip Yonov In Aiven
We’ve added Tiered Storage to Diskless Kafka—using plain old KIP-405 as the read-optimizer, Diskless Kafka materializes fast-to-read segments—unifying Tiered and Diskless into a single path. This leverages production-grade Tiered Storage plugin, removes the need for bespoke components, and simplifies the community discussion. We’ve also upgraded KIP-1150 and KIP-1163 to address the community’s most pressing questions such as transactions and queues support.
Read Post
Aiven

Getting Started with Iceberg Topics for Apache Kafka: A Beginner's Guide

Sep 4, 2025 By Aiven In Aiven
Understand how Kafka integrates with Apache Iceberg and experiment locally with Docker and Spark The streaming data landscape is evolving rapidly, and one of the most exciting developments is the integration between Apache Kafka and Apache Iceberg. While Kafka excels at real-time data streaming, organizations often struggle with the complexity of moving streaming data into analytical systems.
Read Post

Get Kafka-Nated, Ep 6: Kafka Meets Flink: The Streaming Analytics Revolution

Aug 25, 2025 By Aiven In Aiven
Wednesday July 23 2025 Guest Focus: Streaming analytics expert and Kafka-Flink integration specialist Ben Gamble from Ververica will be joining our host Hugh Evans. Ben has been at the forefront of driving Kafka-Flink integration and the streaming analytics revolution. What we’ll cover: As always we’ll offer a free coffee voucher to all attendees. Get Kafka-Nated!
View Video
Aiven

Simple Kafka for Developers: Kafka UI Directly in Your IDE

Aug 24, 2025 By Yonatan Dvir In Aiven
Developers love tools that make their lives easier. Whether it’s debugging, visualizing data, or managing clusters, the right tools can transform hours of manual work into just a few clicks. When it comes to Kafka - one of the most powerful but complex streaming platforms - having the right interface is critical. That’s exactly why we built our new Kafka UI Plugin.
Read Post

Get Kafka-Nated Ep 5: Satish Duggana, Uber - Contributing Tiered Storage to Kafka

Aug 21, 2025 By Aiven In Aiven
Wednesday August 20 2025 Guest Focus: Senior engineer and KIP-405 Tiered Storage architect Satish from Uber, will be joining our host Hugh Evans. Satish was a contributor to KIP 405 which brought tiered storage to Kafka. What we’ll cover: As always we’ll offer a free coffee voucher to all attendees. Get Kafka-Nated!
View Video
observiq

Kafka Performance Crisis: How We Scaled OpenTelemetry Log Ingestion by 150%

Aug 19, 2025 By Dakota Paasman In ObservIQ
When your telemetry pipeline starts falling behind, the countdown to production impact has already begun. One Bindplane customer operating a large-scale log ingestion pipeline built on the OpenTelemetry Collector and Kafka hit that breaking point. Instead of keeping pace with incoming data, their pipeline was ingesting just 12,000 events per second (EPS) per partition/collector—and this Kafka topic had 16 partitions. In aggregate, that was roughly 192K EPS.
Read Post
Aiven

Iceberg Topics for Apache Kafka: Zero ETL, Zero Copy

Aug 14, 2025 By Filip Yonov In Aiven
We’re rolling out table-formatted topics for Apache Kafka, enabling open-source users to ingest, process, and emit data natively as Apache Iceberg tables. We’ve developed a new class of topics in Apache Kafka that stream data into lakehouse formats such as Apache Iceberg. The developer experience, similar to Diskless, is flexible, and the topics are opt-in via cluster configuration.
Read Post

Real-Time Analytics Made Simple with Kafka and Iceberg

Aug 14, 2025 By Aiven In Aiven
AIVEN DATA PLATFORM The Aiven Platform is more than a collection of open source services for streaming, storing and analyzing data. The platform ensures that all services run reliably and securely in the clouds of your choice, are observable, and can easily be integrated with each other and with external 3rd party tools.
View Video

Copyright © 2026 OpsMatters™. All rights reserved.