Create your own data stream for Apache Kafka with Python and Faker
How can you test an empty data pipeline? Well, you can't, really. Read on and let's walk you through creating pretend streaming data using Python and Faker.
Operations | Monitoring | ITSM | DevOps | Cloud
The Place Where Modern Operations & Technology Come Together
Social search in real time: Exploring Mastodon data with Apache Kafka and OpenSearch
In an earlier blog post we talked about how to stream data from the Mastodon timeline into an Apache Kafka® cluster. If you missed it, read it to learn how to connect to Mastodon and stream data into an Apache Kafka topic. This article assumes that you already have an Apache Kafka environment running with data in a topic that is called Mastodon.
7 Best Practices for Data Visualization
A look at best practices, no-code and low-code platforms you can use, common visualization types, criteria for good data visualization and more. Organizations regularly generate an overabundance of data that is essential for decision-making. Data visualizations play an important role in helping people understand complex data and observe patterns and trends over a period of time.
Learn from the experts: BigData Boutique and Aiven talk about OpenSearch
They had me at the panel title: “Lessons learned from maintaining 10K+ OpenSearch® clusters in production”
What is data hygiene, and why is it important?
Data hygiene is a critical but often overlooked concept for businesses of all sizes. Think of any activity that involves the use and storage of data, like customer relationship management (CRM), marketing automation, customer service, or analytics; then add in trends like increasing regulations and customer expectations around privacy. Data hygiene needs to be on the top of your list when you’re managing customer relationships across multiple channels.
InfluxDB SQL Queries with Python
Recently InfluxData announced SQL support in InfluxDB Cloud, powered by IOx. Users can now use familiar SQL queries to explore and analyze their time series data. The SQL support was introduced along with the usage of Apache Arrow. Apache Arrow is an open source project used as the foundation of InfluxDB’s SQL support. Arrow provides the data representation, storage format, query processing, and network transport layers. Apache Flight SQL provides a method for interacting with Arrow via SQL.
A new year with a new look and many more...
Simplified analysis. Enhanced visualizations, alerting capabilities, advanced data forwarding, and more. Great news! We have published a new update with many exciting new features and optimizations.
Introduction to Aiven for ClickHouse
Learn how to work with Aiven for ClickHouse: create a service, explore possibilities provided by the Aiven Console, and finally use ClickHouse CLI to create a table, load data and run a couple of sample queries. CHAPTERS ABOUT AIVEN Aiven’s cloud data platform helps your business reach its highest potential by making your data work for you. It provides fully managed open source data infrastructure on all major clouds, helping developers focus on what they do best: innovate and create without worrying about the limitations of technology.
Move from batch to streaming with Apache Kafka and Apache Flink
Find out how Apache Kafka® and Apache Flink® allow you to move from batch processing to streaming, but keep using SQL in the data pipeline.
How to Use Big Data to Your Advantage
Users have been generating increasing amounts of data in the past few years, partly due to rapid digitalization since the pandemic. As a result, increasing numbers of analytics applications are capitalizing on these data assets. However, building scalable systems is no trivial task and incidents are inevitable. Complex systems generate data in the form of logs, traces, metrics, and more, which organizations often find themselves sprinting through. Such logs are a powerhouse of valuable information.