Operations | Monitoring | ITSM | DevOps | Cloud

The latest News and Information on Log Management, Log Analytics and related technologies.

Case Study: Building an Operations Dashboard

Picture a simple E-commerce platform with the following components, each generating logs and metrics. Imagine now the on-call Engineer responsible for this platform, feet up on a Sunday morning watching The Lord of The Rings with a coffee, when suddenly the on-call phone starts to ring! Oh no! It’s a customer phoning, and they report that sometimes, maybe a tenth of the time, the web front end is returning a generic error as they try to complete a workflow.

Webinar Recap: How to Get More Out of Your Log Data

Data explosion is prevalent and impossible to ignore in today’s business landscape, with organizations face a pressing challenge: the ever-increasing volume of log data. As applications, systems, and services generate a torrent of log entries, it becomes crucial to find a way to navigate this sea of information and extract meaningful value from it. How can you turn the overwhelming volume of log data into actionable insights that drive business growth and operational excellence?

The Data Scientist Role Explained: Responsibilities, Skills & Tools

As one of the most innovative, in-demand roles on the market, data scientists are responsible for harnessing the power of data to make valuable predictions and decisions. This blog post takes an in-depth look at what a data scientist does, from mining structured and unstructured data and extracting useful information to using advanced algorithms and technologies like machine learning and artificial intelligence (AI) for decision-making.

Understanding Kubernetes Logs and Using Them to Improve Cluster Resilience

In the complex world of Kubernetes, logs serve as the backbone of effective monitoring, debugging, and issue diagnosis. They provide indispensable insights into the behavior and performance of individual components within a Kubernetes cluster, such as containers, nodes, and services.

Sematext Update Review Episode 2 | New Product Features

The first half of 2023 has been a fantastic year thus far. We are super excited to share with you some of the newest updates and improvements we have made to your favorite monitoring tools inside of the sematext cloud. Whether you work in DevOps for a multi-billion dollar company or if you are a freelancer who owns an online business, Sematext has the perfect monitoring solution for you. Today, we will discuss our new OpenSearch integration, Changes we have made to Sematext Synthetics for HTTP monitoring, and UI changes we have made to the events tool.

Setting Up a Data Loop using Cribl Search and Stream Part 1: Setting up the Data Lake Destination

In the very first video of the series, we delve into the concept of a data loop and why it is beneficial to use Cribl Search and Cribl Stream to optimize the use of a data lake. The video gives a concise overview of Cribl Search and Cribl Stream, and how they work in tandem to create a data loop. We then provide step-by-step instructions on how to configure the Cribl Stream "Amazon S3 Data Lake" Destination to transfer data from Stream to an S3 bucket that has been optimized specifically for Cribl Search's access. Finally, we demonstrate sending sample data to the S3 bucket and present a before-and-after view of the bucket to showcase the impact of the test data.

Setting Up a Data Loop using Cribl Search and Stream Part 2: Configuring Cribl Search

In the second video of our series, we delve into the nuts and bolts of configuring Cribl Search to access the data that we've stored in the S3 bucket. The video guides you step-by-step through the process of configuring the Search S3 dataset provider by using the Stream Data Lake destination as a model for the authentication information. From there, we proceed to walk through the process of creating a Dataset to access the Provider that we've just established. To wrap things up, we demonstrate how to search through the test data that we've previously stored in the S3 bucket.

Setting Up a Data Loop using Cribl Search and Stream Part 3: Send Data from Cribl Search to Stream

The third video of our series focuses on utilizing Cribl Stream to manage data. The presenter takes us through the process of configuring the Cribl Stream in_cribl_http source in tandem with the Cribl Search send operator to collect data. We are able to witness live data results being sent from Search to Stream. Afterward, we demonstrate creating a Route in Stream to direct the incoming data from Search (via the in_cribl_http) Source to the Data Lake by using the Amazon S3 Data Lake Destination. This step employs a passthrupipeline to ensure that the data is not altered in transit.