Operations | Monitoring | ITSM | DevOps | Cloud

In this article, discover how the Qovery engineering team built a high-performance Logs Interface to handle thousands of lines of data efficiently.

Most people are probably familiar with the word “grok” from Robert A. Heinlein’s novel A Stranger in a Strange Land, in which it is used to describe a deep, almost mystical understanding of something. ‍ Grok is also the name of a plugin for LogStash that enables you to parse and analyze log data using a syntax similar to regular expressions, but specialized for various log formats and fields.

Two years ago, a power outage knocked a Dropbox data center offline. It wasn’t just any data center. It was the only one where Dropbox hosted Grafana Loki, meaning engineers couldn’t access their log data. “We had considered a data center outage when we were rolling out Loki, but it had just never risen up in priority enough to get put into multiple data centers,” said Chris Hodges, an infrastructure software engineer at the cloud storage company.

Today’s public sector organizations are tasked with delivering a staggering amount of technology capabilities to support a growing set of digital services, meet IT modernization goals, and continue to protect against a wide range of attack vectors. Cloud technology adoption has played a significant role in ensuring that ongoing IT modernization not only aligns with each organization’s mission-strategic capabilities but also enables efficiencies of scale.

Elastic Cloud Serverless provides the fastest way to start and scale security, observability, and search solutions — without managing infrastructure. Today, we are excited to announce the general availability of Elastic Cloud Serverless on Microsoft Azure — now available in the EastUS region. Elastic Cloud Serverless provides the fastest way to start and scale security, observability, and search solutions without managing infrastructure.

Stateless architecture that auto-scales no matter your data, usage, and performance needs How do you take a stateful, performance-critical system like Elasticsearch and make it serverless? At Elastic, we reimagined everything — from storage to orchestration — to build a truly serverless platform that customers can trust. Elastic Cloud Serverless is a fully managed, cloud-native platform designed to bring the power of Elastic Stack to developers without the operational burden.

Today, we’re excited to announce support for AWS PrivateLink, allowing Logz.io customers to securely send logs and metrics through private VPC connectivity, without any data ever hitting the public internet. If you’re running workloads inside a VPC on AWS, this upgrade drastically improves your security posture, simplifies your networking architecture, and – most notably – reduces your data transfer costs (a lot).