Operations | Monitoring | ITSM | DevOps | Cloud

Testing the new Elasticsearch cold tier of searchable snapshots at scale

The cold tier of searchable snapshots, previously beta in Elasticsearch 7.10, is now generally available in Elasticsearch 7.11. This new data tier reduces your cluster storage by up to 50% over the warm tier while maintaining the same level of reliability and redundancy as your hot and warm tiers.

A Partnership Between InfluxData and Ockam Brings Trust to Time Series Data

This article is a re-post of the article written by Matthew Gregory and published on the Ockam blog. Let’s investigate how to build applications with trusted time series data in a zero trust environment! To trust an application we need to trust the data that feeds into it. Increasingly, applications rely on time series data from outside the datacenter, at the edge, or in IoT. This means we need to think of trust and data in new ways.

Advanced Link Analysis: Part 1 - Solving the Challenge of Information Density

Link Analysis is a data analysis approach used to discover relationships and connections between data elements and entities. This is a very visual and interactive technique that can be done in the Splunk platform – and is almost always driven by a person, an analyst or investigator, to understand the data and discover necessary insights specific to the business problem at hand.

Monitoring InfluxDB 2.0 in Production and at Scale

One of the great things about InfluxDB is that it is really easy to get up and running, and it doesn’t require much monitoring when you are dealing with datasets that fit well on your local dev machine. Once you start using InfluxDB in production and pushing orders of magnitude more data into the system, it’s critical to monitor how your instance is performing so that you can proactively respond to things like disk or network failures, memory saturation, and write or query loads.

InfluxDB Cloud is on Microsoft Azure Marketplace

Here at InfluxData, we’ve been focusing recently on deepening our support for Microsoft Azure. First we turned on InfluxDB Cloud on Azure West Europe, in Amsterdam, back in July. Then we launched InfluxDB Cloud on Azure East US, in Virginia, in September. Today, we’re pleased to announce that InfluxDB Cloud joins InfluxDB Enterprise on Azure Marketplace.

Creating a Day of Week Runtime Field and Using It in Kibana

The video contains a demonstration of the creation of a runtime field in which the day of the week is calculated from a timestamp field that contains the date. A visualization is then created in Kibana Lens using an indexed field and the newly created runtime field. Runtime field is the name given to the implementation of schema on read in Elasticsearch.

Shadow an Indexed Field With a Runtime Field to Fix Errors

The video contains a demonstration of using a runtime field to fix errors in the indexed data. We intentionally index documents with some errors, and then use a runtime field to shadow the indexed field. The demonstration shows how a user querying the data or creating a visualization in Kibana Lens will see the correct information, which is calculated in the runtime field. This scenario allows for immediate fixing of errors in the indexed data by shadowing them with runtime fields (instead of reindexing). Runtime field is the name given to the implementation of schema on read in Elasticsearch.

TL;DR InfluxDB Tech Tips - the Easiest Way to Use and Create InfluxDB Templates

If you didn’t already know, one of the perks of InfluxDB 2.0 is having access to templates. InfluxDB templates allow you to easily apply a variety of preconfigured resources including Telegraf configurations, buckets, dashboard, tasks, and alerts to your InfluxDB instance. In this TL;DR we’ll walk through the easiest way to use and create a template.

Dynamically Created Runtime Fields

The video contains a demonstration of the creation of an index template that defines that unknown fields will be created as runtime fields. Documents are then indexed into an index that inherits from that template, and because these documents contain fields that are not defined in the template, the fields are automatically created as runtime fields (i.e. these fields are usable for search and aggregation, but are not indexed). Runtime field is the name given to the implementation of schema on read in Elasticsearch.

Elastic 7.11 released: General availability of searchable snapshots and the new cold tier, and the beta of schema on read

We are pleased to announce the general availability (GA) of Elastic 7.11. This release brings a broad set of new capabilities to our Elastic Enterprise Search, Observability, and Security solutions, which are built into the Elastic Stack — Elasticsearch and Kibana. This release enables customers to optimize for cost, performance, insight, and flexibility with the general availability of searchable snapshots and the beta of schema on read.