Operations | Monitoring | ITSM | DevOps | Cloud

July 2023

Removing the first line from a Flat file in Logic Apps

Welcome again to another Decoding Logic App Dilemmas: Solutions for Seamless Integration! This time we selected a real problem presented by a client during one of our Logic Apps training courses: How to remove the first line from a flat file (CSV)! In this case, we have a CSV file where the first line contains the column headers that we want to see removed from the message in order to process only the data.

Navigating the Serverless Landscape: Lessons from our Tracing Collector API Journey

In the previous blog in this series, we delved into the redesigned architecture of Amazon Prime Video and how they integrated different architectural styles for optimal performance and cost efficiency. We also discussed the impact of Amazon’s decision on the concept of a “serverless-first” mindset, highlighting the importance of considering alternative architectural approaches based on specific use cases and requirements.

What Is AWS Lambda? A Straightforward, No BS Guide

Amazon Web Services (AWS) offers over 200 services. But AWS Lambda continues to stand out for several reasons. This AWS Lambda tutorial will help explain Lambda in simple terms so you can decide if the service is suitable for your computing needs. We’ll cover what exactly AWS Lambda is, how it works, how it compares to EC2, use cases, benefits, limitations, and more. Additionally, we’ll cover how you can monitor and manage your Lambda costs without the burden of cost management.

Integrate RabbitMQ with Logic Apps using Azure Functions

Unfortunately, no Logic App connector can make the bridge to RabbitMQ, which makes this integration challenge a little bit more complicated. However, we have the ability to create an Azure Function by using the RabbitMQ trigger for Azure Functions to overcome this limitation. The purpose of this POC is to receive a message in a RabbitMQ queue, and that event triggers an Azure Function, which fires a Logic App.

Lower Your AWS Lambda Bill by Increasing Memory Size- yep!

Lambda allows you to allocate memory for your functions in increments of 1 MB, ranging from a minimum of 128 MB to a maximum of 10,240 MB (10 GB). When we specify the memory size for a Lambda function, AWS will allocate CPU proportionally. For example, a 256 MB function will receive twice the processing power of a 128 MB function.

8 Challenges of Microservices and Serverless Log Management

As organizations increasingly adopt serverless architectures and embrace the benefits of microservices, managing logs in this dynamic environment presents unique challenges. In this blog, we’re taking a closer look at the differences between serverless and traditional log management, as well as 8 challenges associated with log management for serverless microservices.

Kubernetes Community Day Munich Recap: A Meeting of Tech Minds and Ideas

This July, the community spirit was profoundly vibrant in the scenic city of Munich, as Kubernetes Community Day (KCD) Munich brought together a meeting of minds and inspired the open-source collaboration we all know and love. The event was a testament to the strength and vitality of the Kubernetes community, which pulsed with an energy of shared intellectual curiosity and passion for all things Kubernetes.

Understanding AWS Lambda proactive initialization

AJ Stuyvenberg is a Staff Engineer at Datadog and an AWS Serverless Hero. A version of this post was originally published on his blog. In AWS Lambda, a cold start occurs when a function is invoked and an idle, initialized sandbox is not ready to receive the request. Features like Provisioned Concurrency and SnapStart are designed to reduce cold starts by pre-initializing execution environments.

How Zesty's Programmers and Ops Team Troubleshoots Kubernetes in Minutes

Using Lumigo's end-to-end distributed tracing that surfaces critical payload data, Zesty is able to find the root cause of errors in their microservice-based apps without using logs. Make sure to subscribe so you don't miss out on any new livestreams and observability content! With one-click distributed tracing, Lumigo lets developers effortlessly find and fix issues in serverless and containerized environments.

Debunking Misconceptions: Amazon Prime Video's Approach to Microservices and Serverless

This is the second blog in our deep dive series on serverless architectures. In the first installment, we explored the benefits and trade-offs of microservices and serverless architectures, highlighting the case of Amazon Prime Video's architectural redesign for cost optimization.

Proven methods for elevating end-to-end tracking in Azure/Hybrid Integrations

Tracking end-to-end message or business data across Azure/hybrid integration and implementing end-to-end tracking presents a significant challenge for many organizations. To solve this problem, many rely on various monitoring tools like Log Analytics, App Insights, etc., designed for developers. However, when it comes to supporting applications in production or real-time for non-technical Azure operations/support teams, this approach can be challenging in terms of security and expertise.

Azure Rightsizing: Maximizing Performance and Minimizing Costs

Organizations increasingly leverage Azure to host their applications and services in today’s cloud-driven world. However, efficiently managing Azure resources ensures optimal performance, cost-effectiveness, and resource utilization. One essential aspect of resource management is rightsizing. In this blog post, we’ll explore the concept of rightsizing Azure resources and provide practical tips on optimizing your deployments.

The Smart and Efficient Way to Test Serverless Architectures

Serverless architectures allow developers to focus on their code, and not worry about infrastructure. But just because it’s “serverless” doesn’t mean it doesn’t need testing, or that testing needs to be hard. Whether you’re working with API Gateway, AppSync, Step Functions or Event-Driven Architectures, Yan Cui will show you how to test it.

Lambda monitoring: Combining the three pillars of observability to reduce MTTR

Observability & monitoring can be challenging when it comes to distributed applications, serverless architectures being a typical examples of that. As with any other service that we run, we need to understand how our Lambda functions are executed, how to identify issues, and how to optimize performance.

Introducing Trace Endpoint Mapping

At Lumigo, we see ourselves as your reliable ally in the noble mission of detecting and vanquishing troublesome issues that lurk within your serverless and container applications. Our secret sauce? Equipping you with a wealth of detailed trace data, ensuring you’re always well-lit and ready for battle when the nefarious ‘bugs’ make their unsolicited appearances.

What are Azure Functions?

Serverless computing, also known as Functions as a Service (FaaS), has taken the world of cloud computing by storm. A game-changer in its own right, serverless computing has completely transformed the way developers approach and design their applications by abstracting the underlying infrastructure layer. But what makes it a powerful paradigm shift?

Azure Unit Cost Analysis for Cloud cost optimization

As organizations embrace cloud computing, understanding, and optimizing costs becomes essential. Azure, Microsoft’s cloud platform, offers various services and features to help you manage your cloud expenses effectively. One powerful technique to achieve this is by performing Azure unit cost analysis. In this blog post, we will explore the concept of unit cost analysis and provide a step-by-step guide on performing it in Azure.

Decoding Logic App Dilemmas: Nested JSON schema validation

Welcome again to another Decoding Logic App Dilemmas: Solutions for Seamless Integration! This time we selected a problem related to a few tips and tricks I have been writing Message validation inside Logic Apps or JSON schema validation. One of our previous dilemmas addressed this complex topic: Decoding Logic App Dilemmas: How to validate if a JSON property is not an empty string? , of course, describing and addressing a different problem.

Troubleshooting Bad Health Checks on Amazon ECS

Health checks are an important factor when working with containerized applications in the cloud and are the source of truth for many applications in terms of their running status. In the context of AWS Elastic Container Service (ECS), health checks are a periodic probe to assess the functioning of containers. In this blog, we will explore how Lumigo, a troubleshooting platform built for microservices, can help provide insights into container crashes and failed health checks.

Log-Free Troubleshooting

With piles of logs generated from every function, container and API in your microservice-based application, how can you easily surface meaningful information so you can debug quickly? You don’t. You let Lumigo do it for you. In this live product training, we’ll share every tip and trick in Lumigo that will save you time and stop you from digging through logs when errors occur. Make sure to subscribe so you don't miss out on any new livestreams and observability content!

Logic App Best Practices, Tips, and Tricks: #36 How to process an Array or a single object JSON structure in the same manner

Today I will speak about another helpful Best Practice, Tips, and Tricks that you must consider while designing your business processes (Logic Apps): How to process an Array or a single object JSON structure in the same manner.