Operations | Monitoring | ITSM | DevOps | Cloud

January 2024

The Rise of Applied Observability, AIOps, and GenAI in Enterprises

CloudFabrix’s Macaw Conference for Observability and AIOps garnered traction and showcased modern solutions to modern IT problems in enterprises. This is a summary of the conference. CloudFabrix CMO – Shailesh Manjrekar kicked off the conference by delivering the keynote by talking about the General Market Trends & highlighting the Modern IT challenges faced by Enterprises during their Digital Transformation journey.

How to Leverage Generative AI in IT Operations

Although Generative AI traces its origins to the earliest machine learning models in the 1950s, its popularity and usage has accelerated exponentially over the past year after OpenAI issued the first public release of its ChatGPT (generated pre-trained transformer) AI chatbot in December 2022. Generative AI holds the potential to transform many professions including IT operations.

AI on-prem: what should you know?

Organisations are reshaping their digital strategies, and AI is at the heart of these changes, with many projects now ready to run in production. Enterprises often start these AI projects on the public cloud because of the ability to minimise the hardware burden. However, as initiatives scale, organisations often look to migrate the workloads on-prem for reasons including costs, digital sovereignty or compliance requirements.

AI + Automation: A Trusted Copilot for ITOps in the Digital Age

We’re living in an unprecedented moment in time. Data is reshaping our world. From enterprise networks and the cloud to the smart refrigerators in our kitchens and the watches on our wrists, data is proliferating at an unprecedented scale, both in volume and velocity. As data owners, we continuously strive to monitor and derive intelligent insights from this data so we can catch performance anomalies and issues – from misconfigured systems to a skipped heartbeat – and quickly intervene.

Question Time: GenAI for Customer Experiences | ServiceNow

Yes, generative AI is a BIG deal. Brian Solis, head of global innovation at ServiceNow, shares how every organization is going to have to reimagine their business for an AI-first world. Plus, get some practical examples of how AI can improve the customer experience (like giving people what they want before they even know they want it!). Take Brian’s advice and allow your curiosity to run wild — reply in the comments with creative ways you plan to use #GenAI.

Question Time: GenAI for Developing on the Now Platform | ServiceNow

Sometimes you have to see it to believe it. That was the case for Tom Freeman, a self-proclaimed generative AI skeptic and director of technical marketing here at ServiceNow. Tom sits down to answer questions about how genAI will impact developing on the Now Platform, the value of our large language model, and what’s coming next in this space. See it to believe it.

Question Time: GenAI for IT | ServiceNow

The consensus is in: Generative AI is a game-changer. Rajeev Sethi, VP of digital technology and emerging technologies at ServiceNow, discusses how genAI can improve KPIs across the business from employee satisfaction to mean time to resolution (MTTR). Now, we turn the question to you — what are some ways your workplace is using generative AI?

Question Time: GenAI and the Future of Work | ServiceNow

AI isn’t new to ServiceNow — we’ve been innovating in the space for nearly a decade. ServiceNow’s Chief Transformation Officer Kelley Steven-Waiss shares how generative AI will help employees focus on the work that matters most, get the right insights, and take the right actions. Watch until the end for her personal favorite way to use Now Assist. Now it's your turn in the hot seat — Have you discovered any innovative uses of AI at work? Drop your knowledge in the comments.

Integrating AI and DevOps for Software Development Teams

For a long time, the domains of Machine Learning and AI on one side, and software development on the other side, were separate kingdoms. Sometimes, they touched, and something magical would happen. But more often, things didn’t really work out. They faced challenges stemming from a lack of mutual understanding, shared language, and compatible tools. With the meteoric rise and increased accessibility of powerful generative AI and LLMs, the need for collaboration to achieve real-world engineering and customer value has never been more vital.

Role of Human Oversight in AI-Driven Incident Management and SRE

In the fast-paced landscape of technology, AI-driven Incident Management and Site Reliability Engineering (SRE) have emerged as critical components in ensuring the seamless functioning of digital systems. AI algorithms are increasingly employed to detect, diagnose, and resolve incidents with unprecedented speed and efficiency, revolutionizing the traditional approaches to reliability.

LLM hallucinations: How to detect and prevent them with CI

An LLM hallucination occurs when a large language model (LLM) generates a response that is either factually incorrect, nonsensical, or disconnected from the input prompt. Hallucinations are a byproduct of the probabilistic nature of language models, which generate responses based on patterns learned from vast datasets rather than factual understanding.

What Will 2024 Bring to the ITOps World? OpsRamp's Technology Leaders Make Their Predictions

If one story stands out in the tech industry for 2023, it was the coming-out party for generative AI. OpenAI’s ChatGPT artificial intelligence chatbot, which was publicly released late in 2022, seized the industry’s imagination in 2023, becoming the fastest-growing consumer application ever. The technology quickly evolved throughout 2023 with a paid subscription service; an API; iOS and Android versions; an enterprise version; plug-ins; and an AI image generator.

Elastic recognized with 2024 EMA Allstars award for its AI-assisted observability

We are thrilled to be recognized with the 2024 EMA Allstars award. This award acknowledges Elastic’s focus on delivering a full-stack observability solution that provides unified visibility and AI-powered insights into complex hybrid cloud deployments. The EMA Allstars award celebrates trailblazers and innovators who are reshaping the enterprise technology landscape.

The Debrief: Building AI-Related Incidents

Recently we went live with one of our biggest product launches to date AI. And this product was unique in that it was broken up into four smaller projects: So naturally most folks might be wondering: What were the biggest differences between these projects and what went into actually building out each of these features? In this episode, you'll hear from Rob and Isaac, both Product Engineers who played a really critical role in the building out of related incidents, to get a peek behind the curtain.

Exploring Tech's Influence on Cutting-Edge Annual Reports

In the era of digital transformation, the business landscape has evolved dramatically. This progression is vividly evident in the realm of annual reports, where technology has sculpted a cutting-edge revolution. No longer are annual reports confined to bland, printed documents. Instead, they've morphed into dynamic, interactive digital experiences that powerfully communicate a company's successes, challenges, and aspirations. This transformation has not only redefined how information is presented but also reshaped stakeholder engagement, making transparency and accessibility a new norm in business communications.

The Impact of Technology on Modern-Day Legal Practice

Modern technology has rvolutionizd the way lgal professionals approach their work. By harnssing th powr of technology, lawyrs can now lvrag advancd tools and softwar to perform tasks that wr onc tim consuming and labor intnsiv. For xampl, lgal rsarch, which usd to involv manual sarchs through numrous books and lgal databass, can now b don with a fw clicks of a button. Onlin databass and sarch ngins have provided lawyrs with accss to vast rpositoris of lgal information at thir fingrtips, dramatically incrasing th spd and accuracy of thir rsarch.

Building a GPT-style Assistant for historical incident analysis

Like most things, our AI Assistant started out as an idea. One of our data scientists, Ed, was working with our customers to improve our existing insights. But the most common theme that kept surfacing was the wide-range of use cases that our customers wanted to use insights for. Using this user feedback as our inspiration, we came up with the idea of a natural language assistant that you can use to explore your incident data.

The Debrief: incident.io, say hello to AI

This week was a particularly exciting one for us at incident.io. We launched not one, not two, but four AI-powered features to help folks get the most out of their incidents. In this episode of The Debrief, we sit down with Ed Dean, Product Analyst, and Charlie Revett, Product Engineer, to talk through all of these features and discuss how they're already making a measurable impact. You'll also hear them talk about: You can learn more about our AI features here.

EMA explores Elastic AI Assistant for Security

Spoiler alert: it’s great! Elastic Security has been making waves among busy security analysts everywhere with the launch of Elastic AI Assistant. Whether it’s synthesizing alert details and suggesting next steps, or the recent addition from Elastic 8.11 to generate ES|QL queries from natural language, there’s a lot to love about Elastic AI Assistant for security efforts.

AI at Splunk: Trustworthy Principles for Digital Resilience

There’s no doubt AI will radically reimagine the way we live, work and interact. It will empower new ways to solve business challenges and deliver customer value, but such a widespread impact requires a holistic approach. Building AI responsibly is one thing, but embedding trust into every aspect of our AI strategy is another entirely – and that’s what Splunk sets out to do.

Lessons learned from building our first AI product

Since the advent of ChatGPT, companies have been racing to build AI features into their product. Previously, if you wanted AI features you needed to hire a team of specialists to build machine learning models in-house. But now that OpenAI’s models are an API call away, the investment required to build shiny AI has never been lower. We were one of those companies. Here’s our journey to building our first AI feature, and some practical advice if you’ll be doing the same.

Make AI Writing Undetectable with These Helpful Tips

Artificial Intelligence (AI) has revolutionized the writing field, proving itself a capable author of anything from news articles to short stories. However, one of the common challenges people face is making AI-generated text sound as human and natural as possible. Namely, AI-generated text can be identified by its lack of personal touch, and writers need to create their content that could effectively engage and entice readers. So how can one make AI writing undetectable and incorporate it seamlessly into their work? Let's explore some helpful tips.

Unleashing the power of AI and automation for effective Cloud Cost Optimization in 2024

In the current dynamic business environment, cloud computing has emerged as the fundamental driver of innovation and scalability. As companies increasingly rely on the cloud for their business initiatives achieving cloud cost optimization remains a significant hurdle.

Supercharged with AI

One of the most painful parts of incident management is keeping on top of the many things that happen when you’re right in the middle of an incident. From figuring out and communicating what’s happening, to ensuring you learn from previous incidents, and even capturing the right actions – incidents are hard, but they don’t need to be this hard.

Challenges & limitations of LLM fine-tuning

Large Language Models (LLMs) like GPT-3 have revolutionized the field of artificial intelligence, offering unprecedented capabilities in natural language processing. Fine-tuning these models to specific tasks or datasets can enhance their performance. However, this process presents unique challenges and limitations that must be addressed. This article explores the intricacies of LLM fine-tuning, shedding light on the obstacles and constraints faced in this advanced AI domain.

Emerging AI use cases in ITSM Knowledge management, chatbots and self-service

AI experts Louis Columbus and Susan Fung explore AI use cases in IT service management, highlighting how a symbiotic relationship between AI and human intelligence amplifies knowledge management capabilities and enhances user experiences by providing direct answers that synthesize complex information.

Navigating AI in SOC

With notable advancements in Artificial Intelligence (AI) within cybersecurity, the prospect of a fully automated Security Operations Center (SOC) driven by AI is no longer a distant notion. This paradigm shift not only promises accelerated incident response times and a limited blast radius but also transforms the perception of cybersecurity from a deterrent to that of an innovation enabler.

What's in store for AI in 2024 with Patrick Debois

In this episode, Rob is joined by Patrick Debois, a seasoned industry expert and DevOps pioneer. Patrick shares his personal odyssey within the realm of DevOps, reflecting on the current state of the industry compared to his initial expectations. The conversation delves into the convergence of business analytics and technical analytics, exploring innovative approaches developers are adopting to integrate generative AI into their products.

Prompt engineering: A guide to improving LLM performance

Prompt engineering is the practice of crafting input queries or instructions to elicit more accurate and desirable outputs from large language models (LLMs). It is a crucial skill for working with artificial intelligence (AI) applications, helping developers achieve better results from language models. Prompt engineering involves strategically shaping input prompts, exploring the nuances of language, and experimenting with diverse prompts to fine-tune model output and address potential biases.

How AI can change the game in the database and streaming system optimization field

The net result of an AI-powered optimization process is not only a better data experience, but also increased developer productivity. Once the teams are aware of what can be automated, the improvements can not only speed things up but reduce costs.

Tech trends to watch in 2024

The past year has seen a transformational change in the cloud computing landscape, spearheaded by the advent of AI technology, the ongoing economic challenges for businesses to achieve successful results, and the evolving data regulations surrounding security and privacy. To navigate these changes, and create future opportunities, here are the major trends for 2024 and beyond.

5 Cutting-Edge Technologies Transforming Prisons Today

The concept of prison technology might conjure images of grainy security cameras and clunky metal detectors. But the reality is far more nuanced, with a wave of innovative solutions emerging to reshape correctional facilities. These advancements prioritize heightened security and improved well-being for inmates and staff, paving the way for a more humane and effective system.

AI in 2024 - What does the future hold?

2023 was an epic year for artificial intelligence. In a year when industry raced faster than academia in machine learning (source), the state of the art for AI evolved to include increasingly larger amounts of data, and bringing to bear sufficient computing resources to support new use cases remained a challenge for many organisations. With the rise of AI, concerns were not far behind.

Top tips: Symbiotic intelligence-the intersection of AI and simulation technologies

Top tips is a weekly column where we highlight what’s trending in the tech world and list ways to explore these trends. This week, we’re discussing strategies that will help enhance the role of simulation technology in advancing the capabilities of AI.

Taking the Gold Rush to the regions

2023 was the year of Artificial Intelligence (AI). 2024 will build on the incredible momentum of the likes of ChatGPT, Google Bard, Microsoft CoPilot, and others, delivering applications and services that apply AI to every industry imaginable. A recent analysis piece from Schroders makes the point well: “The mass adoption of generative Artificial Intelligence (AI) …has sparked interest akin to the Californian Gold Rush.”

LLM Observability with OpenTelemetry and SigNoz

In the rapidly evolving world of Large Language Models (LLMs), ensuring peak performance and reliability is more critical than ever. This is where the concept of 'LLM Observability' comes into play. It's not just about monitoring outputs; it's about gaining deep insights into the internal workings of these complex systems.

AI, Privacy and Terms of Service Updates

Like everyone else in the world, we are thinking hard about how we can harness the power of AI and machine learning while also staying true to our core values around respecting the security and privacy of our users’ data. If you use Sentry, you might have seen our “Suggested Fix” button which uses GPT-3.5 to try to explain and resolve a problem. We have additional ideas being developed as well that we’re excited to preview.