Operations | Monitoring | ITSM | DevOps | Cloud

Insights are how your team tracks interesting observations, analysis and optimization work in CloudZero. Each one records the opportunity and its status, so the work gets sized, assigned, and closed out. Teams now do a lot of this work in an AI assistant. For example, you can ask Claude which instances sat idle last month, and it will tell you. But if you have to switch to CloudZero and fill out a form to log that finding, some findings won’t get logged.

AI cost per customer is each customer's attributed share of your AI spend: API tokens, inference infrastructure, and per-seat AI tools, measured against that customer's revenue. It matters because AI usage is wildly uneven across customers, so healthy blended margins can hide individual customers you serve at a loss. It's cost to serve, not acquisition cost. Cost per customer is the metric CloudZero was built around.

AI cost per query is your total AI serving spend divided by the number of queries served over the same period. It combines model API charges (input and output tokens), retrieval and orchestration overhead, and shared infrastructure. Most production text queries cost between $0.0005 and $0.02. It's the base unit of AI unit economics, and the number finance needs before any ROI claim holds up.

Azure cost exports sometimes fail with a server error and then succeed on the next try. Some reports cover only part of the month. Large tenants get rate-limited when they request a lot of data at once. Each of these things can leave a gap in your Azure history. You normally find the gap when finance compares the Azure total in CloudZero to the Microsoft invoice.

AI Signals adds a standard set of AI dimensions to your dimension picker, plus custom dimensions built from your own data. Not every team needs all of them. The ones you don’t use make the ones you want harder to find. Cleaning that up used to require an engineer to run a script every time an account team needed a change. We identified the bottleneck and automated it, so account teams can manage dimensions themselves and engineering stays focused on product work.

Every number in CloudZero comes from a billing connection. When a credential expires or a permission changes, that connection stops sending data, and your reports show less spend than you actually have. If you catch it early, you can fix the connection before month-end close. You also need to know what broke. For Azure and Snowflake connections, CloudZero now tells you which check failed, so you can send the fix to the right person without opening a support ticket.

Training an AI model costs anywhere from a few hundred dollars to several hundred million, depending entirely on what “train” means. Fine-tuning an existing model: tens to thousands of dollars. Pretraining a small model from scratch: tens of thousands to millions. A frontier run in 2026: hundreds of millions, with Epoch AI projecting the largest runs will pass $1 billion by 2027.

You can already break down cloud spend by team, product, or customer in Explorer. But AI spend has been harder to decompose. Which models is each team running? What activity is driving the cost growth you saw this month? Before AI Explorer, answering those questions meant exporting raw event data and building your own breakdowns, or waiting days for reconciled billing to land in Explorer.