BlogBusiness case
What an AI workflow costs once review and rework are counted
Compare AI options on the cost of a handled case rather than the cost of a token. That figure adds model calls, the platform around them, the minutes people spend reviewing and correcting, the cases passed back for manual handling and the fixed cost of building and running the system, then divides by the cases actually completed. Calculate the same figure for today's process, and the comparison becomes fair.
Why the token price answers a narrower question
The FinOps Foundation describes how AI unit economics usually begins with cost per token and matures towards outcome measures such as cost per agent action or cost per case deflected. The token price is a resource metric. It tells an engineer whether a design is efficient, but not whether the process got cheaper.
Even the model line is harder to predict than a price list suggests. A case may take several calls, retries and long context, and an agent can loop. The AWS Generative AI Lens recommends stopping conditions for long-running agent workflows so that the maximum cost of a run can be predicted. Prices also move, and the FinOps Foundation's AI paper notes that they can change sharply in either direction.
The lines in a cost per handled case
- Model usage for every step of a case, including retries.
- A share of the platform: hosting, retrieval, logging and monitoring.
- Review time: minutes per reviewed case, times the share of cases reviewed, times the loaded hourly cost of the reviewer.
- Escalations: cases passed back to people and handled as they are today.
- Corrections: errors found after completion, including the extra work they cause further down the process.
- Fixed costs: the build spread over an agreed period, plus maintenance, evaluation runs and model upgrades.
Divide by cases completed, not cases attempted. A case that was escalated is still a handled case, but its cost is the manual cost plus whatever the system spent before giving up.
A worked example with its assumptions
Every number below is hypothetical and chosen for easy arithmetic. Assume 10,000 service requests a month. Today each takes 12 minutes at a loaded cost of 48 euros an hour, so 9.60 euros per case and 96,000 euros a month.
- Model and platform: 0.30 euros per case, 3,000 euros in total.
- The system completes 80 percent of cases, each reviewed in 2 minutes: 8,000 times 1.60 euros, 12,800 euros.
- 20 percent are escalated and handled manually: 2,000 times 9.60 euros, 19,200 euros.
- 3 percent of completed cases need a 20-minute correction later: 240 times 16 euros, 3,840 euros.
- Fixed: a 120,000 euro build spread over 24 months plus 4,000 euros of monthly upkeep, 9,000 euros.
The total is 47,840 euros, or 4.78 euros per handled case against 9.60 today. Model and platform account for about 6 percent of it. In this example, review and escalations together make up about two thirds of the cost.
Which assumptions move the result
Change one assumption at a time. If the escalation rate rises from 20 to 35 percent, the cost per case goes from 4.78 to 5.91 euros. If review takes 4 minutes instead of 2, it reaches 6.06 euros. Halving the model and platform cost lowers it only to 4.63 euros. In a design like this one, measured review minutes and escalation rates decide the business case. In a high-volume agent with long loops and little review, the model line can dominate instead, so run the calculation for your own design.
Collecting the numbers during the pilot
The FinOps Foundation calls planting instrumentation during development the cheapest early step: tag resources and emit a usage counter so that the denominator exists later. For a process, that means tagging every model call with a case ID, recording when a reviewer opens and closes a case, logging each escalation and correction with a reason, and taking fixed costs from contracts. Keep the figure as a trend for one process rather than comparing it with unrelated teams.
Comparing designs on the same formula
Run today's process, a bought product, your own build and a simpler rules-based workflow through the same calculation. Any saving stays conditional until the pilot has measured escalation, review and correction rates on real cases. Benefits that are not cost, such as faster turnaround, belong next to the figure rather than inside it. When we build process agents, we report this figure per handled case in euros, next to the share of cases escalated and the share the agent got wrong.
Budgeting for the people who review AI workWhat an AI pilot must prove
Questions
Should staff time count if nobody's role changes?
Yes. Record the minutes either way. Freed time is capacity the business can use for other work or for more volume, and how to value it is a management decision. Hiding review time makes every option look cheaper than it is.
How should the build cost be spread?
Over the period you realistically expect to run the system without a major rebuild, stated openly. Show the figure with and without the build share, because the second number is what the process costs to keep running.
What if the model cost does dominate?
Then model choice, routing, caching and context size become the levers worth working on, and each change should be checked against the same test set so that a cheaper setup does not quietly lower quality.
Related services
More from the blog
Human review budget
How to budget reviewer hours before automating a process: review modes, a capacity sheet with peak days, faster reviews and when the review share may fall.
AI pilot success criteria
What an AI pilot has to show before the next stage is funded, and how to write acceptance criteria before anyone chooses a tool.
AI build or buy
How to decide between buying an AI product and building around the systems you already run, and what your team owns and maintains in each case.
Sources
- FinOps Framework capability: Unit Economics (FinOps Foundation)
- FinOps for AI Overview (FinOps Foundation working group paper)
- GENCOST05-BP01 Create stopping conditions to control long-running workflows, AWS Well-Architected Generative AI Lens
- GENCOST01-BP01 Right-size model selection to optimize inference costs, AWS Well-Architected Generative AI Lens
Talk to an engineer
Bring one piece of work you would like to improve. The call takes 30 minutes and needs no access to your systems or your data.
Booking runs on Google Calendar.
Prefer to write first? Leave your email and a few lines, and we reply with times.
Look for the draft in your email program
Send it from there, and an engineer replies in person with times for a 30-minute call. If no draft has opened, write to us at miki@cloudsail.com.