AI for your roleHeads of Digital
From AI pilots to systems in daily use: a guide for Heads of Digital and AI officers
You own the AI portfolio, often without authority over IT or the business units, and management now wants results rather than more pilots. Whether a pilot reaches production is mostly settled before it starts: a measured baseline, acceptance criteria on your own cases, a named owner and a stop criterion. If you are also the AI officer, your work starts with an inventory of the AI already in use.
Where a Head of Digital starts
- 1
List what runs today: in production, in pilot or still a playground, and which licences are paid for.
- 2
Send usage and billing exports for the free one-page review, which also starts the AI inventory.
- 3
Pick one process with a measured baseline, an owner in the business and a stop criterion.
- 4
Agree acceptance criteria on your own cases before building, and test against them before go-live.
- 5
Hand over with runbooks and a named owner, then take the next use case from the list.
What a Head of Digital is asked to deliver
Operational results from an AI strategy that already exists. In KPMG's 2026 survey of 480 decision-makers in German companies, 98% have an initial AI strategy, yet only 39% say top management actively steers it and 37% have clearly defined responsibilities and governance. The mandate has moved from writing the strategy to showing systems that people use every day.
The gap is the step from pilot to operation. In Lünendonk's 2026 study of 180 CIOs, IT heads and business unit managers in the DACH region, reported by CIO.de, 58% of companies are piloting AI agents, 19% use them productively in individual areas and 1% end to end, and 66% say fewer than a quarter of their piloted agents leave the test lab. The study's author summed it up as "Was fehlt, ist die operative Konsequenz": what is missing is operational follow-through.
- A short list of use cases, each with a business owner, a measured baseline and an expected effect, instead of a long list of ideas.
- Pilots that either go into production or stop on a criterion agreed at the start.
- Foundations the next use case can reuse: data access with permissions, one gateway in front of all models, tests and monitoring.
- Rules people follow because an approved tool makes it easy.
- A view management can read: what runs, what it costs per case and how often it is right.
If you are the AI officer: inventory, literacy measures and rules
The AI officer's work starts with knowing which AI is in use. The AI Act names no mandatory AI officer comparable to the data protection officer, as the training provider skill-sprinters pointed out in 2026. Its Article 4 asks companies to take measures for adequate AI literacy among the people who work with AI, and after the Digital Omnibus it remains a duty to take such measures, as the law firm Lewis Silkin summarised in July 2026. Many companies name someone anyway: in the BSI and TÜV-Verband AI security study of 2026, 63% of AI-using companies have a designated AI responsibility and 59% have binding internal policies, while 71% feel poorly informed about the AI Act's requirements. How your company meets these duties is for your company to decide, advised by its lawyers. We cover the technical side.
Shadow AI is where the inventory usually begins. In IW Köln's 2026 survey, 29.1% of employees who use AI at work use tools their employer did not provide, rising to 44.5% among staff whose employer strongly promotes AI skills. The institute's conclusion: "Wer fördert, ohne bereitzustellen, macht die Nutzung unkontrollierbar", encourage without providing and use becomes uncontrollable. In Bitkom's 2025 survey, 23% of companies had rules for AI use, up from 15%, and 31% were planning them.
- Inventory: which tools, models and agents are in use, in which teams, with which data, and at what cost. Our free AI usage review starts it from your billing and usage exports, aggregated by team.
- Classification: which uses could fall under the AI Act's high-risk list, such as CV screening and ranking of applicants or credit scoring. These are high-risk uses under Annex III, with extra duties for the deployer from 2 December 2027. People make those decisions, and we do not automate them.
- Literacy measures: a short, documented introduction per team to the tools that team uses, covering what each tool does, where it fails and when to check. For every system we build, we write that description with you.
- Rules the platform enforces: approved models behind one gateway, data classes that may not go to external models, and logging agreed with the works council, so the policy is more than a document.
- Transparency: where an assistant talks to customers, a notice that they are dealing with AI. According to Lewis Silkin's 2026 summary, the AI Act's Article 50 duties have applied since 2 August 2026.
The questions a Head of Digital is asked
They come from management, the CFO, IT and the business units, and they turn up in this wording in trade press, surveys and practitioner forums:
- "What is already in production, and what is still pilot or playground?"
- "What goal did you start with, and what actually came of it?"
- "Why do AI projects fail despite good tools?"
- "By which criteria do you prioritise?" when the list of AI ideas is longer than the budget
- "Is management on board, or are you fighting alone?"
- "Which AI tools are already in use here, including privately by staff?", the AI officer's first question
What to decide, and in which order
Each of those questions needs an answer you can measure, so the order starts with the process and its baseline. The tool comes later.
- Which process first. Choose by volume, today's cost per case and how often the work repeats, and check whether it needs AI at all or whether rules, a process change or better data would do. Our guide to choosing a first workflow has a scoring method.
- Buy, build or both. Where a standard product already covers the step, such as the assistant in Microsoft 365 or the AI features of the ticket, CRM or document system you already run, use it. Build where the work crosses systems such as SAP, SharePoint and ServiceNow, where data must stay on your own servers, or where no product fits the process.
- Where it runs. A SaaS tool, your own cloud account or your own servers, decided per data class together with the data protection officer.
- How quality is judged. Acceptance criteria and test cases from your own work, agreed with the business owner before anything is built, so a measurement decides the go-live.
- Who owns it after go-live. A named owner in the business, an operator in IT or at Cloudsail, a budget for running costs and the stop criteria.
- What the second use case reuses. Gateway, connectors, permissions and the test setup stay, so the next system does not start from zero.
Why the foundations decide whether the portfolio scales
Most companies lack exactly these foundations. In ServiceNow's Enterprise AI Maturity Index 2026, only 16% of German companies have established test, audit and risk processes for AI, and 72% name data accuracy, data access and data management as their biggest hurdles. In the Lünendonk study of 2026, companies put data quality and integration (98%), orchestration platforms and infrastructure (94%), training and change (87%) and AI compliance (87%) at the top of their investment plans for the next two years.
We build those foundations while delivering the first use case: connectors that carry permissions from SharePoint, file shares and your ERP, one gateway with keys, budgets and logs per team, and a test suite from your own cases that runs again after every change to models, prompts or data. In your own cloud account or on your own servers, depending on the data.
The risks a Head of Digital owns, and how they are handled
- A demo that works and never goes further. Acceptance criteria, a business owner and a go or stop rule are agreed before the pilot starts.
- Too many parallel initiatives without a business case. Keep one portfolio in which every use case has a baseline, an expected effect and a stop criterion, and review it with management.
- Data that is not ready. Take stock of the sources for the one use case at hand instead of starting a company-wide data project.
- Staff do not use the tool. We build it into the work people already do, the team writes test cases with us, and use is measured per team, never per person.
- Shadow AI and spend nobody owns. An approved platform behind one gateway, budgets per team and the usage review bring both under control.
- Providers changing or retiring models. Regression tests from your own cases run before every model version change, and the gateway lets you switch models without rewriting applications.
- Surprises from the AI Act or the works council. Name high-risk uses early, involve the works council before a pilot with real employees, and design logging so a works agreement can be kept.
What proof to ask any provider for
Ask for evidence that holds up in a management review, from us or from anyone else:
- A measured baseline of the process before the project, and the same measure after it.
- Acceptance criteria and a pass rate on your own cases, with the test set handed over to you.
- An architecture that shows where data flows and is stored, and how permissions are enforced for assistants and agents.
- A cost per handled case, split into build, operation and model consumption.
- Who runs it after go-live, with runbooks your team can follow without the provider.
- An exit path: code, configuration and tests in your repositories, and models you can switch behind one gateway.
- If a provider has no reference for your situation, a small test on your own data and the method behind it, instead of a slide.
Where a Head of Digital should start
Start with what already exists. If staff use ChatGPT, Copilot or other paid AI tools, the free AI usage review turns your usage and billing exports into one page: where the spend goes, the three changes we would make first and what to measure next. For the AI officer, it is the first version of the inventory.
If a pilot is stuck, bring it to a free 30-minute call with an engineer. We look at what it would need to pass an acceptance test and run in production. Neither the call nor the review needs access to your systems or data. If you go ahead, each step gets a fixed price, agreed in writing after the first call.
Questions
Why do so many AI pilots get stuck in testing?
Usually because nobody agreed what good enough means, who runs the system afterwards, or how it connects to the systems where the work happens. A pilot built against acceptance criteria on your own cases, connected to the real systems and with an owner named from the start ends with a clear decision to go live or to stop.
How do we measure whether a pilot succeeded?
Against a baseline taken before the pilot: hours or cost per case, cases per week, error rate or answer time. Add the system's pass rate on the agreed test cases. If the numbers do not move, the pilot stops. Our guide on measuring pilot success describes the method.
By which criteria should we prioritise AI ideas?
By the volume and cost of the work today, how standardised it is, whether the data can be reached, the damage a wrong result would do and who would own the system. Check first whether rules, a process change or better data would solve the problem without AI.
When should we stop an AI project?
When the agreed measure does not move after the agreed test, when the cost per case stays above the manual process, or when nobody in the business takes ownership. Write the stop criteria down before the pilot starts, so stopping is a decision and not a failure.
Why do staff not use the AI tool we introduced?
Often because it sits next to their work instead of in it, cannot see the documents they need, or gives answers they cannot check. Assistants that answer from your own systems with the source shown, inside the tools people already use, get used. We measure use per team, never per person.
Is an AI officer legally required?
The AI Act names no mandatory AI officer comparable to the data protection officer. Its Article 4 asks for measures that build AI literacy. Many companies name one anyway to keep the inventory, the rules and the training plan. Your company decides, advised by its lawyers, and this is not legal advice.
Which AI tools are already in use here, including privately by staff?
Licences and API accounts show up in billing and usage exports, which our free usage review reads, aggregated by team. Private tools on private devices do not. Ask the teams, and offer an approved alternative, because shadow AI grows where AI is encouraged but not provided.
Should we buy a standard AI product or build our own?
Buy where a product covers the job inside one system. Build where the work crosses systems such as SAP, SharePoint and your ticket tool, where data must stay on your own servers, or where you need measured quality on your own cases. Often it is both: a bought model, built into your process. Our build or buy guide walks through the decision.
Can the data protection officer also be the AI officer?
That is your company's decision: the AI Act names no mandatory AI officer, so it does not say who takes the role. The data protection officer brings a lot to it, because data flows, processing agreements and data protection impact assessments overlap with an AI inventory. The role also covers ground outside data protection: which tools and models are in use and what they cost, literacy measures per team, and tests after model changes. If the same person would both drive AI projects and check them, ask your lawyers whether that fits the data protection officer's role. An external AI officer can fill the gap where nobody inside has time, as long as someone inside keeps the inventory current. This is not legal advice.
Related services
AI strategy and rollout
AI strategy and rollout that starts with one running, measured system on your own processes and builds the roadmap around its figures.
AI system testing
Before go-live, acceptance tests on your own cases tell you how often your chatbot, assistant or agent is right, in terms your QA team already uses.
Free AI usage review
One page for management on where your AI money goes, whether it pays off and what to change, from exports you choose to share. Free, no system access.
AI platform for all teams
One approved route to AI for every team, with budgets, logs and a free choice of model, run on your servers or in your cloud.
For managing directors
Turn the AI mandate into one working process with a measured benefit, with no slide decks and no data leaving the company.
For IT leaders and CIOs
Give staff approved AI without data leaving the company or a new system your team cannot run: gateway, permissions, own servers or cloud.
From the blog
AI pilot to production
What has to be in place before a successful AI pilot goes live: regression tests, versioning and rollback, monitoring, an owner, a handover and a staged rollout.
AI pilot success criteria
What an AI pilot has to show before the next stage is funded, and how to write acceptance criteria before anyone chooses a tool.
AI Act checklist for deployers
What the EU AI Act asks of companies that use AI assistants and agents after the Digital Omnibus, with a technical checklist from inventory to supplier documentation.
Shadow AI: ban or better option
Shadow AI grows where companies encourage AI without providing it, and bans push it onto private phones. An approved platform that enforces your AI policy works better.
Talk to an engineer
Bring one stuck pilot or your list of use cases. The call takes 30 minutes and needs no access to your systems or data.
Booking runs on Google Calendar.
Prefer to write first? Leave your email and a few lines, and we reply with times.
Look for the draft in your email program
Send it from there, and an engineer replies in person with times for a 30-minute call. If no draft has opened, write to us at miki@cloudsail.com.