The AI hype train has crashed into a wall of reality. According to CIO.com's 25th annual State of the CIO survey—covering 662 IT leaders and 249 business users—only 19% of AI initiatives have met or exceeded business goals. Even more alarming: 18% admit fewer than one-third of their AI use cases are meeting defined expectations.
The brutal truth? Most enterprises are drowning in AI pilots that never translate into business value.
The problem isn't the technology. It's the operational discipline required to turn experiments into measurable outcomes. CIOs are racing to operationalize strategic AI initiatives under immense pressure from top leadership, but the infrastructure to measure and achieve ROI is woefully underdeveloped.
This isn't a call to abandon AI. It's a wake-up call to approach it like any other strategic investment: with accountability, clear metrics, and the willingness to kill projects that don't deliver.
The Three Barriers Killing AI ROI
The State of the CIO survey reveals why AI initiatives fail:
32% cite ill-defined ROI metrics. Without clear success criteria, every pilot looks promising until someone asks for the numbers. You can't optimize what you don't measure.
31% point to murky corporate AI strategy. When every vice president and line-of-business leader is implementing AI for their own optimization without a unified roadmap, you end up with a chaotic patchwork of disconnected experiments.
40% blame lack of in-house expertise. Data scientists can build brilliant models, but if your shop floor supervisor doesn't understand how to integrate AI insights into day-to-day workflows, those models stay on the shelf.
Andrea Ballinger, CIO at Rensselaer Polytechnic Institute (RPI), captures the chaos perfectly: "No one is measuring ROI on an ongoing basis because we are facing counterpressures from every vice president and line-of-business domain looking to implement AI for their own optimization. We are saying yes to everyone without stepping back and focusing on the business cases that show real value."
Sound familiar? You're not alone.
The Infrastructure Gap: What's Missing
The shift from experimentation to execution requires deliberate organizational structures. The survey found that 83% of IT leaders have or plan to implement cross-functional steering committees to identify, prioritize, and align AI use cases to enterprise goals.
That's the good news. The bad news? Formal approval processes lag significantly.
Only 53% have established official approval processes for AI projects. Another 28% plan to activate something within the next 12 months. Without formal guardrails, AI spending happens in the shadows—budget allocations without business cases, proofs-of-concept that never transition to production, and shadow IT that bypasses governance entirely.
KPIs are even less mature. Just 47% of respondents have established formal metrics, with another 34% planning to do so within the year. If you're measuring AI success at all, you're likely tracking operational efficiency (40%), employee productivity (34%), or cost reduction (30%). Revenue impact? Only 27% of respondents cite it as a success metric.
That's a red flag. AI should drive top-line growth, not just cost savings.
The CIO Playbook: Three Strategies That Work
The survey highlights three companies doing AI ROI right:
1. First Student: Metrics-Driven AI Council
Sean McCormack, CIO at First Student—a leading school bus transportation provider—has stood up an innovation framework and AI-specific council that meets regularly to review use cases and identify those with the highest potential for payback.
"We have more discipline around business cases than most companies," says McCormack. "Everything is metrics-driven and dependent on proving value. By the time we put something into production, it's been through a series of proof of concepts, there's been a deep dive on financials, and we are able to move quickly and demonstrate value."
First Student is now running AI at scale across predictive maintenance, fleet and driver safety, contract development, automated hiring, and agentic voice bots for help desk and HR. The key? A flexible architecture that allows them to switch models quickly without vendor lock-in.
Takeaway for CTOs/CIOs: Build governance first. AI council + proof-of-concept rigor + financial validation = scalable ROI.
2. TIAA: Enterprise-Wide Adoption with Embedded Governance
TIAA, a financial services firm, has 85% of its workforce using TIAA Gate, its internal AI platform. They've invested in training, robust governance frameworks, steering committees, an AI center of excellence (CoE), and made strategic use of AI part of everyone's performance goals.
Yet even TIAA struggles with ROI. Sastry Durvasula, TIAA's chief operating, information & digital officer, notes: "What's on paper sometimes doesn't turn into real ROI given the reality of operational costs. Something may prove to be a successful pilot, but you need to understand the full cost of operations—for example, the efficiencies of running tokens or how you're handling traffic or RAG [retrieval augmented generation]."
Takeaway for CFOs/Business Leaders: Pilot success ≠ production profitability. Factor in operational costs (compute, tokens, inference latency) before scaling.
3. Stage-Gated Funding: Kill Projects That Don't Deliver
Thomas Prommer, a longtime CTO, CIO, and CAIO, recommends three best practices:
Joint accountability: Assign both a technical and business sponsor to every AI project. Co-ownership ensures alignment between what's technically feasible and what delivers business value.
Embedded AI squads: Replace centralized AI CoEs with teams embedded inside business units. Centralized models create clearinghouses that nobody owns; embedded teams force accountability at the point of impact.
Stage-gated funding tied to outcome milestones: "We don't fund 'build a model,' we fund 'reduce returns by 8% on this category' with checkpoints at 90, 180, and 270 days," Prommer explains. "Projects that miss two checkpoints get killed. We kill roughly a third of what we start and that's healthy."
That kill rate—33%—is the hallmark of disciplined AI execution.
Takeaway for all leaders: If you're not killing AI projects, you're not prioritizing hard enough.
What CIOs Should Measure (And What They're Actually Measuring)
The gap between what matters and what's measured:
| What CIOs Measure Today | What Should Drive AI ROI |
|---|---|
| Operational efficiency (40%) | Revenue growth (27% today) |
| Employee productivity (34%) | Customer acquisition cost reduction |
| Cost reduction (30%) | Time to market acceleration |
| Revenue impact (27%) | Competitive differentiation |
Here's the disconnect: If AI is supposed to be transformative, why are most organizations measuring incremental improvements?
Operational efficiency and cost reduction are table stakes. The real ROI comes from AI-driven product innovation, market expansion, and customer experience transformation.
Sriram Krishnasamy, former chief digital information and transformation officer at FedEx, emphasizes the experience layer: "If someone on the data science team builds a great model that provides insights on improving manufacturing efficiency, but it's so far removed from what the shop floor supervisor does in day-to-day life, it will never be used at scale."
AI ROI isn't about the sophistication of the model. It's about how seamlessly it integrates into existing workflows.
The CIO as Chief AI Orchestrator
Why are CEOs leaning on CIOs to drive AI ROI? Because CIOs have two critical skills:
- Deep knowledge of the technology stack and vendor landscape. They can evaluate whether a solution is production-ready or vaporware.
- Proven ability to work cross-functionally and drive change management. AI touches every department—sales, finance, marketing, operations, legal, HR. CIOs already operate at these intersections.
The survey confirms this shift: 46% of respondents view the CIO as a business leader who proactively identifies needs and aligns technology recommendations with business goals. 83% view CIOs as changemakers.
The top CEO priority for IT leaders in 2026? Research and implement AI products and projects (27% of respondents). And CIOs are meeting the mandate: 79% say they're working far more closely with lines of business on AI applications.
That's a massive vote of confidence—but it comes with accountability.
What's Next: The AI Investment Wave
IT leaders expect to accelerate and expand involvement with:
- AI/machine learning (76%)
- agentic AI (70%)
- Cybersecurity (63%)
Investment priorities over the next year:
- Generative AI (67%)
- Machine learning (66%)
- Agentic AI (65%)
But here's the strategic tension: AI commands an all-hands-on-deck approach, but it's not the only CEO directive. Cyber and data security remain top-of-mind in the C-suite (25% of respondents cite it as a top CEO priority in 2026, up from 20% last year). CEOs also want CIOs to strengthen IT and business collaboration (23%).
To achieve those directives, CIOs are expanding technology initiatives in:
- Business process and IT automation (56%)
- Security and risk management (55%)
- Data and business analytics (54%)
Translation: AI isn't replacing the fundamentals. It's raising the bar on execution.
The Bottom Line: No More Excuses
The era of AI experimentation is over. The mandate now is to prioritize and scale AI solutions with the greatest propensity to deliver business value.
Here's your checklist:
✅ Establish cross-functional AI steering committees (83% have or plan to do this)
✅ Implement formal AI project approval processes (53% have, 28% planning)
✅ Define formal KPIs tied to business outcomes (47% have, 34% planning)
✅ Adopt stage-gated funding tied to milestones (kill 30%+ of projects that don't deliver)
✅ Measure revenue impact, not just cost savings (shift from 27% to 50%+)
✅ Build flexible architectures (avoid vendor lock-in)
✅ Engineer the experience layer (AI only delivers ROI if people actually use it)
The CIOs who master this playbook will drive measurable ROI. The rest will be explaining to the board why 81% of their AI initiatives failed to meet expectations.
Which side of that statistic do you want to be on?
Continue Reading:
