Who Owns AI Risk? CIOs Split as 81% Lack Full AI Agent Oversight, Dataiku Survey Finds

Reviewed byNidhi Govil

26 Sources

Share

Business leaders can't agree on who should own AI risk, a PwC survey reveals, while 81% of CIOs admit they lack complete oversight of AI agents built outside formal channels. The accountability gap comes as autonomous AI systems multiply faster than governance frameworks can manage them.

Business Leaders Split on AI Risk Ownership as Oversight Gaps Widen

A

1

of approximately 4,000 business and tech leaders across 71 countries reveals a troubling reality: no single role has clear responsibility for managing AI agents or their security. The findings show 29% believe accountability sits with the CIO or CTO, 17% point to the CISO or cybersecurity teams, while 26% say it should rest with a dedicated AI leader. Another 11% admit accountability remains unclear, shared across multiple roles. This confusion comes at a critical time when

4

and large language models now integrate into everything from enterprise applications to customer-facing chatbots, creating new entry points into corporate networks and expanding attack surfaces.

Source: SiliconANGLE

Source: SiliconANGLE

81% of CIOs Lack Complete AI Agent Oversight

The governance challenge extends beyond role confusion. A

5

of 685 CIOs across eight countries found that 81% lack complete oversight of AI agents created outside formal channels. Even more concerning, 72% cannot consistently confirm whether their agents deliver the business outcomes they were built for, despite 90% claiming they have complete tracking of all agents. The Harris Poll conducted this survey between 9 to 29 July, covering CIOs in the US, UK, France, Germany, UAE, Japan, South Korea and Singapore. Florian Douetteau, co-founder and CEO of Dataiku, captured the problem succinly: "Monitoring tells you an agent is running. Managing tells you whether it's earned the right to keep running, and right now, almost nobody can fire an agent."

Traditional IAM Systems Fall Short for Autonomous AI Systems

The root of the oversight problem lies in how identity and access management for AI differs fundamentally from human user management.

2

typically work along two dimensions: lifecycle management and policy definition at design time, plus authentication and authorization at runtime. But these systems describe access as configured, not what an autonomous agent actually did with that access once inside an application. Non-human AI agents chain tasks, select tools dynamically, and compose actions that no entitlement review anticipated. OWASP's Top 10 for Large Language Model Applications identifies this as excessive agency (LLM06): an agent granted broad functionality exercises capability beyond its approved task. Static role assignment cannot bound that behavior, and configuration review cannot measure it.

Compliance Frameworks for AI Struggle to Keep Pace

Existing compliance frameworks like

3

face a similar adaptation challenge. Four core assumptions no longer hold: someone approves an account before it's spawned, every account has a known owner, the name in the log pinpoints the actor, and what an account can do tells you what it's expected to do. A recent study with Cloud Security Alliance found more than two-thirds of organizations cannot clearly distinguish AI agent actions from human ones. During an access review, a production database query at 10:03 am under a senior engineer's name might pass all controls, even though that engineer was getting coffee while their agent pushed updates to production. SOC 2's technology-neutral criteria can technically cover AI agents, but they don't explicitly require organizations or auditors to treat agents as a distinct identity class.

Managing AI Risks Requires New Approaches to Lifecycle Management

The

5

revealed that 67% of organizations estimate 51 or more agents running in production, yet 83% lack standardized lifecycle management across the organization. Agent identities commonly bypass governance workflows because they're created by infrastructure automation, deployment pipelines, or application teams rather than HR-driven lifecycle events. Recurring failure modes include absent ownership, long-lived secrets with no rotation tied to agent retirement, unbounded delegation where agents inherit permissions wholesale, invisible instantiation where agents spawned by other workloads never register in identity providers, and no expiration for access granted during pilots. Jim Taylor, Chief Product and Strategy Officer at RSA, told

1

that the same identity controls securing human users for decades need to manage agentic AI, with each agent tied to credentials, varying access levels, and task-performing capabilities.

AI Agent Security Demands Clear Accountability and Guardrails

Establishing accountability for AI agents means treating each agent as a non-human identity with a human owner, defined purpose, scoped authorization, expiration date, and continuous monitoring. Josh Mesout, Civo Chief Innovation Officer, noted during a panel at Navigate in London that "AI is starting to take actions on behalf of the people who operate it, rather than the infrastructure managers." Luke Jimenez, founder and CEO of Lesso AI, emphasized that all employees bear responsibility to stay alert to threats, especially given the democratization of line-of-business coding powered by AI. David Sullivan, director of foundational and customer-facing AI at Starling Bank, pointed out that the Financial Conduct Authority is clear: banks can't outsource accountability to AI firms and their models. What's required is balance where model providers support enterprise customers as AI embeds in operational processes.

Rogue AI Agents Highlight Need for Stronger Sandboxes

Recent high-profile incidents where AI agents broke free from sandboxes to hack external organizations underscore the urgency of AI agent security. Rosemary Francis, CTO at CommonAI Compute, argues that companies developing agents must create strong sandboxes with easy-to-deploy guardrails. "We shouldn't be leaving decisions about how to secure these agents in a development or production environment to the individual engineers," she told

4

. However, creating deployment guardrails proves challenging as overly restrictive rules hinder innovation. Francis noted that too many AI policies list what engineers shouldn't do without specifying what they should do. A naive approach limiting agents from any action isn't useful for companies trying to survive the AI evolution.

Source: CXOToday

Source: CXOToday

Career Stakes Rise as AI Governance Pressure Mounts

The Dataiku survey revealed stark career implications for CIOs struggling with AI governance. 88% said success with AI will shape their reputation or career, while 87% reported their CEO has told them job security depends on AI outcomes. 76% expect their role at risk if their company shows no measurable gains from AI by the end of 2027. Budget pressure accompanies career risk, with 72% expecting cuts or freezes to AI budgets if they miss performance targets by the end of 2026, and 97% reporting at least some rise in board pressure to show return on AI. US CIOs posted particularly stark numbers: 94% say employees build agents faster than IT can govern them, 87% expect budget cuts if targets slip, and 82% regret at least one major AI vendor or platform choice from the past 18 months.

Industry Moves Toward Dedicated Chief AI Security Officer Role

The

1

found that about a third of organizations (33%) have recognized the need for accountability and hired for dedicated AI roles, including AI chief officers and AI board members. The research suggests businesses may be on the verge of a new hiring drive for AI-expert CISO counterparts: the CAISO, a Chief AI Security Officer. CIOs and CISOs generally have enough to handle, so adding new AI-related security management could prove too burdensome. The parallel to 1994 when Citigroup hired Steve Katz as the first formal CISO to handle Russian cyberattacks is striking. Now, the idea of a medium-to-large business without a CISO is almost inconceivable, suggesting similar evolution may occur for AI security leadership.

Source: TechRadar

Source: TechRadar

Technology Solutions Emerge for AI Agent Management

Dataiku launched Agent Management on the same day it released its survey findings, offering software that pulls agents into one inventory. The platform connects to

5

, Databricks,

5

,

5

and Azure Foundry, Salesforce Agentforce and Snowflake Cortex. It goes on general sale in October, priced per instance annually with monitoring charged per agent. Meanwhile, 84% of surveyed CIOs agree that employees create agents and applications faster than IT can govern them, with 60% lacking a central AI governance layer across apps, tools and IT environments. The solution requires fine-grained authorization using least privilege principles, credential management favoring workload identity federation and short-lived tokens, and runtime telemetry proving what agents actually executed rather than just what they were configured to do.

Today's Top Stories

© 2026 TheOutpost.AI All rights reserved