Enterprises Rebuild AI Infrastructure as Autonomous Agents Force Private Cloud Governance Overhaul

19 Sources

Share

Broadcom unveiled AI factory automation and agent security controls at VMware Explore 2026 as enterprises struggle to govern autonomous AI agents operating at scale. The shift brings production AI workloads back to private cloud environments where data sovereignty, cost control and infrastructure governance can be managed under one roof.

Private Cloud Becomes the New Home for Production AI Workloads

Enterprises are shifting AI infrastructure back to private cloud environments as they move from pilot projects to production-ready AI agent deployment

1

. The migration addresses mounting pressures around cost control, data privacy, and the complexity of managing autonomous agents at scale. Broadcom's Prashanth Shenoy explained that customers face significant challenges deploying agentic AI workloads because "setting up GPUs, servers, networking, Kubernetes, containers, AI software stack, testing, validating which models to use" remains "an extremely manual and complex process"

1

.

Source: SiliconANGLE

Source: SiliconANGLE

The VMware Cloud Foundation now supports over 150 open-source AI models, including Google Gemma 4 and Nvidia Nemotron 3, validated for on-premises deployment

4

. Bob Keblusek, CTO at VMware partner Sentinel Technologies, noted that "the more that VMware puts together easier bundling and makes it easier for our customers to operationalize AI -- the more we see less barriers for AI adoption for enterprises"

4

. This turnkey automation approach transforms what Broadcom calls the "metal to model" journey into a streamlined process

1

.

AI Factory Automation Tackles Infrastructure Complexity

Broadcom's AI factory automation strategy pairs hardware flexibility with operational simplification. AMD contributes compute options across different scales, with the MI350P PCIe accelerator targeting enterprises starting their AI journey and the MI355X handling models exceeding 1 trillion parameters

1

. Raghu Nambiar from AMD outlined clear sizing guidance: "If your problem size is 10 billion parameters, CPU is the answer. But if you're looking at the 100 billion parameters range, then MI350P is the answer"

1

.

Source: SiliconANGLE

Source: SiliconANGLE

The approach eliminates the need for parallel infrastructure by allowing enterprises to run inference workloads, agentic applications, containerized services and traditional VMs together on VMware Cloud Foundation

4

. Organizations already operating VCF gain immediate access to what Shenoy describes as an AI factory "built in," avoiding the operational burden of managing separate stacks for AI workloads in production

1

.

Securing AI Agents Becomes Critical as Shadow AI Spreads

Autonomous agents operating without human supervision have exposed governance gaps that decades of employee access controls never addressed. Clayton Donley, vice president at Broadcom, emphasized the urgency: "We've had 50 years of figuring out how to manage your employees or customers or other people accessing your computer systems. We've had about 15 minutes to figure out how to do it for AI agents"

2

. The problem intensifies as organizations grant these agents corporate data, API traffic access and autonomous decision-making authority

2

.

Broadcom introduced AgentMinder to address this challenge through signed agent identities paired with runtime inspection of API traffic and observability

2

. The packet path becomes the control point where network infrastructure can discover Model Context Protocol servers, agents and AI models, then flag unauthorized instances as shadow AI

2

. Umesh Mahajan from Broadcom stressed the dual nature of the threat: "First, you have to make sure that the agentic AI workloads don't get compromised from the outside. Then, we see the agentic AI workloads can themselves go rogue and start attacking outwards"

2

.

Source: SiliconANGLE

Source: SiliconANGLE

AI Infrastructure Governance Demands New Identity Controls

The governance challenge extends beyond technical security into regulatory compliance territory. Organizations operating under frameworks like Sarbanes-Oxley face a certification gap that Donley highlighted: "You used to have to certify that your employees had appropriate access. Nobody certifies my agents have this access"

5

. Business units deploying agents for mission-critical work are moving faster than IT teams can establish controls, creating risk that regulated industries cannot sustain

5

.

Broadcom's approach treats agents as identities requiring three fundamental controls: identity verification, intervention capability and inspection of actions

5

. The implementation starts passively by monitoring traffic to identify agents, then introduces centralized policy enforcement. Donley explained the initial step: "Sometimes the starting thing we do is we just watch the traffic, because it's very easy, it's very cheap, it doesn't require you to change anything"

5

. Organizations can then consolidate control by replacing individual API keys with centrally managed credentials that prevent circumvention

5

.

Tanzu Platform Gains AI-Ready Security Framework

VMware launched AI-ready data foundations for the Tanzu Platform, providing an end-to-end framework for transitioning from AI pilots to production-ready AI agents inside private cloud environments

4

. The update includes hardened agent sandboxes enforcing a "deny-by-default" security model that isolates credentials and prevents prompt injection attacks

4

.

Keblusek emphasized the significance for customer conversations: "Seeing VMware go after this with the Tanzu Platform makes a ton of sense. If we're able to add agentic security so that our customers can adopt agentic and feel comfortable about it, run it in their own data centers or in a VMware secure enclave or cloud -- that is all very welcomed as security is the top concern when talking to customers about AI adoption"

4

. Additional features include on-premises data processing that reduces hallucinations and token costs, developer tools with human-in-the-loop controls, and a curated marketplace for vetted AI models and data products

4

.

Economics and Data Sovereignty Drive Infrastructure Decisions

Cost considerations around tokenization and scalability are pushing enterprises toward localized AI deployments where they maintain control over spending. Keblusek noted that Sentinel Technologies provides "cost optimization dashboards and some FinOps basically around tokenization because it starts to really accelerate as you're adopting AI, especially if you're using frontier models"

4

. The ability to run models on-premises enables data sovereignty while reducing the variable costs associated with cloud-based inference at scale

4

.

Christophe Bertrand from theCUBE Research identified data governance, compliance and sovereign cloud requirements as central to the infrastructure rebuild

3

. He anticipates discussions at VMware Explore 2026 will demonstrate how "advanced memory tiering" translates into economics and performance at scale for organizations leveraging private cloud more aggressively

3

. The shift represents a fundamental change in how enterprises evaluate AI infrastructure, with behavior and security of autonomous agents now representing harder challenges than raw compute capacity

3

.

Today's Top Stories

© 2026 TheOutpost.AI All rights reserved