2 Sources
2 Sources
[1]
Over half of enterprise AI stalls on infrastructure mess
The answer seems to be educating the enterprise workforce, and creating smarter use cases More than half of AI projects have been delayed or canceled within the last two years citing complexities with AI infrastructure, according to a research report commissioned by DDN, a data optimization company in partnership with Google Cloud and Cognizant. About two-thirds of the 600 IT and business decision-makers surveyed at US enterprises with 1,000 or more employees said their AI environments are too complex to manage. "If you look at the enterprise, there's just enormous enthusiasm to deploy AI, but the problem is that the infrastructure, the power, and the operational foundation that is required to run it just aren't there," Alex Bouzari, CEO of DDN, told The Register. "And so as a result, it pops up in the financial elements with IT projects getting delayed, the GPUs being underutilized, power costs going up. And so the economics, I think, for lots of organizations don't pencil out because of these challenges." This isn't the first study that has found AI projects coming up short in the enterprise. MIT's widely cited Project NANDA found 95 percent of organizations are seeing zero measurable return from their generative AI investments. Gartner predicted that more than 40 percent of agentic AI projects will be canceled by the end of 2027. Forrester found that 25 percent of planned AI spend would be delayed into 2027, as only 15 percent of AI decision-makers reported an EBITDA lift for their organization. While some 97 percent of the decision-makers surveyed in the DDN study believe that scaling AI for their organization will need to happen in the cloud, Bouzari isn't so sure that is much of a panacea for the infrastructure dilemma. "The same challenges that you would have on prem will follow you into the cloud," he said. "I mean, cloud needs unified data, and the cloud needs orchestration at scale. So, it's all of these considerations. There's an education process which needs to take place within the IT organization." Founded in 1998, DDN works with some of the biggest names in the AI race including Nvidia, xAI, and Google, to optimize the flow of data into and out of AI infrastructure, a capability that has taken on heightened relevance as the cost and power used by those systems has grown. Bouzari said there is a widening gulf between the early movers in AI that made big bets and have turned pilot projects into salable products that generate ROI, and many enterprises who are just starting in AI today. Complicated infrastructure appears to be one of the significant roadblocks that are stopping adoption. "I think that the education process is something that the facilitators can enable. I mean, if you look at organizations like Accenture and Deloitte, resellers who know how to deploy complex, turnkey business solutions for organizations, I think there's a ramp in that curve, which is starting to take place, and then we will have an accelerated adoption." Rather than defaulting to customer service chatbots when the topic of use cases comes up, vendors and advisors need to help find capabilities that bridge an organization's data with AI. "As opposed to, I'm going to lower my customer service cost from 3.7% of revenue to 3.1% of revenue," Bouzari said. "That is really short changing what AI can do." ®
[2]
Businesses are struggling to achieve AI success - this report reveals why
Enterprises are also under pressure from a sustainability angle Artificial intelligence isn't proving to be the golden key for many businesses, with two in three (65%) admitting their AI environments are too complex to manage and more than half (54%) have cancelled AI projects over the past two years due to infrastructure issues. And infrastructure, according to DDN's latest State of AI Infrastructure Report, is exactly what's holding businesses back, quickly followed by energy. Looking ahead, 97% agree cloud is essential to scaling AI initiatives, with hybrid AI workloads expected to grow 162% over the next 12 months. DDN's report reveals the considerable role that third parties play, with 72% relying on external expertise and only 12% depending solely on in-house teams. This is notable, because 83% agree that teams are struggling today and 98% admit to AI skills gaps, further underscoring the need for outside help. The study also found that most failures can be traced back to silos, either in storage, compute or data pipelines. "Enterprises are discovering that scaling AI isn't a compute problem - it's an integration problem," DDN CTO Sven Oehme wrote. "If your infrastructure isn't unified, your AI can't learn efficiently." Other common reasons for failure include legacy technologies, poor cloud strategies, and the complexity of stacking tools instead of simplifying them. "Without modern, unified infrastructure, AI can't scale," DDN CEO Alex Bouzari said, slating companies for chasing models and GPUs instead of focusing on "the data layer underneath." All of this against a backdrop of increased pressure from stakeholders and regulators. Most (93%) are now actively trying to reduce AI energy impact, with around half (47%) citing power and cooling as the top inefficiencies. "Tokens per watt" is therefore emerging as a new performance metric for AI efficiency.
Share
Share
Copy Link
More than half of AI projects have been canceled or delayed in the past two years due to infrastructure challenges, according to a new report. Two-thirds of enterprises admit their AI environments are too complex to manage, with fragmented infrastructure, internal AI skill gaps, and energy consumption emerging as critical barriers to achieving AI success.
More than half of AI projects have been delayed or canceled within the last two years, with complex infrastructure challenges emerging as the primary culprit. A research report commissioned by DDN, a data optimization company in partnership with Google Cloud and Cognizant, surveyed 600 IT and business decision-makers at US enterprises with 1,000 or more employees. The findings reveal that 54% of AI project cancellations stem directly from infrastructure issues, while 65% of respondents admit their AI environments are too complex to manage
1
2
.
Source: The Register
"If you look at the enterprise, there's just enormous enthusiasm to deploy AI, but the problem is that the infrastructure, the power, and the operational foundation that is required to run it just aren't there," Alex Bouzari, CEO of DDN, told The Register. The economics of enterprise AI often fail to pencil out due to underutilized GPUs, rising power costs, and operational complexities that prevent organizations from achieving meaningful ROI
1
.The DDN State of AI Infrastructure Report identifies fragmented infrastructure as a core obstacle to achieving AI success. Most failures can be traced back to silos in storage, compute, or data pipelines. DDN CTO Sven Oehme emphasized that "scaling AI isn't a compute problem - it's an integration problem. If your infrastructure isn't unified, your AI can't learn efficiently"
2
.Internal AI skill gaps compound these technical challenges. The report found that 98% of organizations admit to skills deficiencies, with 83% reporting that their teams are struggling. As a result, 72% of enterprises now rely on external expertise to manage their AI infrastructure, with only 12% depending solely on in-house teams
2
. This widening gulf between early AI adopters who have turned pilot projects into revenue-generating products and enterprises just starting their AI journey highlights the need for better education within the IT organization.
Source: TechRadar
While 97% of decision-makers believe that scaling AI initiatives will need to happen in the cloud, Bouzari cautions that cloud migration alone won't solve the infrastructure dilemma. "The same challenges that you would have on prem will follow you into the cloud," he explained. Hybrid AI workloads are expected to grow 162% over the next 12 months, but organizations still need unified data and orchestration at scale
1
2
.The energy consumption of AI has become a critical concern, with 93% of enterprises actively trying to reduce AI energy impact. Power and cooling rank as the top inefficiencies, cited by 47% of respondents. A new performance metric, "tokens per watt," is emerging to measure AI efficiency as stakeholders and regulators increase pressure on sustainability.
Related Stories
The infrastructure crisis isn't isolated. Previous studies have documented similar struggles: MIT's Project NANDA found 95% of organizations seeing zero measurable return from generative AI investments, while Gartner predicted that more than 40% of agentic AI projects will be canceled by the end of 2027
1
.Bouzari argues that vendors and advisors need to help organizations identify AI use cases that go beyond basic customer service chatbots. Instead of focusing on marginal cost reductions, enterprises should bridge their data with AI capabilities that deliver transformative value. "That is really short changing what AI can do," he said. Companies are chasing models and GPUs instead of focusing on "the data layer underneath," which Bouzari identifies as the foundation for successful AI adoption
1
2
.Legacy technologies and the complexity of stacking tools instead of simplifying them further complicate the path forward. As organizations like Accenture and Deloitte ramp up their capabilities to deploy complex, turnkey business solutions, an education process within enterprises will be essential to accelerate adoption and close the gap between AI enthusiasm and execution.
Summarized by
Navi
[1]
17 Oct 2024•Technology

20 Jan 2026•Business and Economy

27 Sept 2024

1
Policy and Regulation

2
Technology

3
Technology
