AI Existential Risks and Market Bubble Fears Take Center Stage at Singapore Forums

AI Existential Risks Emerge as Central Concern

At the Milken Institute Asia Summit and Forbes Global CEO Conference held in Singapore, a cautious shift in sentiment around artificial intelligence surfaced as investors and policymakers voiced serious apprehensions about both existential threats from AI and AI market bubble fears1

1

2

2

. What began as concerns over frothy valuations has expanded into a broader spectrum of fears encompassing autonomous systems out of human control, AI-designed bioweapons, and the possibility that massive technology spending may never deliver sufficient returns. Singaporean Foreign Minister Vivian Balakrishnan delivered a stark warning at the Singapore forums, stating that anyone claiming absolute control over autonomous agents "obviously doesn't know what he's talking about," emphasizing that loss of control represents a real threat1

1

.

Bioterrorism Threats and Call for Enhanced Governance

The discussion around AI existential risks took a particularly alarming turn when Kiran Mazumdar-Shaw, founder and chairperson of Indian biopharmaceutical firm Biocon, identified bioterrorism threats as the most pressing danger. She warned that while AI serves as a force for good, bad actors could exploit the technology to design new viruses or pathogens2

2

. Balakrishnan reinforced these concerns, noting the very real risk of state and non-state actors weaponizing AI to build new weapons in chemistry, biology, or weapons of mass destruction1

1

. The need for enhanced governance became a rallying cry, with Mazumdar-Shaw explicitly stating that self-governance will not suffice and calling for robust guardrails and AI governance frameworks2

2

. These warnings gain additional weight following last month's rare unified call from heads of leading US AI labs to slow technology development, citing concerns that AI could soon improve autonomously and slip beyond human control1

1

.

Market Bubble Fears and Investment Concerns

Beyond safety issues, financial sustainability emerged as another critical dimension of cautious apprehension at the Singapore forums. Ray Dalio, founder of Bridgewater Associates, characterized AI as existing in a "classic bubble," drawing a clear distinction between how terrific a technology is versus how terrific an investment proves to be2

2

. Investors' faith in the AI trade has sustained stock market momentum even as higher energy prices and bond market volatility have pushed borrowing costs in major economies to multi-decade highs1

1

. Dalio warned that rising rates and changing circumstances have not yet negatively impacted markets, but pressure for interest rates to climb further persists. Once higher rates bite harder, the bubble would begin to burst, with Dalio stating, "I think we're close to that"2

2

.

Regulatory Challenges and ROI Uncertainties

Rohit Sipahimalani, chief investment officer at Singapore state investor Temasek, highlighted the fragility of market confidence by noting that if the AI narrative unwinds due to safety issues, regulation, or because end users fail to see insufficient return on investment as we progress through 2027, significant market issues could emerge1

1

. "The biggest risk to the market is the AI narrative. Right now, it seems very strong," Sipahimalani stated at the Milken Institute Asia Summit2

2

. The regulatory challenges facing the industry gained additional urgency when Reuters reported that Claude maker Anthropic plans to caution potential investors in its IPO that advanced AI could pose "catastrophic or existential risks to humanity"1

1

. This unprecedented disclosure signals growing recognition within the industry itself that current development trajectories demand serious governance intervention. Investors now face a dual challenge: navigating both the technological uncertainties around autonomous systems and the financial realities of whether massive AI spending will generate adequate returns, making the next few years critical for determining whether enhanced governance can address these converging risks before market dynamics force a reckoning.