Wall Street Giants Warn of New AI Risks: Hallucinations, Cybercrime, and Employee Morale

Curated by THEOUTPOST

On Thu, 13 Mar, 12:02 AM UTC

3 Sources

Share

Major financial institutions like Goldman Sachs, Citigroup, and JPMorgan Chase are alerting investors to emerging risks associated with the widespread adoption of artificial intelligence, including AI hallucinations, cybercriminal exploitation, and potential impacts on workforce dynamics.

Wall Street's Growing Concerns Over AI Risks

Major Wall Street firms, including Goldman Sachs, Citigroup, and JPMorgan Chase, are sounding the alarm on new risks associated with the increasing use of artificial intelligence (AI) in the financial sector. These concerns, highlighted in their annual reports, encompass a range of issues from AI hallucinations to cybercrime and workforce challenges 12.

AI Hallucinations and Data Quality

One of the primary concerns raised by banks is the risk of AI hallucinations – instances where AI systems produce inaccurate or unreliable outputs. Citigroup, for example, warned about the potential for "ineffective, inadequate or faulty" results from generative AI systems being rolled out in select parts of the bank 3. The quality and accuracy of data used to train AI models is a critical issue, with JPMorgan emphasizing the importance of maintaining the highest level of "data quality" in their AI models 3.

Cybersecurity Threats

The adoption of AI technologies has also opened up new avenues for cybercriminals. Banks are increasingly concerned about sophisticated AI-powered cyberattacks. According to a survey by Accenture, 80% of cybersecurity executives in the banking industry believe that generative AI is empowering criminals faster than banks can respond 3. This highlights the urgent need for robust cybersecurity measures to keep pace with AI advancements.

Workforce Displacement and Morale

JPMorgan's annual report pointed out that AI could lead to "workforce displacement," potentially affecting staff morale and retention 1. This shift in the employment landscape could also intensify competition for employees with specialized technological skills 2. The integration of AI into various job functions is forcing banks to reconsider their hiring strategies and employee development programs.

Regulatory Challenges

The rapidly evolving regulatory environment surrounding AI presents another significant challenge for financial institutions. The implementation of the EU Artificial Intelligence Act in 2024 has established new rules for AI systems in the region, affecting many U.S. banks with European operations 3. However, the regulatory outlook in the U.S. remains less clear, adding to the complexity of compliance efforts.

Competitive Pressures

While AI offers numerous benefits, it also introduces competitive pressures. Goldman Sachs noted that failing to integrate AI technologies in a timely manner could affect their ability to attract and retain customers 3. Banks are now in a race to leverage AI for improved productivity, cost reduction, and enhanced customer services.

Balancing Innovation and Risk

Financial institutions are walking a tightrope between embracing AI innovations and managing associated risks. As Marco Argenti, Chief Information Officer at Goldman Sachs, stated, "It's so important to take a responsible approach and really be applying controls so that you protect yourself from potential inaccuracies and hallucinations" 3.

The Way Forward

To address these challenges, banks are implementing governance mechanisms and controls to ensure safe, fair, and secure deployment of AI. As Ben Shorten from Accenture emphasized, "This is not a plug-and-play technology" 2. The financial sector's approach to AI will need to evolve continuously, balancing innovation with robust risk management strategies.

1: https://www.bloomberg.com/news/articles/2025-03-12/wall-street-flags-new-ai-risks-from-hallucinations-criminal-use 2: https://www.pymnts.com/artificial-intelligence-2/2025/banking-giants-warn-ai-can-bolster-cybercrime-and-lower-morale/ 3: https://www.seattletimes.com/business/wall-street-warns-of-new-ai-risks-from-hallucinations-criminal-use/

Continue Reading
AI-Generated Fake News Heightens Risk of Bank Runs, UK

AI-Generated Fake News Heightens Risk of Bank Runs, UK Study Warns

A new UK study reveals that AI-generated fake news spread on social media could significantly increase the risk of bank runs, prompting calls for improved monitoring and preparedness in the financial sector.

Digital Trends logoEconomic Times logo

2 Sources

Digital Trends logoEconomic Times logo

2 Sources

Wall Street and Private Finance Vie for $1 Trillion AI

Wall Street and Private Finance Vie for $1 Trillion AI Infrastructure Opportunity

Major banks and private finance groups are competing for a slice of the estimated $1 trillion AI infrastructure market. Morgan Stanley proposes collaboration between traditional banking and private capital to meet the massive funding requirements for AI's future.

PYMNTS.com logoBloomberg Business logo

2 Sources

PYMNTS.com logoBloomberg Business logo

2 Sources

The Impact of AI on Banking and Financial Services:

The Impact of AI on Banking and Financial Services: Opportunities and Risks in ASEAN and Global Markets

Artificial Intelligence is reshaping the banking and financial services sector, offering new opportunities for growth and efficiency while also presenting emerging risks. This story explores the impact of AI in ASEAN markets and beyond, highlighting both the potential benefits and challenges.

Finextra Research logoEconomic Times logo

2 Sources

Finextra Research logoEconomic Times logo

2 Sources

Fortune 500 Companies Increasingly Cite AI as Potential

Fortune 500 Companies Increasingly Cite AI as Potential Risk Factor

A growing number of Fortune 500 companies are acknowledging the potential risks associated with artificial intelligence in their annual reports. This trend highlights the increasing importance and impact of AI technologies in the corporate world.

Fortune logoSeeking Alpha logo

2 Sources

Fortune logoSeeking Alpha logo

2 Sources

Goldman Sachs Analyst Warns of Potential AI Bubble Burst

Goldman Sachs Analyst Warns of Potential AI Bubble Burst

Jim Covello, a veteran analyst at Goldman Sachs, raises concerns about the sustainability of the AI boom. He warns that the current AI hype might be leading to a market bubble, drawing parallels with past tech bubbles.

Futurism logoThe New York Times logoEconomic Times logoThe Seattle Times logo

4 Sources

Futurism logoThe New York Times logoEconomic Times logoThe Seattle Times logo

4 Sources

TheOutpost.ai

Your one-stop AI hub

The Outpost is a comprehensive collection of curated artificial intelligence software tools that cater to the needs of small business owners, bloggers, artists, musicians, entrepreneurs, marketers, writers, and researchers.

© 2025 TheOutpost.AI All rights reserved