Major AI Model Flaw Let Weaker Models Decode Encrypted Reasoning, Exposing 62 API Keys and Passwords

2 Sources

Share

Security researchers uncovered a critical API vulnerability affecting OpenAI, Anthropic, and Google that allowed weaker AI models to decode encrypted reasoning from stronger models. The flaw exposed 62 API keys, 33 passwords, and 367 PII artifacts hidden in 315,320 publicly shared reasoning blocks, revealing how a provider-wide encryption key enabled cross-model attacks without breaking any rules.

Weaker AI Models Decode Stronger Models Through Provider-Wide Encryption Key

A critical AI model flaw in how OpenAI, Anthropic, and Google handle encrypted reasoning has exposed sensitive data buried in publicly shared API logs. Security researchers from MATS Research, the ELLIS Institute Tübingen, the Max Planck Institute for Intelligent Systems, and Snyk discovered that weaker AI models could decode the inner thoughts of AI models from their more powerful siblings, bypassing security safeguards entirely.

1

The API vulnerability stems from an architectural design flaw where all three providers use a single provider-wide encryption key across their entire ecosystem. Instead of binding each encrypted reasoning block to a specific user, session, or model, the chain-of-thought reasoning blocks remain "fully compatible and interchangeable across different sessions, users, and even different models within a provider's ecosystem," according to the research paper titled "Stealing Reasoning Traces from Proprietary LLM APIs."

2

Credential Theft and Hiding Prompt Injections in Public Agent Transcripts

By decoding 315,320 reasoning blocks scraped from 6,708 public agent transcripts shared on GitHub and Hugging Face, researchers recovered 704 distinct privacy artifacts from genuine user sessions. The haul included 62 API keys, 33 passwords, 24 access tokens, seven private keys, and 367 PII artifacts total.

1

2

Source: Hacker News

Source: Hacker News

Crucially, 64 of these artifacts appeared only in hidden reasoning and nowhere in the visible trace. Developers who sanitized readable conversation text unknowingly left secrets inside opaque blocks that another account could replay. "Developers frequently share their session logs and encrypted thinking traces publicly online, entirely unaware of the sensitive data hidden within the encrypted blocks," the researchers noted.

2

Stealing Proprietary Reasoning Without Jailbreaking

The attack demonstrated four distinct abuse paths: stealing proprietary reasoning for model distillation, extracting private data from other users' published traces, recovering hidden harmful content concealed behind a safe visible answer, and hiding prompt injections inside opaque reasoning blocks.

1

Lead researcher Alexander Panfilov explained the mechanism: "Cross-model portability means Haiku 4.5 can read Opus 4.8's thoughts." An encrypted reasoning block from Claude Opus 4.8, Anthropic's flagship model, could be injected into Claude Haiku 4.5, a cheaper, less guarded sibling. When prompted to read the encrypted block verbatim, Haiku complied without triggering anti-distillation alignment that Opus possesses.

2

Source: Decrypt

Source: Decrypt

The same cross-model attack reproduced across OpenAI's GPT-5.6 family using GPT-5.6 Luna as the decoder, and Google's Gemini lineup using Gemini Robotics ER-1.6. Standard API access was sufficient to execute the attack—no special permissions or jailbreaking required.

1

Server-Side Patches Deployed After Responsible Disclosure

Following responsible disclosure procedures, OpenAI, Anthropic, and Google deployed server-side patches to address the vulnerability. The researchers' reproducibility statement confirms the main extraction attack no longer works as of August 2026.

1

Anthropic now states that thinking blocks are tied to the model that produced them and should be stripped when switching models because other models ignore them. Google indicates its backend manages thought compatibility when a session switches models, while OpenAI still instructs developers to replay encrypted reasoning items when manually managing stateless history.

1

However, the 6,708 session transcripts with decoded reasoning blocks already scraped from the public web remain accessible, and no public acknowledgment from the three providers has surfaced.

2

Security Implications and What Developers Should Watch

The encryption itself was not cracked, and the attack did not require obtaining an encryption key. It relied on intact opaque blocks being accepted and processed by the provider. The exposure demonstrates a bounded but serious risk: developers who published raw agent logs with reasoning objects intact represent one identifiable group at risk, though not necessarily the only one.

1

Developers are advised to strip reasoning blocks and opaque reasoning fields from shared traces and avoid committing raw API transcripts even when visible text has been sanitized. The report does not document malicious exploitation in the wild, but the architecture enabled invisible prompt injection proof-of-concept attacks where malicious instructions hidden in reasoning blocks caused models to execute attacker-directed actions without visible text exposure.

1

The researchers caution they lack ground-truth plaintext for proprietary reasoning, so exact reconstruction cannot be guaranteed. Fidelity checks relied on reasoning-token counts and qualitative comparisons, with extracted lengths generally tracking providers' reported thinking-token counts.

1

Today's Top Stories

© 2026 TheOutpost.AI All rights reserved