2 Sources
[1]
Attacker stole a METR API key, used $600K worth of credits, and no one noticed for weeks
AI model testing organization METR has disclosed two attacks that happened earlier this year, including one in which an attacker stole an API key and spent three weeks consuming public-model credits worth about $600,000. METR (short for Model Evaluation and Threat Research) found no evidence that the attackers accessed sensitive information in either incident, and the org said it investigated both with security experts. METR researchers worked with OpenAI to investigate how its agents hacked Hugging Face, and on Monday, it disclosed two of its own security snafus. "In March 2026, attackers stole an API key for inference on public models and consumed a substantial amount of credits," the nonprofit disclosed in a Monday report. "In May 2026, we observed attackers systematically probing our publicly accessible infrastructure, including an unsuccessful attempt to access internal data via an inadvertently exposed endpoint." From fail-open bug to model-credit theft The March incident involved a METR researcher who didn't have access to sensitive information - including model data and credentials, as well as information about model architectures, training, and release dates. The researcher used agents running on a personal EC2 instance that was "intentionally" left publicly accessible behind Google authentication. The instance contained an API key for METR's public models account. According to METR's account, a "vibe-coded app" included a fail-open bug that disabled authentication, and this exposed the system to the public internet for several days. "We suspect that the attacker found the instance by looking through recently-registered websites (e.g. in certificate transparency lists) to find vibe-coded sites with high-signal keywords relating to LLMs or agents, for purposes of harvesting potentially exposed model provider API keys," the AI research org wrote. Once the attacker found the app, they prompted an agent to reveal its model provider API key, then added an SSH key to maintain persistent access, and over the next three weeks used the stolen credentials to consume API credits on public models worth about $600,000. Luckily for METR, the unnamed model developer had given the credits to the nonprofit for free. How do you not notice the 'large illicit usage?' METR does answer the question on everyone's mind in the report: Why its researchers didn't notice the "large illicit usage?" There are several reasons for this. First, the model testing operation regularly runs evaluations that use a lot of tokens, and this means the organization is "very acclimated to getting lots of weird rate limit and API errors." So the high usage didn't look that out of the ordinary. Plus, since the tokens were free, METR didn't accrue a large bill, and at the time there was no way to put a spending limit on keys like the one that was stolen. In response to the March incident, METR says it improved its security infrastructure, protocols, and review process, and will continue to invest in security. To this end, it also hired a security lead, and plans to add more security staff. Crims used agents to try to access frontier models The second incident happened in early May, when "METR became the target of a sustained external attack campaign." After being "tipped off" that attackers who appeared financially motivated may have been trying to gain illicit access to frontier models, METR watched the intruders probe its publicly accessible infrastructure. They also used agents to find ways to gain initial access, including automated vulnerability discovery, credential stuffing against authentication providers, attempting OAuth token grants, scanning newly deployed services, and phishing attempts. At the same time, METR unintentionally "exposed a read-only SQL query mechanism via our public transcript viewer." While queries were scoped to public data by default, a bug allowed access to unpublished evaluation data, and "some sensitive model data was accidentally included in this database." However, there's no evidence that the attacker found the exploit or accessed any non-public data, according to the model testing body. An independent bug hunter discovered the vulnerability and reported it to METR, which paid the researcher a bounty, and took the API offline. In response, METR says it now uses an isolated production environment for public-facing applications that is separate from its internal infrastructure.®
[2]
Attackers Steal METR API Key and Consume AI Credits Worth About $600,000
METR (short for Model Evaluation and Threat Research and pronounced "Meter"), a research non-profit that evaluates frontier artificial intelligence (AI) models for their ability to carry out long-horizon, agentic tasks, disclosed that it suffered "two notable security incidents" where external actors attempted to gain unauthorized access to its systems. No sensitive information is believed to have been accessed as a result of these incidents, it said, adding that a version of its findings was shared with AI companies it works with prior to public disclosure. The attacks have not been attributed to any known threat actor or group, nor did they involve AI agents breaking into its evaluations. "In March 2026, attackers stole an API key for inference on public models and consumed a substantial amount of credits," METR said. "In May 2026, we observed attackers systematically probing our publicly accessible infrastructure, including an unsuccessful attempt to access internal data via an inadvertently exposed endpoint." The March Incident According to METR, one of its researchers with no sensitive access is said to have used agents running on a personal EC2 instance that was intentionally made publicly accessible behind Google authentication. The instance contained an API key for METR's general-access (public models) account. However, the "vibe-coded app" suffered from a "fail-open vulnerability" that silently disabled authentication, causing the agent orchestration dashboard to be exposed to the public internet for several days. "From our analysis, we suspect that the attacker found the instance by looking through recently-registered websites (e.g., in certificate transparency lists) to find vibe-coded sites with high-signal keywords relating to LLMs or agents, for purposes of harvesting potentially exposed model provider API keys," METR explained. Once the system was identified, the threat actor prompted an agent directly to reveal its model provider API key, added an SSH key for persistent access, and used the stolen credentials to consume a significant amount of API credits on publicly-available models over a period of three weeks. METR said the accrued credits would have racked up approximately $600,000 in bills had it not been provided to the non-profit for free by the model provider. It did not name the AI company. It also noted that the illicit usage was not immediately caught because it runs large-scale evaluations and experiments that typically consume a high volume of tokens and the fact that there were no caps on token spend. Following the incident, METR said it has updated its security policies around putting METR credentials or data on non-METR infrastructure or devices, improved monitoring, and added spend alerts to keys where possible. The May Incident The second attack observed in May 2026 has been described as a "sustained external attack campaign" orchestrated by a likely financially motivated threat actor to obtain unlawful access to frontier AI models. "We observed the attackers systematically probing our publicly accessible infrastructure, with heavy use of agents to automate vulnerability discovery, including by credential stuffing authentication providers, attempting OAuth token grants, scanning newly deployed services, and attempting to phish staff," METR said. Around the same time, the research entity said it inadvertently exposed a read-only SQL query mechanism built into its public transcript viewer. Although the queries were scoped to public data by default, a bug in the component could have been exploited to access unpublished evaluation data. In addition, the database "accidentally included" sensitive model data, despite the fact that it was supposed to contain only data from non-sensitive models. METR said it became aware of the issue only after an independent security researcher discovered and reported it, resulting in the API being taken offline. "The attackers had probed this endpoint in passing as part of their broader campaign, but the evidence shows no indication that they discovered the exploit or accessed any non-public data," METR said.
Share
Copy Link
AI model testing organization METR revealed two major security breaches from 2026. In March, attackers exploited a fail-open bug to steal an API key and consumed $600,000 worth of AI credits over three weeks. In May, a sustained attack campaign targeted METR's infrastructure, though no sensitive data was accessed.

METR (Model Evaluation and Threat Research), an AI model testing organization that evaluates frontier AI models for long-horizon agentic tasks, disclosed two security incidents from early 2026
1
2
. In March 2026, attackers stole a METR API key for inference on public models and consumed AI credits worth approximately $600,000 over three weeks without detection1
. The research nonprofit found no evidence that sensitive information, including model data, credentials, or details about model architectures and release dates, was accessed in either incident2
.The March incident began when a METR researcher without access to sensitive information used agents running on a personal EC2 instance that was intentionally made publicly accessible behind Google authentication
1
. This instance contained an API key for METR's public models account. However, a "vibe-coded app" included a fail-open bug that silently disabled authentication, exposing the agent orchestration dashboard to the public internet for several days2
. METR suspects the attacker discovered the instance by scanning recently-registered websites in certificate transparency lists, searching for sites with keywords related to LLMs or agents to harvest potentially exposed model provider API keys1
.Once the attacker identified the vulnerable system, they prompted an agent directly to reveal its model provider API key, added an SSH key to maintain persistent access, and spent the next three weeks using the stolen credentials to consume API credits on public models
2
. The credits, which would have cost approximately $600,000, had been provided to METR for free by an unnamed model developer1
. METR explained why the large illicit usage went undetected: the organization regularly runs evaluations that consume high volumes of tokens, making researchers "very acclimated to getting lots of weird rate limit and API errors"1
. Additionally, since the tokens were free, METR didn't receive a large bill, and at the time there were no spending limits available for keys like the one that was stolen1
.In May 2026, METR became the target of a sustained attack campaign by what appeared to be financially motivated actors attempting to gain illicit access to frontier AI models
1
2
. After being tipped off, METR observed attackers systematically probing its publicly accessible infrastructure with heavy use of agents to automate vulnerability discovery2
. The tactics included credential stuffing against authentication providers, attempting OAuth token grants, scanning newly deployed services, and phishing attempts1
.Related Stories
During the May incident, METR unintentionally exposed a read-only SQL query mechanism via its public transcript viewer
1
. While queries were scoped to public data by default, a bug in the component allowed access to unpublished evaluation data2
. The database also accidentally included sensitive model data that should not have been present2
. An independent bug hunter discovered the vulnerability and reported it to METR, which paid a bounty and immediately took the API offline1
. Evidence shows the attackers probed this endpoint but found no indication they discovered the exploit or accessed any non-public data2
.In response to these security incidents, METR has implemented several measures to strengthen its defenses
1
. The organization now uses an isolated production environment for public-facing applications that is separate from its internal infrastructure1
. METR has also improved its security infrastructure, protocols, and review process, updated policies around placing METR credentials or data on non-METR infrastructure or devices, enhanced monitoring capabilities, and added spend alerts to keys where possible2
. The nonprofit has hired a security lead and plans to expand its security team1
. These incidents highlight the growing risks facing AI research organizations as attackers increasingly use automated agents to discover vulnerabilities and target valuable AI resources.Summarized by
Navi
[1]
13 Aug 2026•Technology

29 May 2026•Technology

28 Jul 2026•Technology

1
Technology

2
Policy and Regulation

3
Health