EU Demands Monitoring of High Risk AI Systems Following OpenAI and Anthropic Hacking Incidents

EU says necessary to monitor high risk AI systems after OpenAI, Anthropic AI hacking incidents

BRUSSELS, July 31 (Reuters) - Artificial intelligence developers should have in place tools to monitor their systems for security risks, senior European Commission officials said on Friday, following hacking incidents by OpenAI and Anthropic AI models. The comments came two days ahead before Europe's landmark AI Act with transparency rules kick in, the first in the world to regulate a technology used in almost all sectors of businesses ⁠and society. Anthropic said on Thursday some of its Claude AI models had hacked into the systems of three companies during cybersecurity tests, days after rival OpenAI revealed that one of its AI agents went on a rogue attack. Both companies have briefed the Commission on the AI incidents, the officials told reporters. "We have been informed by the two providers of incidents bilaterally before they become public. ⁠We are in contact with them. They will also report to us more information as we speak. We will see also if we need to follow up more formally on those things," one of the ⁠officials said. Another official talked up the crucial role of Europe's AI rules. "So I think all these, let's say, incidents highlight the importance of really ⁠putting in place the necessary monitoring activities by the developers," the official said. The AI rules requires providers of general-purpose AI (GPAI) ⁠or foundation models to draw up technical documentation, adopt copyright policies and provide detailed summaries about the content used for algorithm training. Reporting by Foo Yun Chee; editing by Philip Blenkinsop Our Standards: The Thomson Reuters Trust Principles., opens new tab * Suggested Topics: * Cybersecurity * Data Privacy * Intellectual Property Foo Yun Chee Thomson Reuters An agenda-setting and market-moving journalist, Foo Yun Chee is a 21-year veteran at Reuters. Her stories on high profile mergers have pushed up the European telecoms index, lifted companies' shares and helped investors decide on their next move. Her knowledge and experience of European antitrust laws and developments helped her break stories on Microsoft, Google, Amazon, Meta and Apple, numerous market-moving mergers and antitrust investigations. She has previously reported on Greek politics and companies, when Greece's entry into the eurozone meant it punched above its weight on the international stage, as well as on Dutch corporate giants and the quirks of Dutch society and culture that never fail to charm readers.

European Union says necessary to monitor high risk AI systems after OpenAI, Anthropic AI hacking incidents

European officials stressed AI developers need security monitoring tools. This follows recent hacking incidents involving OpenAI and Anthropic AI models. The European Union's AI Act, with its transparency rules, is set to begin soon. Both companies have informed the Commission about these security breaches. These events highlight the importance of developer monitoring activities for AI systems. Artificial intelligence developers should have in place tools to monitor their systems for security risks, senior European Commission officials said on Friday, following hacking incidents by OpenAI and Anthropic AI models. The comments came two days ahead before Europe's landmark ⁠AI ⁠Act with transparency rules kick in, the first in the world to regulate a technology used in almost all sectors of businesses and society. Anthropic said on Thursday some of its Claude AI models had hacked into the systems of three companies during cybersecurity tests, days after ⁠rival OpenAI revealed that one of its AI agents went on a rogue attack. Both companies have briefed the ⁠Commission on the AI incidents, the officials told reporters. "We have been informed by the two providers of incidents bilaterally before they become public. We are in contact with them. They will also report to us more information as we speak. We will see also if we need to follow up more formally on those things," one of the officials said. Another official talked up the crucial role of Europe's AI rules. "So ⁠I think all these, let's say, incidents highlight the importance of really putting in place the necessary monitoring activities by the developers," the official said. The AI rules requires providers of general-purpose AI (GPAI) or foundation models to draw up technical documentation, adopt copyright policies and provide detailed summaries about the content used for algorithm training.