2 Sources
[1]
A call for built-in biosecurity safeguards for generative AI tools - Nature Biotechnology
Generative AI is changing biotechnology research, and accelerating drug discovery, protein design and synthetic biology. It also enhances biomedical imaging, personalized medicine and laboratory automation, which enables faster and more efficient scientific advancements. However, these
[2]
Built-in safeguards might stop AI from designing bioweapons
Artificial intelligence (AI) is fast-tracking the design of new proteins that could serve as drugs, vaccines, and other therapies. But that promise comes with fears that the same tools could be put to work designing the building blocks of biological weapons or harmful toxins. Now, scientists are
Share
Copy Link
Researchers propose built-in safeguards for AI tools in biotechnology to mitigate potential biosecurity risks while harnessing the technology's potential for scientific advancements.

Generative AI is revolutionizing biotechnology research, accelerating advancements in drug discovery, protein design, and synthetic biology
1
. These AI-driven tools are enhancing various aspects of scientific research, including biomedical imaging, personalized medicine, and laboratory automation. However, the rapid progress in AI capabilities has also raised significant biosecurity concerns, prompting discussions within the scientific community and policymakers1
2
.The power of generative AI lies in its ability to predict novel biological molecules that may not resemble existing genome sequences or proteins. This capability introduces dual-use risks and serious biosecurity threats. There are concerns that AI models could potentially bypass established safety screening mechanisms used by nucleic acid synthesis providers, which currently rely on database matching to identify sequences of concern
1
.To address these concerns, scientists are proposing a range of protective measures that could be built into AI tools themselves. These safeguards aim to either block malicious uses or make it possible to trace a novel bioweapon to its AI creator
2
.FoldMark: Developed in Mengdi Wang's lab at Princeton University, this guardrail embeds a unique identifier code into protein structures without altering their function. This could help trace the origin of potentially harmful novel toxins
2
.Unlearning: This approach involves modifying AI models to strip away some of their training on existing toxins and pathogenic proteins, making it harder for the models to propose dangerous new proteins
2
.Antijailbreaking: This method systematically trains AI models to recognize and reject potentially malicious prompts
2
.External Safeguards: The implementation of autonomous agents to monitor AI usage and alert safety officers when attempts are made to produce hazardous biological materials
2
.Implementing these safeguards presents challenges, and some experts suggest alternative approaches. James Zou, a computational biologist at Stanford University, proposes focusing regulations on service facilities or organizations that can turn AI-generated protein designs into large-scale production. This approach would involve scrutinizing the origin and intended use of new molecules at the production level
2
.Related Stories
Recent AI models, such as RFdiffusion and ProGen, have demonstrated the ability to custom design proteins in a matter of seconds. While these advancements hold great promise for basic science and medicine, their power and accessibility raise concerns. As Mengdi Wang notes, "AI has become so easy and accessible. Someone doesn't have to have a Ph.D. to be able to generate a toxic compound or a virus sequence"
2
.Thomas Inglesby, director of the Johns Hopkins University Center for Health Security, emphasizes the importance of developing a framework to harness the potential of AI technology while preventing serious risks
2
. Kevin Esvelt from MIT Media Lab notes that while concerns remain theoretical, proactive measures are necessary2
.As the field of AI in biotechnology continues to evolve, the focus on safeguards and responsible development is gaining traction. Researchers and policymakers alike recognize the need to balance innovation with security, ensuring that the transformative potential of AI in biotechnology can be realized without compromising public safety.
Summarized by
Navi
[2]
03 Oct 2025•Science and Research

05 Jun 2026•Policy and Regulation

19 Jun 2025•Technology

1
Technology

2
Technology

3
Science and Research
