What this project is
DNA synthesis is the point at which an AI-designed protein sequence transforms from a digital file into a biological molecule. Producing the protein generally requires the corresponding synthetic DNA. Providers screen orders against databases of known toxins and pathogens, making this a central biosecurity safeguard.
Current screening relies mainly on sequence similarity. Ordered DNA is translated into protein sequences and compared with known proteins of concern using sequence alignment, profile hidden Markov models, and short-sequence signatures. These methods work well for close matches but are less reliable when protein design tools alter sequence while preserving structure or function. Recent work has shown that redesigned proteins can diverge substantially from known sequences and evade standard homology-based screening [1].
This means advanced AI could pose new risks. The very feature that makes AI-driven protein design so powerful—changing a sequence but keeping the same function—can also make it harder for current screening systems to spot dangerous proteins. Even if we grow our databases, the core issue remains: a protein can look different yet do the same thing.
This project asks: can we screen for what a protein actually does, not just what it looks like? Even when a protein is redesigned to keep its function, it still relies on certain key features, like catalytic residues, binding sites, and structural contacts, to work. These features might still show up in screening, even when the overall sequence looks unfamiliar.
Our prior work provides a direct way to test this idea. ProtoMech uses cross-layer transcoders to identify circuits inside the protein language model ESM2 [2]. We found that these circuits respond to catalytic motifs, binding pockets, and regions involved in structural stability. We will test whether these signals persist across redesigned versions of known toxins and identify variants that homology-based methods miss.
Our main idea is that these circuit-level signals could still be picked up by screening, even after traditional similarity checks stop working well.
The grant will support a six-month computational study using publicly available sequence, structure, and functional data on known toxins.
[1] Bruce Wittmann, Tessa Alexanian, Craig Bartling, Jacob Beal, Adam Clore, James Diggans, Kevin Flyangolts et al. "Strengthening nucleic acid biosecurity screening against generative protein design tools." Science 390, no. 6768 (2025): 82-87.
[2] Darin Tsui, Kunal Talreja, Daniel Saeedi, and Amirali Aghazadeh. "Protein Circuit Tracing via Cross-layer Transcoders." International Conference on Machine Learning Research (ICML) 2026.
<https://protmech.github.io>
<https://github.com/amirgroup-codes/ProtoMech>
Theory of impact
Advanced AI could make it much easier and cheaper to design biologically active proteins. If AI-powered redesign outpaces the screening systems used by DNA-synthesis providers, it may get harder to spot and stop harmful proteins before they are made.
This project looks at one possible solution. A circuit-based screen wouldn’t replace current sequence checks, but could add another layer of safety for proteins that don’t look risky but might act in dangerous ways. This method could be used as a backup for cases where the risk is unclear, helping keep costs down and preventing false alarms from getting in the way of normal work.
If this approach works, it would show that mechanistic interpretability can directly help screen for biological risks—not just help us understand how models work. The method could then be built into open-source screening tools or tested by synthesis providers alongside current sequence and structure checks.
Even if this approach doesn’t work out, that is still valuable to know. If circuit signatures fade away just as quickly as sequence similarity or don’t add anything new, we will know not to rely on this method. That would help avoid wasting time and resources on an ineffective technique and make it clear where the limits are for using protein model interpretability in biosecurity.
How the money will be spent
$30k: This would cover a smaller six-month study focused on building benchmarks, analyzing circuits, and comparing results with homology-based screening. However, it would include fewer protein families, redesign methods, and robustness tests.
$50k: This amount would fund the entire project. It would allow for broader toxin coverage, more redesign methods, and comparisons with various baseline approaches (such as sequence, embedding, and structure). It also covers ablation studies, GPU costs, and the public release of the benchmark, prototype, and technical report.