Eric Nguyen on why the model that writes DNA must also guard it
Radical Numerics' new Omni model shows DNA language models can now beat specialized tools at predicting disease-causing mutations, and Eric Nguyen argues the same generative models must be turned into sequence-level biosecurity defenses.
DNA Is a Language
A genome language model is an LLM trained on DNA instead of words, learning to read and write the letters of life.
a large language model trained on DNA sequences. So very much like natural language and chatbots you see but not train on words or natural language but on the raw fabric of life which is these sequence of letters that make up DNA.
From Reading to Writing
The leap from reading DNA to writing it let these models invent a working CRISPR system and, later, the first genome built from scratch by AI.
what you can do with a generative DNA model was to generate the first genome from scratch using AI.
One Model, Two Mandates
The same model that is good at generating DNA is also good at spotting a dangerous sequence, so Radical Numerics builds both the design tool and its defense.
A model that is good at generating turns out is also very good at discriminating or predicting if a sequence is pathogenic or not.
Alignment Made the Difference
Omni passed specialized tools after Radical Numerics added the alignment steps, mid- and post-training, that made chatbots useful.
EVO was just showcasing the potential of that pre-training but Omni is a step of actually making it useful for folks like scientists
The Surprise Factor
A DNA model flags a likely disease variant by measuring its own surprise: a rare, unexpected letter scores as more suspicious than a common one.
the raw outputs of the language model which basically you can think of it like a probability for predicting what the next letter is
The Dark Genome
Old tools largely focused on the small protein-coding fraction of the genome, but much of human disease hides in the non-coding regions where Omni does best.
turns out many if not most of the diseases are in these non-coding regions and so there's been a real desire to build models that can actually pick up these variants
Beyond the Spell-Check
Most biosecurity screening today matches spelling against a list of known pathogens, which misses novel or reworded sequences, so Nguyen wants defenses that read function instead.
you can have a sequence that has the same function like a pathogen but actually look different in terms of the letters.
An Arms Race You Can't Opt Out Of
Design capability is racing ahead of defense, and Nguyen argues the lagging defensive side has to be pulled back up to par before the gap widens.
the design side's going to get more capable. The defensive side needs to try its best to get ahead.