Ian Quigley on why drug-discovery AI learns sociology, not physics
Leash Bio's Ian Quigley argues AI drug discovery is bottlenecked by data, not models: public chemistry datasets teach a model which chemist made a molecule rather than the physics of how it binds, so Leash generates its own causal data at scale and lets reasoning agents explore it.
Models Learn Sociology, Not Physics
Trained on public chemistry data, a model can identify the human chemist who made a molecule from its structure alone, which means it is learning the fingerprints of the people, not the physics of binding.
We really think that it's learning a lot of sociology. It's not learning ground truth.
Two Thousand Teams, No Better Than Chance
Leash ran a Kaggle competition with three tiers of difficulty, and on the hardest tier, an entirely unfamiliar chemical library, none of the 2,000 teams beat random guessing.
And then when you go to the most challenging eval, no one did better than chance.
Four Billion Measurements, Made in a Basement
Rather than trust public data it cannot vouch for, Leash generates its own at enormous scale using DNA-encoded libraries, where every molecule carries a DNA barcode so a single sequencing run reads out millions of binding results at once.
And so we released a data set that was about four billion physical interactions and it was all measured by a single person in the basement of my house.
Break the Pocket to Prove the Physics
Leash mutates a single amino acid to deliberately break a protein's binding pocket and re-runs the screen, so that the exact chemical series that disappears is causal proof of where it was binding, a test a memorizing model cannot fake.
If you use current state of the art models to go see what the model will do, it will shove the small molecule in where the pocket used to be.
A Physically Grounded Playground for Agents
Leash turned its screened data into a fast reinforcement-learning environment where a language-model agent proposes a binding hypothesis in plain English and tests it as an instant database lookup, running thousands of optimization campaigns in a weekend.
right now we give these agents 10 binders, give them a budget of a hundred and they'll get the best binders out of six and a half million in that budget.
If You Have the Data, Why the Model?
The paradox is that if you can collect enough data to train a model, you may already have the chemical material you were after, so the model only earns its keep when it generalizes to targets, and even whole industries, you never screened.
if we get really good at chemical reasoning then we can get really good at lots of different industries and their applications without having to physically go and screen in all those different domains.
A Pill Instead of an Infusion
The prize Leash is chasing is a small molecule that hits the same target as a proven antibody drug, turning a cold-chain infusion into a pill that can enter cells and reach patients far more cheaply.
folks are using antibodies to drug them and going after a small molecule therapeutic that you could take as a pill instead of an infusion
The Edge Is Process, Not Scale
Asked what stops a better-funded lab from simply out-scaling it, Leash's answer is that the moat is years of chasing down the subtle cheating modes in the data, work that depends on culture and attention rather than raw compute.
it takes kind of a unique culture and patience and willing to make these mistakes and then have the team like really think very deeply about how to address them.