Alex Rives on the data bottleneck behind a world model of life
Biohub's head of science argues virtual-cell AI is held back less by model design than by what instruments can measure, and lays out a 1.8 billion dollar push to generate the cell data a world model of life would need.
Life Is a Program
<strong>The cell is code.</strong> Rives frames a cell as an information-processing machine whose genome encodes the programs that run life, so curing disease becomes a matter of learning to read and write those programs.
The cell is an information processing machine which has a genome which encodes the programs that run life.
Measurement, Not Models
<strong>The limit is what we can see, not how we model it.</strong> Virtual-cell models underperform because today's instruments cannot observe the fine-grained causal structure the models would need to learn.
We just really can't measure. Sometimes we can't see it at all.
Three Fronts, Betting on Data
<strong>Models, data at scale, and observation tools all have to advance together,</strong> and Biohub's new 1.8 billion dollar Virtual Biology Initiative aims its effort at generating cell data across hundreds of billions of cells.
There's kind of three parts to really solving this problem.
When Data Is Scarce, Bias Is King
<strong>In the limit of infinite data, architectures probably all converge,</strong> but biology is nowhere near that limit, so clever inductive biases like the physics baked into AlphaFold still decide what works.
Historically, when you're far from that limit, you know, inductive bias becomes really important.
Train on All of Life
<strong>The models that worked never trained on humans alone.</strong> ESM and AlphaFold learned from across all of evolution, because the signal needed to predict human biology is not just present elsewhere in life, it is essential.
ESM and AlphaFold did not come from training a model just on human proteins.
Verification Moves to the Lab
<strong>Pre-train, then elicit, then reinforce:</strong> the LLM recipe ports to biology, except the reward signal cannot be computed, it has to be measured by running the experiment.
Ask the question, perform the experiment, learn from the experiment, improve its understanding, propose a better experiment.
The Answers Aren't Written Down
<strong>The facts we most want are not in any text.</strong> They cannot be reasoned out from first principles; they are empirical, obtainable only by doing the experiment, which is why predictive models of biology are indispensable.
They're empirical facts that can only be derived by performing experiments.
A World Model of Life
<strong>Learn the cell's transition function,</strong> which takes a state and an input and predicts the distribution of next states, and you get a world model of life that can tell you how to push a diseased cell back to a healthy one.
You could think of it as a world model, right? Kind of a world model of life.