Richard Socher on Where AI Goes Superhuman First
Richard Socher argues AI goes superhuman wherever a problem offers unlimited data, a simulation, or a fast verifier — so building a scientific discovery engine is less about smarter models than about engineering verifiable environments and the rewards inside them.
Three Conditions for Superhuman AI
AI reaches superhuman ability in any domain where it has unlimited data, a simulation to practice in, or a fast verifier for its answers.
in any of those three scenarios, AI will get to superhuman capabilities.
Biology's Bottleneck Is Data, Not Intelligence
Biology lags software not because the models are weaker but because it lacks data, simulation, and fast verification — Socher calls it, to a large degree, a data problem.
it is to a large degree a data problem.
AI Is the New Calculus for Biology
Neural networks are to messy biological systems what calculus was to physics: a new language for things that have no tidy governing equation.
neural nets and the current uh language of AI is kind of what uh calculus was to physics.
The Hard Part Is the Idea, Not the Experiment
The hard step is not running experiments but having the idea, and Socher's bet is open-ended cross-domain search — the way the microwave came from radio research, not from trying to cook faster.
that would never get you to invent the microwave. The microwave came from a different uh branch uh of research where people are working on radio waves and antennas
Two Years of Progress in a Couple of Days
Pointed at AI-research benchmarks, the system beat years of community effort in a couple of days — because those tasks can be verified fast.
after like couple days we outperformed what everyone in the world had worked on together
Reward Hacking and the Rise of the Reward Engineer
An AI optimizes exactly what you measure, so a sloppy reward gets gamed — which makes reward engineering a real job and, Socher argues, makes market pressure a quiet safety feature.
I'll just create 50,000 uh bots that then call our service hotline and give a five out of five rating.
Regulate Applications, Not Abstract Intelligence
You can regulate what AI does — drugs, driving, bioweapons — but policing raw intelligence itself would take a surveillance state, so Socher draws the line at applications.
it makes sense to regulate AI applications. Um it doesn't make sense to uh regulate abstract intelligence