Rodrigo Liang on why inference now comes down to economics
SambaNova's CEO argues that as inference scales the winner is decided by economics — payback speed, energy efficiency, and reused data centers — not by who owns the newest or most chips.
Economics is paramount
At scale, Liang says inference is won on how fast a rack pays for itself — about six months on SambaNova versus eighteen to twenty-four for a typical build.
we're able to give you six month returns, where, otherwise, it might take you eighteen, twenty four months to do it.
Strategic backers, not just financial
The Series F did not just add money — its extended close brought in strategic corporate backers, big tech companies partnering with a challenger rather than only funding it.
These are huge tech companies who are coming in and partnering with us to actually help someone someone else grow in the market.
Hybrid is the end state
Liang bets the end state is hybrid: data centers that intermix NVIDIA, AMD, and SambaNova chips and mix frontier with private models, each workload routed to whatever gives the best economics.
people are looking at heterogeneous environments using chips from NVIDIA and AMD and SambaNova to intermix
Financing is the bottleneck
Scaling inference is capital-intensive and slow — chips take nine to twelve months to reach data centers, so the capital sits in process while it turns into deployed value, and financing that gap is the real limit.
it's a capital intensive business. And as you scale, you're having to put all these chips into the factory and taking nine to twelve months
Brownfield, not greenfield
Rather than fight the power and permitting wall that stalls new data centers, SambaNova reuses brownfield sites because its ten-kilowatt racks fit the power already there.
brownfield data centers that already have the space, already have the power, already have the infrastructure developed, and actually reusing it and reenergizing that
Early innings, not a bubble
Answering the bubble question, Liang says we are still in early innings — most enterprises are barely started, and the market is only now entering its efficiency phase.
I think we're in early stages still despite all this build out. You do look at most enterprises are just getting started with delivering applications on AI, and so I think we're just at the early days. Now we're entering the phase where it is about efficiency.