AI Explained

Plain explanations of trending AI concepts, with live visualizations.

GPU

NVIDIA frames Vera CPU around fast agent steps — The agent-step CPU bottleneck — What does it mean?

NVIDIA argues an agent step spends real time on serial CPU work between GPU calls, so Vera targets max single-thread speed to keep GPUs from idling.

LLM

KV-PRM scores agent rollouts from the KV cache — Verify-token scoring against the KV cache — What does it mean?

KV-PRM grades a reasoning trajectory from the KV cache the model already built — one verify token, not a full re-encode of the whole trace.

Agent

Danus coordinates math agents with fact-graph memory — Verifier-gated fact graph — What does it mean?

Danus lets parallel math agents build long proofs by gating every claim through a verifier into one shared fact graph.

Agent

Agora auctions each agent reasoning step to expert models — Auction-based task allocation — What does it mean?

Agora puts each reasoning step up for auction so expert models bid by rectified competence and cost — one dial slides the whole system along the cost-quality frontier.

LLM

vLLM 0.25 makes Model Runner V2 the dense default — Retiring PagedAttention — What does it mean?

vLLM 0.25 removes PagedAttention and makes Model Runner V2 the dense default, and reports full CUDA graphs for decode.

LLM

Linearization study isolates cache routing for long-context attention — Training-free linear attention — What does it mean?

A frozen model is converted to linear attention without retraining — sink tokens, a short convolution, and fixed-budget cache routing add back the long-context recall a plain swap loses.

Agent

STRACE extracts causal root causes from noisy agent traces — Causal trace localization — What does it mean?

STRACE shrinks a failed agent's huge run log down to the few steps that actually caused the failure — causal localization, not length-based trimming — lifting a verifier agent 42.5% → 58.5%.

Agent

Microsoft open-sources Flint for agent-generated visualizations — Semantic intermediate representation — What does it mean?

Microsoft's Flint has the agent write a short chart spec; a compiler fills in the brittle low-level details — for more reliable agent-drawn charts.

Agent

EdgeBench measures scaling laws for agents learning in the wild — Environment-learning scaling law — What does it mean?

EdgeBench watches agents keep learning on the job and fits one clean curve to how they improve: a log-sigmoid law with R²=0.998.

LLM

Quantization study finds accuracy can hide behavior drift — Correctness agreement — What does it mean?

A quantized LLM can keep the same accuracy yet change which answers it gets right — correctness agreement measures that hidden drift.

Agent

Proactive memory agent counters long-horizon state decay — Memory-grounded reminder injection — What does it mean?

A second agent watches a long task, keeps a memory bank, and re-injects a buried instruction at the right moment — lifting pass@1 without touching the action agent.

LLM

NVIDIA Audex — Unified audio-text token space — What does it mean?

Audex is one text decoder that also hears and speaks: audio shares the token space of text, with little to no drop in text skill.