AI Explained
Plain explanations of trending AI concepts, with live visualizations.
AMD ROCm InferaSim — Sparse GPU anchors and transfer laws — What does it mean?
AMD's InferaSim predicts serving configs from one anchor per kernel set; 11 anchors took 9.1 GPU-hours versus 204 to measure.
Signed but Not Safe — Signed requirement manifests — What does it mean?
Signing a requirement manifest stops tampering in transit, but it cannot protect the step that wrote the manifest.
HyFlash lifts on-device speculative decoding 16.2% — Prefix-memory drafting — What does it mean?
A drafter with a local window plus fixed-size recurrent memory keeps long context in 5 MiB.
Measured Coupling paper — Parallel diffusion decoding by measuring token coupling — What does it mean?
Diffusion decoders commit tokens together; measured coupling tests which pairs are safe instead of guessing.
Beyond Instruction Override benchmark — Task-tampering injection — What does it mean?
Prompt injection can bend a decision the task already needs, and override-tuned defenses miss it.
DictLLM compresses LLaMA-7B 5.1× — Shared dictionary plus sparse coefficients — What does it mean?
DictLLM stores one shared dictionary per layer group plus sparse coefficients, shrinking LLaMA-7B 5.1× without retraining.
KOSMOS — Self-scheduling persistent kernels — What does it mean?
KOSMOS lets GPU workgroups switch between moving data and computing by readiness, replacing a fixed split that leaves idle windows.
ZYFA FP8 attention on AMD MI355X — power-of-two probability scaling and ping-pong softmax — What does it mean?
FP8 doubles matrix speed but not softmax; ZYFA shortens and overlaps softmax work.
Blackwell locality domains — Die-aware memory placement — What does it mean?
Blackwell's two dies make memory non-uniform. Pinning data to one die speeds up some accesses and slows others; the access pattern decides.
Adversarial speculative reasoning paper — rejecting drafts on purpose — What does it mean?
Train the draft model to be rejected at an agent's decision points, so the target resamples them at slot 0, where numeric noise is lowest.
Co-design linear attention for TPU systolic arrays — Systolic Linear Attention — What does it mean?
Gated-delta linear attention rebuilt around the TPU's 256×256 matrix unit, so tiles are full and the layer runs as one fused kernel.
Restore MoE refusal safety with full-expert response starts — SafeStart warm start — What does it mean?
SafeStart keeps most of MoE expert-reduction's speedup by using every expert for the prompt and first 8 tokens, largely restoring refusals.