The news. On August 21, 2026 a paper introducing PolicyGuide was posted, targeting customer-service LLM agents that must follow organizational policy across multi-step procedures rather than merely avoid a single forbidden action. It compiles each domain policy into a workflow graph; at user-turn boundaries a proactive verifier reads persisted graph state, reconciles open requests, and returns step-specific remediation along a policy-compliant path. On τ²-bench’s airline, retail and telecom domains it raises mean Pass^4 from 0.42 to 0.62 with a GPT-5.4 agent and verifier, with telecom improving from 0.19 to 0.61, and reports transfer to Claude Sonnet 4.6 and Gemini 2.5 Pro agents. Read the paper →
Picture the speed camera. It sits at one spot on one road, and it is very good at exactly one job: when you go past it too fast, it flashes. It does not know where you set off from, it does not know where you are going, and it has nothing to say about the four junctions between here and there. A speed camera is a correct answer to a question about a moment, and no answer at all to a question about a journey — which is a fine trade when the only thing that can go wrong is speeding at that spot.
Most agent guardrails are speed cameras. The standard shape wraps the model, watches the tool call about to run, and returns allow or block — an action-level check evaluated against the call in front of it. For the things that shape was built for, it works: a call that leaks data or spends money is wrong on its own terms, and you can tell without knowing the story. The trouble starts when the rule being enforced is not about an action but about an order — verify the account before issuing the credit, offer the retention path before closing the line — because then no single call is wrong in isolation, and a guardrail that can only see one call cannot see the rule at all.
An illustrative service procedure — the steps are ordinary examples, not PolicyGuide's own graph. Note that no box here is forbidden; the policy lives in the arrows between them.
This is the setting PolicyGuide picks: customer-service agents that must follow organizational policy across multi-step procedures, not just avoid a single forbidden action. Now switch the camera for a satnav. The satnav holds the whole route as a map, keeps a pin on where you actually are, and — this is the part that matters — when you take a wrong turn it does not merely tell you the turn was wrong. It recomputes and names your next move: make a U-turn, then take the second exit. The correction is expressed in the vocabulary of the route rather than the vocabulary of the mistake, which is why you can act on it immediately and a camera flash leaves you no better off than before.
Three pieces make that possible, and PolicyGuide has one for each. The map is the workflow graph: the paper reports that each domain policy is compiled into one, and describes no more of the compiled form than that. What a graph buys is the part worth holding onto — what may legally come next becomes something you look up rather than something the model re-argues from a policy document every turn. The pin is persisted graph state, the agent's position carried across turns — a state object scoped to compliance, which the paper reports the verifier reading and reconciling the requests still open against. And the voice is the proactive verifier, which runs at user-turn boundaries, reconciles the requests still open, and returns step-specific remediation along a policy-compliant path. The design turns guardrails into stateful workflow guidance instead of local action vetoes — that is the paper's own summary of what changed, and everything else follows from it.
| Local action veto | Workflow-graph guidance | |
|---|---|---|
| What it inspects | The single tool call about to run | The agent’s position in a compiled policy graph |
| When it runs | At the call site, reactively | At user-turn boundaries, proactively |
| What it remembers | Nothing between calls, in the simple case | Persisted graph state and still-open requests |
| What it returns | Allow or block | Step-specific remediation along a compliant path |
| Rules it can express | “Never do X” | “Never do X” plus “do B only after A” |
| What the agent learns from it | That one move was wrong | Which move is right |
Now price it, because the headline numbers hide how the gain is earned. PolicyGuide reports mean Pass^4 rising from 0.42 to 0.62, and Pass^4 means a task counts only when all four independent attempts succeed. Hold that definition fixed and read the number backwards. If the four attempts were independent and equally likely to succeed — (illustrative: the paper reports Pass^4, not per-attempt rates, and real attempts on one task are correlated) — then a Pass^4 of 0.42 implies a per-attempt success of 0.421/4 ≈ 0.805, and 0.62 implies 0.621/4 ≈ 0.887. So the agent went from getting a task right about 81% of the time to about 89% of the time — roughly 8 points — and that 8-point move showed up as a 20-point move in Pass^4, from 0.42 to 0.62. Under an all-four bar, small reliability gains compound and small reliability losses do too, which is exactly why a metric like this rewards guidance that keeps a run on the path over a check that only intervenes when a run leaves it. The same reading on the hardest domain: telecom goes from 0.19 to 0.61, implying roughly 0.66 → 0.88 per attempt.
Two limits worth stating plainly. The first is that this does not retire the speed camera. A rule like “never send customer data to an unverified address” is still correct at the call site and still belongs there — guidance about the procedure and a hard stop on a single action answer different questions, and what a guardrail does when it fires is a separate decision from where it sits. The second is that a compiled graph is a written artifact someone has to build and keep current, which pushes the work upstream rather than removing it: the closer a policy is to a routable map, the more of the agent's job was really a workflow all along. The paper reports the graphs transferring across models — Claude Sonnet 4.6 and Gemini 2.5 Pro agents — which is what you would expect of an artifact that lives outside the model, and is the practical argument for paying to build one.
Goes deeper in: Agent Engineering → Layered Guardrails → Policy Enforcement
Related explainers
- LedgerAgent — Pre-tool-call policy validation — the same problem answered at the call site: keep a state ledger, check policy against it before an irreversible tool call
- AdaPlanBench — Adaptive replanning under hidden constraints — what happens when the constraints an agent must route around only appear part-way through the task
- Agentic abstention — knowing when to stop — the other end of the same question: when the compliant next step is to stop and hand over