Who should approve exceptions to an AI agent's rules?

THE SHORT ANSWER

A person, for every exception that is approved rather than fixed. Vercel's inbound sales agent runs on 14 deterministic rules, and per Tomasz Tunguz's write-up a second agent watches for breaches and fixes them or blesses the exception. Keep that agent for detection and repair. Log every blessing with the rule, the case, and the reason, have a named person read all of them weekly, and count them by rule. Routine output can be sampled at about one in 100, as Vercel COO Jeanne DeWitt Grosser describes. Blessed exceptions are few, and each one is the only record that a rule did not fit. When I sunset a per-seat pricing tier at a $40M ARR company we modeled 50 exceptions a week and got 600, and nobody was counting them.

A person should, for every exception that gets approved and not fixed.

The design most teams are about to copy comes from Vercel. Tomasz Tunguz wrote up how COO Jeanne DeWitt Grosser's team moved their inbound sales agent from a 1,000-line prompt to 14 rules in code, with the model kept for judgment. A second agent watches for breaches of the rules and fixes them or blesses the exception. The write-up does not say how blessings are recorded or reviewed, so this is about the pattern and not about Vercel.

An approved rule break is the most informative event in a rules system. It only exists when a rule did not fit. I learned that from a pricing migration at a $40M ARR company, where the plan modeled 50 exceptions a week and we got 600, three reps negotiated unauthorized extensions, and every one of those accounts still counted as migrated. The exceptions were countable only because a person had to approve each one.

So keep the escalation agent, and add three lines. Every blessing is logged with the rule, the case, and the reason. A named person reads all of them every week. A rule that keeps getting blessed is rewritten or becomes a new rule. Sample the routine output. Read every exception.

The full argument is in Fourteen Rules, and Who Blesses the Exception, and the count itself comes from Percent Migrated Is a Vanity Metric.

SOURCES

THE LONG VERSION

RELATED ANSWERS

Last reviewed 2026-10-06 · 2 min read