What has to travel when a customer changes model providers mid-engagement?

THE SHORT ANSWER

Two things, and the interface is the easy one. Lesson 07 of Becoming Forward Deployed Engineer (October 22, 2026) normalises exactly a token limit and a temperature across providers and passes everything else through by native name, which is the right amount of abstraction. The part that has to survive the switch is the eval threshold per surface, kept in a routing row with the model, the fallback, the threshold, and the date it was last run. A candidate runs the surface's sliced eval before it enters the fallback list, and the threshold runs again the night the fallback fires. The quarterly review of my own table finds about one surface a quarter routed to the flagship for no reason other than that it shipped that way, and a pricing agent of mine with no such check drifted 14% under benchmark in five weeks.

SOURCES

THE LONG VERSION

RELATED ANSWERS

Last reviewed 2026-10-23 · 1 min read