What does it mean when AI designs meet 99% of the brief?

Answered by Falk Gottlob · Reviewed · 1 min read

THE SHORT ANSWER

It means the brief is a floor, not a rubric. In the Kombai benchmark Jakob Nielsen reports in his November 16, 2026 roundup, 15 frontier models each met more than 90% of the criteria in 160 design briefs, two met 99%, and human designers met 98%, so the criteria could not rank anyone. The same study found a model's design changed by only 0.58 on a 0 to 1 scale when the brief moved to a different product domain, against 0.90 for humans, which says the criteria were ones any product satisfies. I have seen the same thing inside a team: a rubric with clarity, consistency, and delight on it scored every output 4 out of 5 and stopped being opened. The one that worked was extracted from thirty real outputs, and its most important dimension was not on the list written beforehand.

It means the criteria are a floor. Fifteen models and a group of human designers all cleared them at 90% or better, so the score says the screen is competent and says nothing about whether it is right for this product.

The benchmark's numbers, why the 0.58 across domains is the one to read, and the three steps to run before picking among ten alternatives are in Fifteen Models Met 90% of the Design Brief. Kill 'Meets the Brief' as the Pass.. The method for extracting the lines that fail is in The Rubric Is the Spec.

SOURCES

THE LONG VERSION

RELATED ANSWERS