Stop Ranking Agent Configs by Average Score

The article argues that ranking agent configurations by average score is flawed and proposes using best-worst comparisons, MaxDiff-style judging, and Plackett-Luce utility scores instead. These methods provide a clearer framework for deciding which configs to deploy, remove, or prioritize next.