Convex AI rules
PromptThe agent rules in the Convex docs. With Guidelines scores are unverified, so this page does not list a change.
Convex · docs.convex.dev/ai#convex-ai-rules
Comparison arm unverified
Convex Evals · Framework eval · 2026-10-08 · 92a60e0bb2f156b5ac44e6ea3f5d03a91deb434b9d002d14819d1fc2b6e35cdb
On 2026-10-10, runs:leaderboardScores returned a server error for experiment with_guidelines. The With Guidelines tab in the page script has no experiment field. The unscoped default query is not treated as that arm.
Why this, and when not
Why The rules themselves are in the docs. The eval page has a With Guidelines tab.
Skip it Do not claim the rules raised the pass rate from an unverified comparison.
Watch out On 2026-10-10, runs:leaderboardScores returned a server error for experiment with_guidelines. The With Guidelines tab in the page script has no experiment field. The unscoped default query is not treated as that arm.