Judge model: meaning, examples, and expert terminology.

Plain meaning

Uses a separate model or evaluator to score agent outputs against explicit criteria.

Aliases

LLM judge, model grader, automated evaluator

People usually say

• automatically test my ai agent
• judge model
• llm judge
• compare two versions
• compare agent versions
• grade responses

Experts usually say

Judge model, Rubric, Eval harness, Human review

Use it when

Your rough ask sounds like: automatically test my ai agent, judge model, llm judge. The term gives your coding agent a clearer problem shape.

When not to use it

Do not use this term as a request for a quick screen fix. Use it when the system needs explicit state, rules, failures, or recovery behavior.

Prompt upgrade

Weak ask: Fix this automatically test my ai agent flow.

Exact Terms ask: Use a judge model only with a clear rubric, calibration examples, and human review for ambiguous cases.

Architecture prompt

Audit this workflow for Judge model and related concerns: Rubric, Eval harness, Human review. Return states, rules, failure modes, and recovery behavior before code.

Implementation prompt

Implement Judge model for this app flow. Include data ownership, edge cases, fallback behavior, and acceptance tests.

Test prompt

Create tests that prove Judge model works across refresh, retry, back/next movement, partial failure, and return visits.

What goes wrong

Asking for code before defining states, transitions, persistence, and failure behavior.

Better move

Use Judge model with the related vocabulary trail: Rubric, Eval harness, Human review.

Turn feedback into vocabulary

If this page almost names your problem but misses the exact term, send the rough phrase and the term you expected. Accepted feedback becomes a better trigger, explanation, comparison page, or new term.