The judge model is a selected evaluation model configured as the re-ranker in the optimization loop to evaluate competing search snippets or full pages against a target query and output a median ranking over multiple samples alongside per-item rationales.
sequenceDiagram
autonumber
actor Optm as Optimizer Loop
participant JM as Judge Model
participant Eval as Aggregator
loop N Samples
Optm->>JM: Evaluate variant snippets & query
JM-->>Optm: Return item rankings & rationales
end
Optm->>Eval: Aggregate run distributions
Eval->>Eval: Calculate median rank & variance
Eval-->>Optm: Final snippet score & next edit priorityReferenced by