Query Relevance Score — DEJAN Codebase Explorer

The Query Relevance Score is a statistical metric derived from a deterministic prompt template that calculates the proportion of positive confirmations across multiple model evaluations.

flowchart LR
    P["Prompt: Recommend Brand?"] --> M1["Sample 1: Yes"]
    P --> M2["Sample 2: Yes"]
    P --> M3["Sample 3: No"]
    P --> MN["Sample N: Yes"]

    M1 --> S["Aggregator"]
    M2 --> S
    M3 --> S
    MN --> S

    S --> QRS["QRS = (Yes / Total) * 100"]

Referenced by

Relevance Gaps Detection
Direct Relevance Testing
ARC Relevance Pillar
Relevance in ARC
Direct Relevance Validation
Direct Recommendation Queries
Auditing Low-Relevance Gaps
Relevance Scoring
Disapproval Gaps in Relevance Probes
Relevance Scoring