Relevance evaluates direct model recommendations by measuring how consistently an LLM endorses a specific brand for a given entity or query across multiple sampled trials.

flowchart LR
    A[Entity or Query] --> B[Model Probe]
    C[Brand] --> B
    B --> D[N Sampled Runs]
    D --> E[Binary Yes/No Responses]
    E --> F[Relevance Score %]

Referenced by