GeneralConcept
Relevance Judgment
Canonical ID https://id.searchplex.net/relevance-judgment/
An assessment assigning a relevance label or level to an item with respect to a query, topic, or information need.
Also called
- Relevance Assessment
- Relevance Judgments
- Relevance Judgements
Scope
Relevance judgments are commonly produced by human assessors in Cranfield-style and TREC-style evaluation, though automatic or synthetic judgments may also be studied. Judgments may be binary or graded and are often collected into qrels.
Related
Not equivalent to
- Relevance Judgment is not nDCG. Relevance judgments provide labels used by metrics such as nDCG; nDCG is an evaluation metric, not a judgment.
- Relevance Judgment is not Qrels. A relevance judgment is an individual assessment; qrels are a structured set or file of judgments used in retrieval evaluation.
Learn more
ID
- Canonical ID
https://id.searchplex.net/relevance-judgment/ - Scheme
Searchplex ID - Machine
JSONJSON-LD