Artifact Benchmark
Test Collection
Canonical ID https://id.searchplex.net/test-collection/
An information-retrieval evaluation resource consisting of a document or item collection, a set of topics or queries, and relevance judgments.
Scope
In Cranfield-style and TREC-style evaluation, a test collection provides the fixed materials needed for offline retrieval evaluation. It is broader than qrels alone and may be packaged as part of a benchmark suite.
Related
Not equivalent to
- Test Collection is not BEIR. BEIR is a benchmark suite aggregating multiple retrieval datasets and test collections; a test collection is a general evaluation-resource pattern.
- Test Collection is not Qrels. Qrels are the relevance-judgment component of a test collection, not the entire evaluation collection.
Learn more
ID
- Canonical ID
https://id.searchplex.net/test-collection/ - Scheme
Searchplex ID - Machine
JSONJSON-LD