Method

Pooling

Canonical ID https://id.searchplex.net/pooling/

An evaluation-collection construction method in which documents retrieved by multiple systems or runs are combined into a pool for relevance assessment.

Scope

Pooling is central to many TREC-style test collections. It is a way to choose items to judge, not the qrels file itself and not a relevance metric.

Not equivalent to

  • Pooling is not Qrels. Pooling selects items to assess; qrels are the resulting structured relevance judgments.
  • Pooling is not Relevance Judgment. Pooling identifies candidates for assessment; a relevance judgment is an assessment of an item for a topic or query.
  • Pooling is not Test Collection. Pooling is one method used to build test collections; it is not the entire collection.

Learn more

ID