Searchplex ID Retrieval terminology registry

Evaluation Program

TREC

Canonical ID https://id.searchplex.net/trec/

The Text REtrieval Conference, an evaluation program and workshop series supporting large-scale information-retrieval evaluation.

Also called

  • Text REtrieval Conference

Scope

TREC organizes tracks, topics, collections, runs, and evaluation resources. It is not itself a metric, a qrels file, or a single test collection, though many test collections and qrels are produced through TREC tracks.

Not equivalent to

  • TREC is not BEIR. TREC is an evaluation program and workshop series; BEIR is a benchmark suite aggregating multiple retrieval datasets.
  • TREC is not Qrels. TREC may publish qrels for tracks; qrels are judgment files, not the TREC program itself.
  • TREC is not Test Collection. TREC is an evaluation program and workshop series; a test collection is an evaluation resource, some of which are created by TREC tracks.
  • TREC is not CLEF. CLEF and TREC are distinct evaluation programs and venues, though both support shared evaluation in information retrieval and information access.
  • TREC is not FIRE. FIRE and TREC are distinct evaluation programs, though FIRE was modeled as a regional counterpart to programs such as TREC, CLEF, and NTCIR.
  • TREC is not NTCIR. NTCIR and TREC are distinct evaluation programs, though both organize shared information-retrieval evaluation tasks.
  • TREC is not TREC-COVID. TREC-COVID is a specific test collection/challenge dataset; TREC is the broader evaluation program.
  • TREC is not TRECVID. TRECVID originated from the TREC video track but is a distinct video-retrieval evaluation campaign.

Learn more

ID