Searchplex ID Retrieval terminology registry

Evaluation Program

CLEF

Canonical ID https://id.searchplex.net/clef/

The Conference and Labs of the Evaluation Forum, an evaluation program and research venue for information-access systems, especially multilingual and multimodal information access.

Also called

  • Conference and Labs of the Evaluation Forum
  • Cross-Language Evaluation Forum

Scope

CLEF organizes evaluation labs, shared tasks, workshops, conference publications, and reusable test collections. It is not itself a metric, dataset, qrels file, or a single retrieval task, though CLEF labs may define tasks and publish datasets, runs, and relevance judgments.

Observed terms

  • CLEF Initiative academic
  • CLEF Labs academic

Not equivalent to

  • CLEF is not Cross-Language Retrieval. CLEF has historically emphasized cross-language and multilingual information access evaluation; cross-language retrieval is a retrieval task, not the CLEF venue.
  • CLEF is not Qrels. CLEF labs may publish relevance judgments or qrels; qrels are judgment files, not the CLEF program itself.
  • CLEF is not Test Collection. CLEF is an evaluation program and research venue; a test collection is an evaluation resource, some of which are created through CLEF labs.
  • CLEF is not TREC. CLEF and TREC are distinct evaluation programs and venues, though both support shared evaluation in information retrieval and information access.
  • CLEF is not FIRE. FIRE and CLEF are distinct evaluation programs and communities, even though both support multilingual information-access evaluation.
  • CLEF is not INEX. INEX is a structured-document retrieval evaluation initiative that later ran within CLEF; CLEF is the broader evaluation forum.
  • CLEF is not NTCIR. NTCIR and CLEF are distinct evaluation programs with different communities, histories, and task emphases.

Learn more

ID