Method

TF-IDF

Canonical ID https://id.searchplex.net/tf-idf/

A term-weighting method that combines term frequency with inverse document frequency to weight terms in documents, queries, or vector-space representations.

Also called

  • Term Frequency-Inverse Document Frequency
  • Term Frequency–Inverse Document Frequency

Scope

TF-IDF is commonly associated with vector space retrieval and classical lexical baselines. It is not the same as BM25, lexical retrieval generally, or sparse retrieval generally.

Used for

Not equivalent to

  • TF-IDF is not BM25. TF-IDF is a term-weighting method; BM25 is a probabilistic ranking function with term saturation and document-length normalization.
  • TF-IDF is not Lexical Retrieval. TF-IDF is one classical term-weighting method; lexical retrieval is the broader retrieval family based on lexical features.

Learn more

ID