Special Topics in Computer Science Advanced Topics in Information Retrieval Chapter 3: Goals: Retrieval Evaluation. Alexander Gelbukh www.Gelbukh.com. Previous chapter. Models are needed for formal operations Boolean model is the simplest
Special Topics in Computer ScienceAdvanced Topics in Information RetrievalChapter 3: Goals: Retrieval Evaluation
The only valid way of reasoning
Others are lost.
Others are noise.
Which one is better?
Two algs: A, B
Which is better?
F-measure: E-measure:user preference Rec vs. Prec
Texts with queries and relevant docs known
Ad-hoc (conventional: query answer)
Routing (ranked filtering of changing collection)
Filtering (changing collection; no ranking)
Interactive (no ranking)
NLP: does it help?
High precision (only 10 docs in answer)
Spoken document retrieval (written transcripts)
Very large corpus (ad-hoc, 20 GB = 7.5 M docs)
Query task (several query versions; does strategy depends on it?)
Till ... ??