'Smoothed counts' presentation slideshows

N-gram model limitations

N-gram model limitations. Important question was asked in class: what do we do about N-grams which were not in our training corpus? Answer given: we distribute some probability mass from seen N-grams to this new N-gram. This leads to another question: how do we do this?. Unsmoothed bigrams.

302 views • 22 slides