Midterm review
Download
1 / 5

Midterm Review - PowerPoint PPT Presentation


  • 48 Views
  • Uploaded on

Midterm Review. CS4705 Natural Language Processing. Midterm Review. Statistical v. Symbolic Processing 80/20 Rule Regular Expressions Finite State Automata Determinism v. non-determinism (Weighted) Finite State Transducers Morphology Word Classes Inflectional v. Derivational

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' Midterm Review' - shad-hansen


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Midterm review

Midterm Review

CS4705

Natural Language Processing


Midterm review1
Midterm Review

  • Statistical v. Symbolic Processing

    • 80/20 Rule

  • Regular Expressions

  • Finite State Automata

    • Determinism v. non-determinism

    • (Weighted) Finite State Transducers

  • Morphology

    • Word Classes

    • Inflectional v. Derivational

    • Affixation, infixation, concatenation

    • Morphotactics


Midterm review

  • Morphological parsing

    • Koskenniemi’s two-level morphology

    • Porter stemmer

  • Minimum Edit Distance (Levenshtein)

  • N-grams

    • Markov assumption

    • Chain Rule

    • Language Modeling

      • Simple, Adaptive, Class-based (syntax-based), bursty

    • Smoothing

      • Add-one, Witten-Bell, Good-Turing

    • Back-off

    • Perplexity, Entropy

  • Maximum Likelihood Estimation


Midterm review

  • Syntax

    • Chomsky’s view: Syntax is cognitive reality

    • Parse Trees

      • Dependency Structure

    • Part-of-Speech Tagging

      • Hand Written Rules v. Statistical v. Hybrid

      • Brill Tagging

    • Types of Ambiguity

  • Context Free Grammars

    • Top-down v. Bottom-up Derivations

      • Left Corners

    • Grammar Equivalence

    • Normal Forms (CNF)


Midterm review

  • Probabilistic Parsing

    • (p)CYK, Earley Parsing

    • Derivational Probability

    • Lexicalization

    • Classification

    • Supertagging

  • Machine Learning

    • Dependent v. Independent variables

    • Training v. Development Test v. Test sets

    • Feature Vectors

    • Metrics

      • Accuracy

      • Precision, Recall, F-Measure

    • Gold Standards