Introduction to Natural Language Processing and Text Mining and The basic building blocks. Sudeshna Sarkar Professor Computer Science & Engineering Department Indian Institute of Technology Kharagpur. Ambiguity. At last, a computer that understands you like your mother.
Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.
Introduction to Natural Language Processing and Text MiningandThe basic building blocks
Computer Science & Engineering Department
Indian Institute of Technology Kharagpur
At last, a computer that understands you like your mother.
-- 1985 McDonnell-Douglas Ad
Speech : ….. a computer that understands your lie cured mother …
Morphological and lexical analysis
Source Language Speech Signal
Target Language Speech Signal
Target text Generation
Source text Analysis
Source Language Analysis
Target Language Generation
Encode all the necessary knowledge
Good when annotated data is not available
Allows steady development
The development can be monitored
Fits well with logic and reasoning in AI
Learn language from its usage
Supervised learning require large collections manually annotated with meta-tags
Development is almost blind
Few ways to check the correctness
Debugging is very frustrating
lady ‘(well behaved) female adult human’
-like ‘having the characteristics of’
-s, a plural marker on nouns
-der ‘plural genitive’
Can’t break any of these down further without distorting the meaning of the units
After a combination with an inflectional morpheme,
the meaning and class of the actual stem usually do not change.