1 / 14

LDMT MURI Data Collection and Linguistic Annotation

LDMT MURI Data Collection and Linguistic Annotation. November 2, 2012 Jason Baldridge, UT Austin Lori Levin, CMU. Purpose. Collect and build data Monolingual text Bilingual text Linguistic annotations to support work on machine translation for Kinyarwanda-English Malagasy-English.

selene
Download Presentation

LDMT MURI Data Collection and Linguistic Annotation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. LDMT MURIData Collection and Linguistic Annotation November 2, 2012 Jason Baldridge, UT Austin Lori Levin, CMU

  2. Purpose Collect and build data • Monolingual text • Bilingual text • Linguistic annotations to support work on machine translation for • Kinyarwanda-English • Malagasy-English

  3. Kinyarwanda Data Resources word counts ENG treebank ENG text KIN text KIN treebank ENGLISH monolingual (huge) PTB (1m) GWord (8b) KGMC (270k) KGMC (225k) KGMC (2.9k) KGMC (3.8k) KGMC (5.8k) KGMC (4.8k) BILINGUAL (285k) Dict (9k) Dict (8k) Pbook (0.9k) Pbook (0.7k) BBC (0.3k) BBC (0.3k) BBC (0.3k) BBC (0.3k) IGT (0.1k) IGT (0.1k) IGT (0.06k) IGT (0.06k) KINYARWANDA monolingual (7m) 1.0 Release 02/11 2.0 Release 10/11 News (7m)

  4. Kinyarwanda Data Resources word counts ENG treebank ENG text KIN text KIN treebank ENGLISH monolingual (huge) PTB (1m) GWord (8b) KGMC (270k) KGMC (225k) KGMC (2.9k) Part-of-speech (2k) GFL (4.7k) KGMC (3.8k) KGMC (5.8k) KGMC (4.8k) BILINGUAL (285k) Dict (9k) Dict (8k) Reviewed & improved Reviewed & improved Pbook (0.9k) Pbook (0.7k) BBC (0.3k) BBC (0.3k) BBC (0.3k) BBC (0.3k) IGT (0.1k) IGT (0.1k) IGT (0.06k) IGT (0.06k) KINYARWANDA monolingual (7m) 1.0 Release 02/11 2.0 Release 10/11 3.0 Release 11/12 News (7m)

  5. Malagasy Data Resources ENG treebank ENG text MLG text MLG treebank ENGLISH monolingual (huge) PTB (1m) Gword (8b) News (2.3k) Bible (730k) Bible (725k) BILINGUAL (732k) News (2.1k) News (2.1k) News (2.3k) MALAGASY Monolingual 1.0 Release 02/11 2.0 Release 10/11

  6. Malagasy Data Resources ENG treebank ENG text MLG text MLG treebank ENGLISH monolingual (huge) PTB (1m) Gword (8b) News (2.3k) Reviewed & improved. Part-of-speech (2k) Bible (730k) Bible (725k) BILINGUAL (732k) News (2.1k) Reviewed & improved. News (2.1k) News (2.3k) Dictionary (77.5k) Global voices (1.8m) Global voices (1.9m) Global voices GFL (3.7k) MALAGASY Monolingual Leipzig (600k) 1.0 Release 02/11 2.0 Release 10/11 3.0 Release 11/12

  7. Malagasy Data Resources • Year 1: 19th century Malagasy bible • Year 2: • Univ. of Leipzig Web Corpus • Monolingual Malagasy, very clean • CMU Global Voices Archive

  8. Malagasy Resources Malagasy - English Resources

  9. CMU Global Voices Corpus • Domains include Twitter, blogs, news about popular democracy movements • Actively published by volunteer translators • We are gathering ~ 500k words / language / year of high quality parallel data http://www.ark.cs.cmu.edu/global-voices/

  10. Morphological analysis • We decided against creating morphological gold-standard annotations from the output of finite state transducers. • Initially tried to use XFST analyzer created by Dalrymple, Liakata and Mackie 2006. • Quality of the output of Dalrymple transducer was poor (ambiguous, many incorrect). • No existing Kinyarwanda transducer • Any annotations would be subject to changing analyses during transducer development.

  11. Morphological analysis • Developed new transducers for both Kinyarwanda and Malagasy. • Less ambiguity • Cautious guessing for unknown stems => better precision • Improvements driven by measuring ambiguity/coverage on data and effect on performance in other tasks. • We may produce annotations after transducer development deemed sufficient.

  12. Syntactic annotations • During past year, we reviewed and revised phrase structures annotated for kin and mlg texts. • Analyses and labels made more consistent across languages • Head annotations added to enable dependency parsing training/evaluation. • All tokenization standardized. • GFL annotations: 4k each tokens, kin and mlg

  13. Data accomplishments • Fieldwork on Kinyarwanda that informs theoretical linguistic work and transducers. • New morphological transducers for kin and mlg. • V 3.0 of monolingual, bilingual, and tree-banked data for Kinyarwanda and Malagasy to be released this coming week. • Order of magnitude parallel data (mlg) • Better & more syntactic data (kin/mlg)

  14. Data accomplishments • Evaluation • Pilot annotations for linguistically target test suites • Formal linguistic advances • GFL specification and tools for annotation and visualization • Abstract Meaning Representation (AMR): leverage ideas, data and tools from ISI as part of other synergistic projects.

More Related