Unsupervised word sense disambiguation for Korean through the acyclic weighted digraph using corpus ...
Download
1 / 16

Presenter: Chun-Ping Wu - PowerPoint PPT Presentation


  • 87 Views
  • Uploaded on

Unsupervised word sense disambiguation for Korean through the acyclic weighted digraph using corpus and dictionary. Presenter: Chun-Ping Wu Authors: Yeohoon Yoon, Choong-Nyoung Seon , Songwook Lee, Jungynu Seo. 國立雲林科技大學 National Yunlin University of Science and Technology. IPM 2007.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' Presenter: Chun-Ping Wu' - river


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript

Unsupervised word sense disambiguation for Korean through the acyclic weighted digraph using corpus and dictionary

Presenter: Chun-Ping Wu

Authors: Yeohoon Yoon, Choong-NyoungSeon, Songwook Lee, JungynuSeo

國立雲林科技大學

National Yunlin University of Science and Technology

IPM 2007


Outline
Outline the acyclic weighted digraph using corpus and dictionary

  • Motivation

  • Objective

  • Methodology

  • Experiments

  • Conclusion

  • Comments


Motivation
Motivation the acyclic weighted digraph using corpus and dictionary

  • The Word Sense Disambiguation is a common problem in natural language processing.

  • Traditional approaches only consider the co-occurrence probability alone.

Sample:I deposit some money in the bank.

Options:

bank = 銀行?

bank = 堤; 岸?

bank = (一)排; (一)組


Objective
Objective the acyclic weighted digraph using corpus and dictionary

  • To construct a WSD system, which can be easily implemented by learning all polysemous words at once, while covering all polysemous words which are listed in MRD.

  • To consider relation between each sense of context words and the sense of the target word.

Sample:I deposit some money In the bank.

Ans:

bank = 銀行


Methodology
Methodology the acyclic weighted digraph using corpus and dictionary

  • Learning step

    • Similarity matrix

    • Word vector

    • Vector representations of sense definitions in MRD

  • Disambiguation step

    • The definition of acyclic weighted digraph.

    • Selecting context words

    • Constructing the acyclic weighted digraph

    • Searching the optimal path on the acyclic weighted digraph


Methodology1
Methodology the acyclic weighted digraph using corpus and dictionary

  • Learning step

    • Similarity matrix

    • Word vector

    • Vector representations of sense definitions

      in MRD


Methodology2
Methodology the acyclic weighted digraph using corpus and dictionary

  • Learning step

    • Similarity matrix

    • Word vector

    • Vector representations of sense definitions

      in MRD.


Methodology3
Methodology the acyclic weighted digraph using corpus and dictionary

  • Learning step

    • Similarity matrix

    • Word vector

    • Vector representations of sense definitions

      in MRD


Methodology4
Methodology the acyclic weighted digraph using corpus and dictionary

  • Disambiguation step

    • The definition of acyclic weighted digraph.

    • Selecting context words

    • Constructing the acyclic weighted digraph

    • Searching the optimal path on the acyclic

      weighted digraph


Methodology5
Methodology the acyclic weighted digraph using corpus and dictionary

  • Disambiguation step

    • The definition of acyclic weighted digraph.

    • Selecting context words

    • Constructing the acyclic weighted digraph

    • Searching the optimal path on the acyclic

      weighted digraph


Methodology6
Methodology the acyclic weighted digraph using corpus and dictionary

  • Disambiguation step

    • The definition of acyclic weighted digraph.

    • Selecting context words

    • Constructing the acyclic weighted digraph

    • Searching the optimal path on the acyclic

      weighted digraph


Methodology7
Methodology the acyclic weighted digraph using corpus and dictionary

  • Disambiguation step

    • The definition of acyclic weighted digraph.

    • Selecting context words

    • Constructing the acyclic weighted digraph

    • Searching the optimal path on the acyclic

      weighted digraph


Experiments
Experiments the acyclic weighted digraph using corpus and dictionary

  • System results


Experiments1
Experiments the acyclic weighted digraph using corpus and dictionary

  • Experiment on English

    • The accuracy of the system is 30.7% on average.

    • The result is very low; there are some reasons as follows.

      • Context words are not appropriate although context words are very important in that they decide which sense of the target word might be the best.

      • Mapping English senses to Korean for using English-Korean dictionary leads to some loss of information.

      • The errors of the stemming process disturbed us to search the right root of the verb in the MRD.


Conclusion
Conclusion the acyclic weighted digraph using corpus and dictionary

  • To consider the relationship between each sense of context words and the sense of the target word

  • By using Viterbi algorithm to reduce computational complexity.

  • The system showed bad results on English (30.7), but it resulted in suitable performances, 76.4% by accuracy, over the semantically ambiguous Korean words.

  • To apply this method to other languages by studying language characteristics.

15


Comments
Comments the acyclic weighted digraph using corpus and dictionary

  • Advantage

    • To consider the relationship between each sense of context words and the sense of the target word.

    • By using Viterbi algorithm to reduce computational complexity.

  • Drawback

    • The performance of this system is better in Korean.

  • Application

    • Word Sense Disambiguation

16


ad