Experiments of opinion analysis on mpqa and ntcir 6
This presentation is the property of its rightful owner.
Sponsored Links
1 / 11

Experiments of Opinion Analysis On MPQA and NTCIR-6 PowerPoint PPT Presentation


  • 84 Views
  • Uploaded on
  • Presentation posted in: General

Experiments of Opinion Analysis On MPQA and NTCIR-6. Yaoyong Li, Kalina Bontcheva, Hamish Cunningham Department of Computer Science University of Sheffield {yaoyong,kalina,[email protected] http://gate.ac.uk/ http://nlp.shef.ac.uk/.

Download Presentation

Experiments of Opinion Analysis On MPQA and NTCIR-6

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Experiments of opinion analysis on mpqa and ntcir 6

Experiments of Opinion Analysis On MPQA and NTCIR-6

Yaoyong Li, Kalina Bontcheva, Hamish Cunningham

Department of Computer Science

University of Sheffield

{yaoyong,kalina,[email protected]

http://gate.ac.uk/http://nlp.shef.ac.uk/


Outlines

We participated two tracks, English and Chinese corpora.

Compared the results on the MPQA corpus and the NTCIR-6 corpus.

Outlines

2(10)


Opinionated sentence recognition

Uni-gram of token’s lemma and POS

tf*idf representation of sentence.

SVM with uneven margins as binary classifier.

Opinionated Sentence Recognition

3(10)


Opinion holder extraction

An information extraction problem.

Identify the first token and last token of an opinion holder.

Two SVM binary classifiers.

Opinion Holder Extraction

4(10)


Experiments on mpqa corpus

Consists of 535 news articles.

360 documents were used for training and other 175 documents for testing.

Experiments on MPQA Corpus

5(10)


Results on mpqa corpus

Results on MPQA Corpus

  • There are comparable with the state of the art results published.

6(10)


Results on ntcir 6 english

Results on NTCIR-6 English

  • Using the SVM models learned from the MPQA corpus.

  • The following are the official results of the run GATE-1.

7(10)


Gate 1 results using gate evaluation tools

GATE-1 Results Using GATE Evaluation Tools

  • Results of the opinionated sentence recognition became lower.

  • Results of the opinion holder extraction was a slightly higher.

8(10)


Experiments using ntcir 6 english corpus for training and testing

300 documents for training, and 139 documents for testing.

Just use the annotations of one annotator, in the file “OAT2006 formalrun english a1.csv”.

212 opinion holders (among the 2355 opinion holders) in the file which had no match within the corresponding sentences. We made necessary changes on them to find the text.

Experiments Using NTCIR-6 English Corpus for Training and Testing

9(10)


Results using ntcir 6 english corpus for training and testing

Results Using NTCIR-6 English Corpus for Training and Testing

  • Much improved results by using the NTCIR-6 corpus for training and testing, showing that there really exist differences between the two corpora,

  • Still worse than the results on the MPQA corpus.

10(10)


Conclusions

SVM with uneven margins obtained state of the art results on the MPQA corpus.

On NTCIR corpus, obtained moderate results on opinionated sentence extraction, but poor results on opinion holder.

Using NTCIR-6 English corpus for training and testing obtained much improved results, but were still worse than those on MPQA.

Conclusions

11(10)


  • Login