slide1
Download
Skip this Video
Download Presentation
Linguistic Resources for the 2013 TAC KBP Entity Linking Evaluation

Loading in 2 Seconds...

play fullscreen
1 / 15

Linguistic Resources for the 2013 TAC KBP Entity Linking Evaluation - PowerPoint PPT Presentation


  • 129 Views
  • Uploaded on

Linguistic Resources for the 2013 TAC KBP Entity Linking Evaluation. Joe Ellis (presenter ), Justin Mott, Xuansong Li, Jeremy Getman, Jonathan Wright, Stephanie Strassel. Linguistic Data Consortium University of Pennsylvania, USA. 2013 Source Corpus. Entity Linking Overview.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' Linguistic Resources for the 2013 TAC KBP Entity Linking Evaluation' - quinto


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
slide1

Linguistic Resources for the

2013 TAC KBP Entity Linking Evaluation

Joe Ellis (presenter),

Justin Mott, Xuansong Li, Jeremy Getman, Jonathan Wright, Stephanie Strassel

Linguistic Data Consortium

University of Pennsylvania, USA

2013 source corpus
2013 Source Corpus

TAC KBP Evaluation Workshop – NIST, November 18-19, 2013

entity linking overview
Entity Linking Overview

Stage 1:

Select name strings and ref docs

Stage 2:

Link namestrings to KB or mark as NIL

TAC KBP Evaluation Workshop – NIST, November 18-19, 2013

entity linking overview1
Entity Linking Overview

Stage 1:

Select name strings and ref docs

Stage 2:

Link namestrings to KB or mark as NIL

TAC KBP Evaluation Workshop – NIST, November 18-19, 2013

entity linking overview2
Entity Linking Overview

Stage 1:

Select name strings and ref docs

Stage 2:

Link namestrings to KB or mark as NIL

TAC KBP Evaluation Workshop – NIST, November 18-19, 2013

entity linking overview3
Entity Linking Overview

Stage 1:

Select name strings and ref docs

Stage 2:

Link namestrings to KB or mark as NIL

Stage 3:

Co-reference NIL entities

Wendy

Wendy Gaxiola

TAC KBP Evaluation Workshop – NIST, November 18-19, 2013

entity linking overview4
Entity Linking Overview

Stage 1:

Select name strings and ref docs

Stage 2:

Link namestrings to KB or mark as NIL

Stage 3:

Co-reference NIL entities

Wendy

Wendy Gaxiola

TAC KBP Evaluation Workshop – NIST, November 18-19, 2013

entity linking stage 1
Entity Linking – Stage 1
  • Run named entity taggers over source corpora
    • Provides guided search through the corpus
    • Thanks KBP coordinators!
  • Namestring Selection
    • Confusable

TAC KBP Evaluation Workshop – NIST, November 18-19, 2013

entity linking stage 11
Entity Linking – Stage 1
  • Run named entity taggers over source corpora
    • Provides guided search through the corpus
    • Thanks KBP coordinators!
  • Namestring Selection
    • Confusable

TAC KBP Evaluation Workshop – NIST, November 18-19, 2013

entity linking stage 12
Entity Linking – Stage 1
  • Run named entity taggers over source corpora
    • Provides guided search through the corpus
    • Thanks KBP coordinators!
  • Namestring Selection
    • Confusable

TAC KBP Evaluation Workshop – NIST, November 18-19, 2013

entity linking stage 13
Entity Linking – Stage 1
  • Run named entity taggers over source corpora
    • Provides guided search through the corpus
    • Thanks KBP coordinators!
  • Namestring Selection
    • Confusable
    • Ambiguous
    • Varied

?

TAC KBP Evaluation Workshop – NIST, November 18-19, 2013

entity linking stage 14
Entity Linking – Stage 1
  • Run named entity taggers over source corpora
    • Provides guided search through the corpus
    • Thanks KBP coordinators!
  • Namestring Selection
    • Confusable
    • Ambiguous
    • Varied

?

TAC KBP Evaluation Workshop – NIST, November 18-19, 2013

entity linking stage 1 namestring selection
Entity Linking – Stage 1: Namestring Selection
  • Ratios
    • NIL & non-NIL
    • Entity types
    • Genre
  • Measurable confusability
    • Multiple-entity namestrings (“Smith”)
    • Multiple-namestring entities (“Barack Obama”, “Bam-Bam”, “Bammy”)
      • NIL singletons
      • Cross-lingual

TAC KBP Evaluation Workshop – NIST, November 18-19, 2013

entity linking stages 2 3 kb linking and nil coref
Entity Linking – Stages 2 & 3: KB Linking and NIL Coref
  • KB Linking
    • Review ref document and search KB for matching node
    • Multiple namestrings viewed together for quicker linking
  • NIL Coreference
    • NIL queries (no KB match) require manual co-reference annotation
    • Time-limited quality control pass to enhance completeness and accuracy

TAC KBP Evaluation Workshop – NIST, November 18-19, 2013

delivered 2013 resources
Delivered 2013 Resources

TAC KBP Evaluation Workshop – NIST, November 18-19, 2013

ad