Linguistic Resources for
This presentation is the property of its rightful owner.
Sponsored Links
1 / 15

Linguistic Resources for the 2013 TAC KBP Entity Linking Evaluation PowerPoint PPT Presentation


  • 95 Views
  • Uploaded on
  • Presentation posted in: General

Linguistic Resources for the 2013 TAC KBP Entity Linking Evaluation. Joe Ellis (presenter ), Justin Mott, Xuansong Li, Jeremy Getman, Jonathan Wright, Stephanie Strassel. Linguistic Data Consortium University of Pennsylvania, USA. 2013 Source Corpus. Entity Linking Overview.

Download Presentation

Linguistic Resources for the 2013 TAC KBP Entity Linking Evaluation

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Linguistic resources for the 2013 tac kbp entity linking evaluation

Linguistic Resources for the

2013 TAC KBP Entity Linking Evaluation

Joe Ellis (presenter),

Justin Mott, Xuansong Li, Jeremy Getman, Jonathan Wright, Stephanie Strassel

Linguistic Data Consortium

University of Pennsylvania, USA


2013 source corpus

2013 Source Corpus

TAC KBP Evaluation Workshop – NIST, November 18-19, 2013


Entity linking overview

Entity Linking Overview

Stage 1:

Select name strings and ref docs

Stage 2:

Link namestrings to KB or mark as NIL

TAC KBP Evaluation Workshop – NIST, November 18-19, 2013


Entity linking overview1

Entity Linking Overview

Stage 1:

Select name strings and ref docs

Stage 2:

Link namestrings to KB or mark as NIL

TAC KBP Evaluation Workshop – NIST, November 18-19, 2013


Entity linking overview2

Entity Linking Overview

Stage 1:

Select name strings and ref docs

Stage 2:

Link namestrings to KB or mark as NIL

TAC KBP Evaluation Workshop – NIST, November 18-19, 2013


Entity linking overview3

Entity Linking Overview

Stage 1:

Select name strings and ref docs

Stage 2:

Link namestrings to KB or mark as NIL

Stage 3:

Co-reference NIL entities

Wendy

Wendy Gaxiola

TAC KBP Evaluation Workshop – NIST, November 18-19, 2013


Entity linking overview4

Entity Linking Overview

Stage 1:

Select name strings and ref docs

Stage 2:

Link namestrings to KB or mark as NIL

Stage 3:

Co-reference NIL entities

Wendy

Wendy Gaxiola

TAC KBP Evaluation Workshop – NIST, November 18-19, 2013


Entity linking stage 1

Entity Linking – Stage 1

  • Run named entity taggers over source corpora

    • Provides guided search through the corpus

    • Thanks KBP coordinators!

  • Namestring Selection

    • Confusable

TAC KBP Evaluation Workshop – NIST, November 18-19, 2013


Entity linking stage 11

Entity Linking – Stage 1

  • Run named entity taggers over source corpora

    • Provides guided search through the corpus

    • Thanks KBP coordinators!

  • Namestring Selection

    • Confusable

TAC KBP Evaluation Workshop – NIST, November 18-19, 2013


Entity linking stage 12

Entity Linking – Stage 1

  • Run named entity taggers over source corpora

    • Provides guided search through the corpus

    • Thanks KBP coordinators!

  • Namestring Selection

    • Confusable

TAC KBP Evaluation Workshop – NIST, November 18-19, 2013


Entity linking stage 13

Entity Linking – Stage 1

  • Run named entity taggers over source corpora

    • Provides guided search through the corpus

    • Thanks KBP coordinators!

  • Namestring Selection

    • Confusable

    • Ambiguous

    • Varied

?

TAC KBP Evaluation Workshop – NIST, November 18-19, 2013


Entity linking stage 14

Entity Linking – Stage 1

  • Run named entity taggers over source corpora

    • Provides guided search through the corpus

    • Thanks KBP coordinators!

  • Namestring Selection

    • Confusable

    • Ambiguous

    • Varied

?

TAC KBP Evaluation Workshop – NIST, November 18-19, 2013


Entity linking stage 1 namestring selection

Entity Linking – Stage 1: Namestring Selection

  • Ratios

    • NIL & non-NIL

    • Entity types

    • Genre

  • Measurable confusability

    • Multiple-entity namestrings (“Smith”)

    • Multiple-namestring entities (“Barack Obama”, “Bam-Bam”, “Bammy”)

      • NIL singletons

      • Cross-lingual

TAC KBP Evaluation Workshop – NIST, November 18-19, 2013


Entity linking stages 2 3 kb linking and nil coref

Entity Linking – Stages 2 & 3: KB Linking and NIL Coref

  • KB Linking

    • Review ref document and search KB for matching node

    • Multiple namestrings viewed together for quicker linking

  • NIL Coreference

    • NIL queries (no KB match) require manual co-reference annotation

    • Time-limited quality control pass to enhance completeness and accuracy

TAC KBP Evaluation Workshop – NIST, November 18-19, 2013


Delivered 2013 resources

Delivered 2013 Resources

TAC KBP Evaluation Workshop – NIST, November 18-19, 2013


  • Login