1 / 4

Evaluation of Multi-Media Data QA Systems AQUAINT Breakout Session – June 2002

Evaluation of Multi-Media Data QA Systems AQUAINT Breakout Session – June 2002. Howard Wactlar, Carnegie Mellon Yiming Yang, Carnegie Mellon Herb Gish, BBN. Extracting Answers From …. Web-based charts and graphs – Yiming Yang Continuous speech – Herb Gish Video – Howard Wactlar.

abedi
Download Presentation

Evaluation of Multi-Media Data QA Systems AQUAINT Breakout Session – June 2002

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Evaluation of Multi-Media Data QA SystemsAQUAINT Breakout Session – June 2002 Howard Wactlar, Carnegie Mellon Yiming Yang, Carnegie Mellon Herb Gish, BBN

  2. Extracting Answers From … • Web-based charts and graphs – Yiming Yang • Continuous speech – Herb Gish • Video – Howard Wactlar

  3. Multimedia Data Extraction • Long term goal: Ability to respond to same challenge and metrics as current and forthcoming TREC-QA • But with different source data • Multiple channels of information (with temporal and spatial dimensions) simultaneously • Problem: Errors inherent in extraction and interpretation • …but parallel sources of data may corroborate or refute

  4. Evaluation Task Proposal: Multi-modal Biography Generation • Task Description: • Given a name, generate a multi-modal summary of key characteristics and events of person’s life in a specified time frame. • Response: • Natural language passages/sentences of key events • Recent/historical pictures of individual • video/radio segments (e.g., speech,interview) augmenting key events • Org chart, map of movements • Data: • Web images and text • Video and radio from news sources • Eval: • Subjective (analyst / other user) assessment • Objective: precision, recall, recency, coherence Goal for next meeting: Define application-based task and metrics

More Related