Вопросно-ответные системы
Download
1 / 50

Вопросно-ответные системы - PowerPoint PPT Presentation


  • 326 Views
  • Uploaded on

Вопросно-ответные системы Актуальные проблемы прикладной лингвистики, Е.Ю. Калинина, МГУ, 2007-2008 Что такое воспросно-ответные системы? Q&A: Inputs : a question in English; a set of text and database resources Output : a set of possible answers drawn from the resources

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' Вопросно-ответные системы' - Audrey


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Slide1 l.jpg

Вопросно-ответные системы

Актуальные проблемы прикладной лингвистики, Е.Ю. Калинина, МГУ, 2007-2008


Slide2 l.jpg
Что такое воспросно-ответные системы?

  • Q&A:

  • Inputs: a question in English; a set of text and database resources

  • Output: a set of possible answers drawn from the resources

  • When is the next train to Dublin? --> Q&A System --> Text Corpora & RelDBases --> 8.35, track 9


Slide3 l.jpg
Основные компоненты вопросно-ответной системы

Generic architecture

  • • Query processing

  • • Paragraph indexing

  • • Answer resolution

  • • Open-domain vs. domain-specific systems

    Given a NL query, extract its possibleanswer(s) from real-world NL text documents.


Slide4 l.jpg
Типы информационных потребностей

  • Ad hoc retrieval: find me documents “like this”

Identify positive accomplishments of the Hubble telescope since it was launched in 1991.

Compile a list of mammals that are considered to be endangered, identify their habitat and, if possible, specify what threatens them.


Slide5 l.jpg
Типы информационных потребностей

  • Question answering

Who discovered Oxygen?

When did Hawaii become a state?

Where is Ayer’s Rock located?

What team won the World Series in 1992?

“Factoid”

What countries export oil?

Name U.S. cities that have a “Shubert” theater.

“List”

Who is Aaron Copland?

What is a quasar?

“Definition”


Slide6 l.jpg
Предшественники вопросно-ответных систем

  • Information Retrieval

    • Retrieve relevant documents from a set of keywords; search engines

  • Information Extraction

    • Template filling from text (e.g. event detection); e.g. TIPSTER, MUC

  • Relational QA

    • Translate question to relational DB query; e.g. LUNAR, FRED


Information extraction ie l.jpg
Information Extraction (IE) вопросно-ответных систем

IE systems:

  • Identify documents of a specific type

  • Extract information according to pre-defined templates

  • Place the information into frame-like database records

Damage

Deaths

...

Type

Date

Location

Weather disaster:


Information extraction ie8 l.jpg
Information Extraction (IE) вопросно-ответных систем

  • Templates = pre-defined questions

  • Extracted information = answers

    Limitations

  • Templates are domain dependent and not easily portable

  • One size does not fit all!


Typical trec qa pipeline l.jpg

Question вопросно-ответных систем

Query

Docs

Answers

ExtractKeywords

SearchEngine

PassageExtractor

AnswerSelector

Answer

Corpus

“A simple factoidquestion”

“A 50-byte passage likelyto contain the desired

answer” (TREC QA track)

Typical TREC QA Pipeline


Factoid q a l.jpg
Основная идея вопросно-ответных системFactoid Q&A

  • Determine the semantic type of the expected answer

  • Retrieve documents that have keywords from the question

  • Look for named-entities of the proper type near keywords

“Who won the Nobel Peace Prize in 1991?”

is looking for a PERSON

Retrieve documents that have the keywords “won”, “Nobel Peace

Prize”, and “1991”

Look for a PERSON near the keywords “won”, “Nobel Peace Prize”, and “1991”


Slide11 l.jpg
Пример вопросно-ответных систем

Who won the Nobel Peace Prize in 1991?

But many foreign investors remain sceptical, and western governments are withholding aid because of the Slorc's dismal human rights record and the continued detention of Ms Aung San Suu Kyi, the opposition leader whowontheNobel Peace Prizein1991.


Slide12 l.jpg
Пример (продолжение) вопросно-ответных систем

The military junta took power in 1988 as pro-democracy demonstrations were sweeping the country. It held elections in 1990, but has ignored their result. It has kept the 1991 Nobel peace prize winner, Aung San Suu Kyi - leader of the opposition party which won a landslide victory in the poll - under house arrest since July 1989.


Slide13 l.jpg
Пример (продолжение) вопросно-ответных систем

The regime, which is also engaged in a battle with insurgents near its eastern border with Thailand, ignored a 1990 election victory by an opposition party and is detaining its leader, Ms Aung San Suu Kyi, who was awarded the1991 Nobel Peace Prize. According to the British Red Cross, 5,000 or more refugees, mainly the elderly and women and children, are crossing into Bangladesh each day.


Slide14 l.jpg

Generic вопросно-ответных системQA Architecture

NL question

Question Analyzer

IR Query

Document Retriever

Answer Type

Documents

Passage Retriever

Passages

Answer Extractor

Answers

Типовая архитектура вопросно-ответной системы


Slide15 l.jpg
Анализ вопроса вопросно-ответных систем

Question word cues

  • Who  person, organization, location (e.g., city)

  • When  date

  • Where  location

  • What/Why/How  ??

    Head noun cues

  • What city, which country, what year...

  • Which astronaut, what blues band, ...

    Scalar adjective cues

  • How long, how fast, how far, how old, ...


Wordnet l.jpg

Using WordNet вопросно-ответных систем

What is the service ceiling of an U-2?

length

NUMBER

wingspan

diameter

radius

altitude

ceiling

Использование WordNet


Ne named entities l.jpg
NE (Named Entities): вопросно-ответных системпримеры

  • Person: Mr. Hubert J. Smith, Adm. McInnes, Grace Chan

  • Title: Chairman, Vice President of Technology, Secretary of State

  • Country: USSR, France, Haiti, Haitian Republic

  • City: New York, Rome, Paris, Birmingham, Seneca Falls

  • Province: Kansas, Yorkshire, Uttar Pradesh

  • Business: GTE Corporation, FreeMarkets Inc., Acme

  • University: Bryn Mawr College, University of Iowa

  • Organization: Red Cross, Boys and Girls Club


Ne named entities18 l.jpg
NE (Named Entities): вопросно-ответных системпримеры

Currency: 400 yen, $100, DM 450,000

Linear: 10 feet, 100 miles, 15 centimeters

Area: a square foot, 15 acres

Volume: 6 cubic feet, 100 gallons

Weight: 10 pounds, half a ton, 100 kilos

Duration: 10 day, five minutes, 3 years, a millennium

Frequency: daily, biannually, 5 times, 3 times a day

Speed: 6 miles per hour, 15 feet per second, 5 kph

Age: 3 weeks old, 10-year-old, 50 years of age


Slide19 l.jpg
Способы извлечения вопросно-ответных системNE

  • Heuristics and patterns

  • Fixed-lists (gazetteers)

  • Machine learning approaches


Slide20 l.jpg
Иерархия типов ответов вопросно-ответных систем


Slide21 l.jpg
Результат??? вопросно-ответных систем

  • Where do lobsters like to live?

    on a Canadian airline

  • Where do hyenas live?

    in Saudi Arabia

    in the back of pick-up trucks

  • Where are zebras most likely found?

    near dumps

    in the dictionary

  • Why can't ostriches fly?

    Because of American economic sanctions

  • What’s the population of Maryland?

    three


Slide22 l.jpg
Эволюция вопросно-ответных систем

  • Traditional QA Systems (TREC)

    • Question treated like keyword query

    • Single answers, no understandingQ: Who is prime minister of India?<find a person name close to prime, minister, India (within 50 bytes)>A: John Smith is not prime minister of India


Slide23 l.jpg
Вопросно-ответные системы будущего

  • System understands questions

  • System understands answers and interprets which are most useful

  • System produces sophisticated answers (list, summarize, evaluate)What other airports are near Niletown?Where can helicopters land close to the embassy?


Slide24 l.jpg
Основные проблемы исследований будущего

  • Acquiring high-quality, high-coverage lexical resources

  • Improving document retrieval

  • Improving document understanding

  • Expanding to multi-lingual corpora

  • Flexible control structure

    • “beyond the pipeline”

  • Answer Justification

    • Why should the user trust the answer?

    • Is there a better answer out there?


Slide25 l.jpg
Почему необходимы технологии обработки естественного языка?

  • Question: “When was Wendy’s founded?”

  • Passage candidate:

    • “The renowned Murano glassmaking industry, on an island in the Venetian lagoon, has gone through several reincarnations since it was founded in 1291. Three exhibitions of 20th-century Murano glass are coming up in New York. By Wendy Moonan.”

  • Answer: 20th Century


Slide26 l.jpg
Необходимость анализа предикатно-аргументной структуры

  • Q336: When was Microsoft established?

  • Difficult because Microsoft tends to establish lots of things…

  • Microsoft plans to establish manufacturing partnerships in Brazil and Mexico in May.

  • Need to be able to detect sentences in which `Microsoft’ is object of `establish’ or close synonym.

  • Matching sentence:

  • Microsoft Corp was founded in the US in 1975, incorporated in 1981, and established in the UK in 1982.


Slide27 l.jpg
Планирование стратегии поиска ответа

  • Question: What is the occupation of Bill Clinton’s wife?

    • No documents contain these keywords plus the answer

  • Strategy: decompose into two questions:

    • Who is Bill Clinton’s wife? = X

    • What is the occupation of X?


Slide28 l.jpg
Что еще необходимо? ответа

  • Taxonomy of question-answer types and type-specific constraints

    Q-Types:

  • Express relationships between events, entities and attributes

  • Influence Planner strategy

    A-Types

  • Express semantic type of valid answers


Slide29 l.jpg
Примеры ответа



Slide31 l.jpg
Пример ответа

  • Q: What year did the Titanic sink?

  • A: 1912

  • Supporting evidence:

  • It was the worst peacetime disaster involving a British ship since the Titanic sank on the 14th of April, 1912.

  • The Titanic sank after striking an iceberg in the North Atlantic on April 14th, 1912.

  • The Herald of Free Enterprise capsized off the Belgian port of Zeebrugge on March 6, 1987, in the worst peacetime disaster involving a British ship since the Titanic sank in 1912.


Slide32 l.jpg
Поиск ответа ответа

  • Different formats for answer candidates detected, normalized and combined:

    • `April 14th, 1912’

    • `14th of April, 1912’

  • Supporting evidence detected and combined:

    • `1912’ supports `April 14th, 1912’

  • Structure of date expressions understood and correct piece output:

    • `1912’ rather than `April 14th, 1912’

  • Most frequent answer candidate found and output:

    • `April 14th, 1912’ rather than something else.

  • It is a misconception the Titanic sank on April the 15th,1912 …


Slide33 l.jpg
Уровни сложности вопросов и ответов

SOPHISTICATION LEVELS OF QUESTIONERS

Level 1 Level 2 Level 3 Level 4

"Casual "Template "Cub "ProfessionalQuestioner" Questioner" Reporter" Information

Analyst"

COMPLEXITY OF QUESTIONS & ANSWERS RANGES:

FROM:TO:

Questions: Questions: Complex;

Simple Facts Uses Judgement Terms Knowledge of User Context Needed; Broad Scope

Answers: Simple Answers found in Answers: Search Multiple Sources (in multiple

Single Document Media/languages); Fusion of information; Resolution of conflicting data; Multiple Alternatives; Adding

Interpretation; Drawing Conclusions


Slide34 l.jpg
Уровень 1 ответов

  • Level 1“Casual Questioner”

  • Q: Why did Elian Gonzales leave the U.S.?

  • Focus: the departure of Elian Gonzales.


Slide35 l.jpg
Уровень 2 ответов

  • Level 2“Template Questioner”

  • Q: What was the position of the U.S. Government regarding the immigration of Elian Gonzales in the U.S.?

  • Focus: set of templates that are generated to extract information about (1) INS statements and actions regarding the immigration of Elian Gonzales; (2) the actions and statements of the Attorney General with respect to the immigration of Elian Gonzales; (3) actions and statements of other members of the administration regarding the immigration of Elian Gonzales; etc


Slide36 l.jpg
Уровень 3 ответов

  • Level 3“Cub reporter”

  • Q: How did Elian Gonzales come to be considered for immigration in the U.S.?—

  • translated into a set of simpler questions:

  • Q1: How did Elian Gonzales enter the U.S.?

  • Q2: What is the nationality of Elian Gonzales?

  • Q3: How old is Elian Gonzales?

  • Q4: What are the provisions in the Immigration Law for Cuban refugees?

  • Q5: Does Elian Gonzales have any immediate relatives?


Slide37 l.jpg
Уровень 3 ответов

  • Focus: composed of the question foci of all the simpler questions in which the original question is translated.

  • Focus Q1: the arrival of Elian Gonzales in the U.S.

  • Focus Q2: the nationality of Elian Gonzales.

  • Focus Q3: the age of Elian Gonzales.

  • Focus Q4: immigration law.

  • Focus Q5: immediate relatives of Elian Gonzales.


Slide38 l.jpg
Уровень 4 ответов

  • Level 4“Professional Information Analyst”

  • Q: What was the reaction of the Cuban community in the U.S. to the decision regarding Elian Gonzales?

  • Focus: every action and statement, present or future, taken by any American-Cuban, and especially by Cuban anti-Castro leaders, related to the presence and departure of Elian Gonzales from the U.S. Any action, statements or plans involving Elian’s Miami relatives or their lawyers.


Slide39 l.jpg
Система 09 ответов

  • Диалог оператора справочной системы 09 с пользователем, запрашивающим информацию – номер телефона референта, находящегося в базе оператора

  • Задача: по данным, предоставляемым пользователем, найти в базе референт и выдать нужную информацию


Slide40 l.jpg
Модель системы знаний оператора ответов

  • Фрейм знаний оператора о референте:

  • Номер слота

  • Имя слота (признак)

  • Пропозициональное заполнение слота (значение признака)


Slide41 l.jpg
Слоты фрейма ответов

  • Дескрипция референта (слоты 1-8)

  • 1. Гиперкатегоризатор (предприятие общественного питания, трест, объединение, институт)

  • 2. Категоризатор родовой (кафе, ресторан, чайхана, рюмочная)

  • 3. Категоризаторы видовые: 3.1., 3.2., etc


Slide42 l.jpg
Слоты фрейма ответов

  • 4. Идентификаторы

  • 4.1. Район

  • 4.2. Улица

  • 4.3. Номер дома

  • 4.4. etc


Slide43 l.jpg
Слоты фрейма ответов

  • 5. Идентификатор «номер»

  • 6. Идентификатор «имя»

  • 7. Детализатор

  • 7.1. (дефолт) справочная, секретарь

  • 7.2. Директор

  • 7.3. Отдел работы с клиентами

  • 7.4. Регистратура

  • 7.5. Учительская

  • 7.6. …


Slide44 l.jpg
Слоты фрейма ответов

  • 8. Номер телефона референта

  • 9. Характерная функция референта

  • 10. Прагматическая цель пользователя, достижение которой он связывает с данным референтом

  • 11. Прагматическая ситуация П, в которой у него возникает информационная потребность (№ телефона референта)


Slide45 l.jpg
Динамическая модель ответов

  • А-фрейм: фрейм знаний Оператора о референте (рабочий фрейм)

  • В-фрейм: Фрейм знаний Базы Данных о референте

  • Задача оператора: получить такое заполнение А-фрейма, чтобы отождествить его с соответствующим В-фреймом


Slide46 l.jpg
Примеры: гиперкатегоризатор ответов

  • П.: Будьте любезны, телефон Трансэлектромонтаж

  • О.: Что это такое?

  • П.: Это трест


Slide47 l.jpg
Примеры: гиперкатегоризатор ответов

  • П.: В Тушинском районе есть, кажется, Сходненская улица, дом 8, там предприятие 4, Теплоэнергии, а? Номер телефона.

  • О.: Что за предприятие 4 Теплоэнергии?

  • П.: Что за предприятие 4 Теплоэнергии? Как это понять?

  • О.: А что это такое? Что мне смотреть?


Slide48 l.jpg
Примеры: детализатор ответов

  • П.: Меня интересует номер телефона железнодорожной больницы, 3-я железнодорожная больница, Это на улице 3-я Часовая, дом 20.

  • О.: № телефона…

  • П.: Это что Вы мне дали?

  • О.: Справочную я Вам дала.

  • П.: Приемная Склифософского, будьте любезны

  • О.: Есть только регистратура, справочная, директор, главврач


Slide49 l.jpg
Примеры: соотношение фреймов ответов

  • П.: Алло! Детский сад 11/33 Перовского района.

  • О.: Это не детский сад, это ясли-сад.

  • П.: Девушка, мне нужна закусочная в Серебряном бору.

  • О.: У нас есть пельменная.

  • П.: Да-да.


Slide50 l.jpg
Примеры: дополнительная информация

  • П.: Скажите пожалуйста номер парикмахерской при Ханое.

  • О.: Парикмахерская? Какой адрес?

  • П.: Это где-то недалеко, это на Профсоюзной находится, недалеко метро Академическая.

  • Ну а какая там проходит улица?

  • П.: Будьте любезны, подскажите мне пожалуйста телефон мехового ателье, которое находится на Таганке.

  • О.: Это не Динамовская улица?

  • П.: Нет!

  • О.: Ульяновская?


ad