slide1 n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
Speech Data Corpus for Verbal Intelligence Estimation PowerPoint Presentation
Download Presentation
Speech Data Corpus for Verbal Intelligence Estimation

Loading in 2 Seconds...

play fullscreen
1 / 18

Speech Data Corpus for Verbal Intelligence Estimation - PowerPoint PPT Presentation


  • 92 Views
  • Uploaded on

Speech Data Corpus for Verbal Intelligence Estimation. Kseniya Zablotskaya , Steffen Walter, Wolfgang Minker. Outline. Introduction Improvement of Spoken Language Dialogue Systems Verbal Intelligence Estimation Monologues Collection Hamburg Wechsler Intelligence Test

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Speech Data Corpus for Verbal Intelligence Estimation' - neve-robbins


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
slide1
Speech Data Corpus

for Verbal Intelligence Estimation

KseniyaZablotskaya, Steffen Walter, Wolfgang Minker

outline
Outline

Introduction

Improvement of Spoken Language Dialogue Systems

Verbal Intelligence Estimation

Monologues Collection

Hamburg Wechsler Intelligence Test

Dialogues Collection

Transcription Standards

Result Table for Each Candidate

Participants

Conclusions and Future Work

introduction
Introduction

Different ways to describe the same event:

- “Excuse me, could you tell me the way to the railway station?”

- “Hey you, show me where the railway station is.”

What our words can say about us:

Emotion

Gender

Age

Analysis of speech

Social class

Personality

Verbal Intelligence

improvement of spoken language dialogue systems
Improvement ofSpoken Language Dialogue Systems

- estimation of cognitive processes of the user

- adaptation to the user

Cognitive processes

of the user

Spoken language dialogue system

Acoustic front-end

Speech recognition

Linguistic

analysis

Dialogue

management

Application

Speech synthesis

Text generation

Adaptation to the user

verbal intelligence estimation
Verbal Intelligence Estimation

Dialogues

Monologues

VI=120

VI=120

VI=120

VI=80

VI=105

VI=120

VI=105

VI=80

Transcribed

speech

VIMod

Feature

extraction

Model /

Classifier

%

Evaluation

VI-test

VI

monologues collection
Monologues Collection

Two short films (Galileo):

Craziest hotels in the world:

necessary to memorize the names

necessary to memorize the order

Experiment on how long people could stay awake

possible to describe the film without certain details

descriptions are informative

dialogues collection
Dialogues Collection

Duration: at least 10 minutes

Topic: the education and the school system in Germany

- interesting

- participants know a lot about it

- participants have different opinions

Dialogues

Answering Questions

Discussions

Contra-Discussions

hamburg wechsler intelligence test
Hamburg Wechsler Intelligence Test

Information (25 questions)

measures general knowledge

questions from a particular culture

For example:

Who is president of Russia?

hamburg wechsler intelligence test1
Hamburg Wechsler Intelligence Test

Comprehension (10 questions)

social awareness

common-sense

For example:

What would you do if you lost

your way in a forest?

hamburg wechsler intelligence test2
Hamburg Wechsler Intelligence Test

Digital Span

forward

backward

auditory short memory

concentration

attention

For example:

Please listen to the fallowing

digits and repeat them:

5 7 2 4 6

hamburg wechsler intelligence test3
Hamburg Wechsler Intelligence Test

Arithmetic (10 questions)

mental alertness

attention and concentration while manipulation mental mathematical problems

For example:

Seven envelopes cost twenty five cents.

How many envelopes can you buy if you have one dollar?

hamburg wechsler intelligence test4
Hamburg Wechsler Intelligence Test

Similarities in Dissimilar Objects (12 questions)

abstract reasoning

power of conceptualization

For example:

Please find a similarity among

a dog and a lion?

hamburg wechsler intelligence test5
Hamburg Wechsler Intelligence Test

Vocabulary (42 questions)

comprehension of meanings

relation between the expressive words

For example:

What does the word “zebra” mean?

transcription standards
Transcription Standards

“?” – interrogative word intonation and rising tone

“.” – completed thoughts and falling tone

“,” – short pauses in the speech, but with a continuation of the main idea

“;” – interrupted thoughts

Example: “no no. or yes? you say; understand,”

All monologues and dialogues were transcribed according

to the standards by Mergenthaler.

The punctuation marks in transcripts are used to show rhythmical and syntactical speech interruptions:

result table for each candidate
Result Table for Each Candidate

- candidate’s points for each verbal task and the verbal IQ.

- verbal IQ is measured according to the special tables of the HAWIE.

participants
Participants

56 candidates: men - 27, women - 29

Age: 16 – 75

Language: German

71 monologues (3 hours 30 minutes)

30 dialogues (6 hours 30 minutes)

conclusions and future directions
Conclusions and future directions
  • Speech data corpus:
  • - 56 candidates;
  • - 10 hours of audio data;
  • Approaches which can be applied to the collected data:
  • - Word usage, abstracts, emotion words;
  • - Analysis at different linguistic levels: morphology, lexicology, syntax, semantics, and discourse;
  • - Linguistic styles;
  • - Content words;
  • - Degree of speakers’ immersion in monologues and dialogues;
  • - “Good story” criteria;
  • - Status in a conversation;
  • - Levels of agreement;
  • Kelly’s repertory grids;
  • We are going to find more candidates and to continue these recordings.