Sofia str mbergsson jens edlund david house kth speech music and hearing stockholm sweden
This presentation is the property of its rightful owner.
Sponsored Links
1 / 19

Prosodic measurements and question types in the Spontal corpus of Swedish dialogues PowerPoint PPT Presentation


  • 87 Views
  • Uploaded on
  • Presentation posted in: General

Sofia Strömbergsson, Jens Edlund & David House KTH Speech , Music and Hearing Stockholm, Sweden. Prosodic measurements and question types in the Spontal corpus of Swedish dialogues. VariQ. Investigate and describe intonational variation in questions in spontaneous dialogue .

Download Presentation

Prosodic measurements and question types in the Spontal corpus of Swedish dialogues

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Sofia str mbergsson jens edlund david house kth speech music and hearing stockholm sweden

Sofia Strömbergsson, Jens Edlund & David House

KTH Speech, Music and Hearing

Stockholm, Sweden

Prosodic measurements and question types in the Spontal corpus of Swedish dialogues


Variq

VariQ

Investigate and describe intonational variation in questions in spontaneousdialogue.

Is there a standard typeofquestion intonation?


Question intonation

Question intonation

  • Declarative => Interrogative

    ”You like apples.” vs. ”You like apples?”

  • Different questiontypes, different intonation

    Y/N questions: Wh-questions:

  • Where is the rise in conversationalspeech?


Spontal corpus

Spontal corpus

  • 60 hoursofdialogue / 120 half-hour sessions

  • Talk freelyaboutanything


Question extraction

Questionextraction

  • 24 dialoguesubset (= 12 hours)

  • Talkspurts based on voice-activity/silence

  • Orthographictranscriptions

  • Twoannotators tag ”questions”

    908 talkspurts withquestion tag

    600selected

    (Spontal balance, 2+ annotatorsagreeing)


Question markup

Questionmarkup

  • Q1: [Y/N] [Wh] [Alt’s] [Other]

  • Q2: [Required] [Optional] [Prohibited]

  • Q3: [Forward] [Backward]

  • Q4: [Reported] [Direct]

Ser du attdetärhålibotten?

Do you see there’s a hole in the bottom?


Question types

Questiontypes

  • Q1:

  • Q2:

  • Q3:

  • Q4:

Y/N > Wh >> Alt’s & Other

Required >> Optional > Prohibited

Forward >> Backward

Direct >> Reported


Prosodic measures

Prosodicmeasures

TIME

Duration

Speech rate

PITCH

Variation

Rising/Falling intonation

DIFF: (Avg pitch)2ndHalf - (Avg pitch)1stHalf


Duration

Duration

Is that Obama or Romney?

  • Significantdifferencesbetween (almost) all Q1 categories

Is that Obama?

Who’sthat?

  • Forward-directedquestionslonger


Speech rate

Speech rate

  • Otherareslower

Is thattrue?!

Didyou?!

Oh yeah…?

  • Optionalareslower

  • Backwardareslower


Pitch variation

Pitch variation

  • Morevaried pitch in questionstowhichanswersareOptional

Is thattrue?!

Didyou?!

  • Morevaried pitch in Backward-directedquestions

  • Reflectingattitude?


Rising falling intonation

Rising/Falling intonation

  • Y/Nfalling, Whrising (or flat)

  • Forwardfalling, Backwardrising (or flat) – butlarge variation


Rising f alling intonation cont

Rising/Falling intonation (cont.)

Jaha?

Oh yeah?

Tycker du inte?

Don’t you think?

Ärdetsant?

Is that true?

Vadsa du?

What’d you say?

Rising intonation signalling

non-understanding/non-acceptance?


Conclusions

Conclusions

  • Strengthsofcodingscheme:

    • General

    • Quick-and-easy

    • Orthogonal, allowsclusteringacross different dimensions

  • Interplayacross different dimensions

Optional + Backward

Other + Optional + Backward

More pitch variation

Slower

Attitude?

Uncertainty?

Non-agreement?


Thank you for your attention

Thankyou for your attention!


Question markup1

Questionmarkup

  • Q1: [Y/N] [Wh] [Alt’s] [Other]

  • Q2: [Required] [Optional] [Prohibited]

  • Q3: [Forward] [Backward]

  • Q4: [Reported] [Direct]

Vadbetyderdet?

What does that mean?


Rising falling intonation cont

Rising/Falling intonation (cont.)

  • DIFF: Y/N falling, Wh rising; Backwardrising

    But… confusionwithsentence focus?

  • PROS: No significantdependencies…


Summary prosodic measures

Summary: Prosodicmeasures

  • Duration: Dependent on numberofalt’s

  • Speech rate: Slowreflectinguncertainty?

  • Pitch variation: Reflectingattitude?

  • Rising/Falling intonation:

    • DIFF: Dependent on sentence focus?

    • PROS: Not dependent on questiontype


  • Login