Prosodic measurements and question types in the Spontal corpus of Swedish dialogues - PowerPoint PPT Presentation

bryce
sofia str mbergsson jens edlund david house kth speech music and hearing stockholm sweden n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
Prosodic measurements and question types in the Spontal corpus of Swedish dialogues PowerPoint Presentation
Download Presentation
Prosodic measurements and question types in the Spontal corpus of Swedish dialogues

Loading in 2 Seconds...

play fullscreen
1 / 19
Download Presentation
Prosodic measurements and question types in the Spontal corpus of Swedish dialogues
141 Views
Download Presentation

Prosodic measurements and question types in the Spontal corpus of Swedish dialogues

- - - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript

  1. Sofia Strömbergsson, Jens Edlund & David House KTH Speech, Music and Hearing Stockholm, Sweden Prosodic measurements and question types in the Spontal corpus of Swedish dialogues

  2. VariQ Investigate and describe intonational variation in questions in spontaneousdialogue. Is there a standard typeofquestion intonation?

  3. Question intonation • Declarative => Interrogative ”You like apples.” vs. ”You like apples?” • Different questiontypes, different intonation Y/N questions: Wh-questions: • Where is the rise in conversationalspeech?

  4. Spontal corpus • 60 hoursofdialogue / 120 half-hour sessions • Talk freelyaboutanything

  5. Questionextraction • 24 dialoguesubset (= 12 hours) • Talkspurts based on voice-activity/silence • Orthographictranscriptions • Twoannotators tag ”questions” 908 talkspurts withquestion tag 600selected (Spontal balance, 2+ annotatorsagreeing)

  6. Questionmarkup • Q1: [Y/N] [Wh] [Alt’s] [Other] • Q2: [Required] [Optional] [Prohibited] • Q3: [Forward] [Backward] • Q4: [Reported] [Direct] Ser du attdetärhålibotten? Do you see there’s a hole in the bottom?

  7. Questiontypes • Q1: • Q2: • Q3: • Q4: Y/N > Wh >> Alt’s & Other Required >> Optional > Prohibited Forward >> Backward Direct >> Reported

  8. Prosodicmeasures TIME Duration Speech rate PITCH Variation Rising/Falling intonation DIFF: (Avg pitch)2ndHalf - (Avg pitch)1stHalf

  9. Duration Is that Obama or Romney? • Significantdifferencesbetween (almost) all Q1 categories Is that Obama? Who’sthat? • Forward-directedquestionslonger

  10. Speech rate • Otherareslower Is thattrue?! Didyou?! Oh yeah…? • Optionalareslower • Backwardareslower

  11. Pitch variation • Morevaried pitch in questionstowhichanswersareOptional Is thattrue?! Didyou?! • Morevaried pitch in Backward-directedquestions • Reflectingattitude?

  12. Rising/Falling intonation • Y/Nfalling, Whrising (or flat) • Forwardfalling, Backwardrising (or flat) – butlarge variation

  13. Rising/Falling intonation (cont.) Jaha? Oh yeah? Tycker du inte? Don’t you think? Ärdetsant? Is that true? Vadsa du? What’d you say? Rising intonation signalling non-understanding/non-acceptance?

  14. Conclusions • Strengthsofcodingscheme: • General • Quick-and-easy • Orthogonal, allowsclusteringacross different dimensions • Interplayacross different dimensions Optional + Backward Other + Optional + Backward More pitch variation Slower Attitude? Uncertainty? Non-agreement?

  15. Thankyou for your attention!

  16. Questionmarkup • Q1: [Y/N] [Wh] [Alt’s] [Other] • Q2: [Required] [Optional] [Prohibited] • Q3: [Forward] [Backward] • Q4: [Reported] [Direct] Vadbetyderdet? What does that mean?

  17. Rising/Falling intonation (cont.) • DIFF: Y/N falling, Wh rising; Backwardrising But… confusionwithsentence focus? • PROS: No significantdependencies…

  18. Summary: Prosodicmeasures • Duration: Dependent on numberofalt’s • Speech rate: Slowreflectinguncertainty? • Pitch variation: Reflectingattitude? • Rising/Falling intonation: • DIFF: Dependent on sentence focus? • PROS: Not dependent on questiontype