tts evaluation
Download
Skip this Video
Download Presentation
TTS Evaluation

Loading in 2 Seconds...

play fullscreen
1 / 4

TTS Evaluation - PowerPoint PPT Presentation


  • 115 Views
  • Uploaded on

TTS Evaluation. Julia Hirschberg CS 4706. TTS Evaluation. Intelligibility Tests Mean Opinion Scores Preference Tests. 7/15/2014. Speech and Language Processing Jurafsky and Martin. 2. Intelligibility Tests. Diagnostic Rhyme Test (DRT) Listening test

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' TTS Evaluation' - royce


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
tts evaluation

TTS Evaluation

Julia Hirschberg

CS 4706

tts evaluation1
TTS Evaluation

Intelligibility Tests

Mean Opinion Scores

Preference Tests

7/15/2014

Speech and Language Processing Jurafsky and Martin

2

intelligibility tests
Intelligibility Tests
  • Diagnostic Rhyme Test (DRT)
    • Listening test
    • Listeners choose between two words differing by a single phonetic feature (voicing, nasality, sustenation, sibilation)
    • DRT: 96 rhyming pairs
      • Dense/tense, bond/pond, …
        • Subject hears dense, chooses either dense or tense
        • % of correct answers is intelligibility score
    • Problem: Only tests single word synthesis
slide4
Modified DRT:
    • 300 words, 50 sets of 6 words (went, sent, bent, tent, dent, rent)
    • Embedded in carrier phrases:
      • Now we will say dense again
  • Mean Opinion Score
    • Have listeners rate output on a scale from 1 (bad) to 5 (excellent)
  • Preference tests:
    • Reading addresses out loud, reading news text, using two different systems or systems against human voice
    • Do a preference test (prefer A, prefer B)
ad