Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.
Slovak synthesis speech quality evaluation Redžúr [r E dZ u: r] 2008 • Jakub Mareček
Testing methods • Subjective test - respondents listen on web application http://www.ktl.elf.stuba.sk/projects/speech/quality_test to speech synthesis samples and evaluate them in these types of tests: • MOS - how listeners perceive tested material on available scale (comprehension, speech tempo, articulation etc.) • MRT - (modified rhyme test) testing comprehension of material based on monosyllabic consonant-vowel-consonant words • Objective test - PESQ – prediction of the perceived quality that would be given to degraded signal by subject in subjective listening test. Primary developed for VOIP (ITU-T P862). • Scale from -0.5 (worst) to 4.5 (best).
Conclusion • Subjective methods are most important for overall evaluation of artificial speech. • New types of subjective tests (MRT, SUS) derived from other languages (German, English etc.) • Web application as best solution for subjective quality evaluation. Feel free to visit http://www.ktl.elf.stuba.sk/projects/speech/quality_test/. • Objective methods like PESQ has still weak correlation with subjective tests.