Navigable customizable tts for algebra
This presentation is the property of its rightful owner.
Sponsored Links
1 / 30

Navigable, Customizable TTS for Algebra PowerPoint PPT Presentation


  • 81 Views
  • Uploaded on
  • Presentation posted in: General

Navigable, Customizable TTS for Algebra. Lois Frankel Educational Testing Service (ETS) Neil Soiffer Design Science, Inc . CSUN March 1, 2013. Presentation Overview. Project Motivation, Goals, and Background Development to date: discussion and demonstration Research Studies Next Steps.

Download Presentation

Navigable, Customizable TTS for Algebra

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Navigable, Customizable TTS for Algebra

Lois Frankel

Educational Testing Service (ETS)

Neil Soiffer

Design Science, Inc.

CSUN

March 1, 2013


Presentation Overview

  • Project Motivation, Goals, and Background

  • Development to date: discussion and demonstration

  • Research Studies

  • Next Steps


Handouts are available at: www.atia.org/orlanohandouts

Project Motivation

  • Text-to-speech (TTS) vs. Math-to-speech

    • Limited choice of syntax/semantics

    • Limited screen-reader support

    • Limited or no within-expression navigation

    • Difficult to author

    • Works in limited environments

  • ETS Experience


Handouts are available at: www.atia.org/orlandohandouts

Project Goals

  • Focus on instruction, not assessment

  • High school algebra

  • Classroom-like synthesized speech “style”: ClearSpeak

  • Customization features

  • Interactive navigation

  • Author in Word

  • Playback in Word and IE


Handouts are available at: www.atia.org/orlandohandouts

Not Part of Project

  • Braille

  • Support for other formats

  • Authoring by people with visual impairment

  • Solving math problems

  • Tutoring/Curriculum

  • Integration with standardized testing


Handouts are available at: www.atia.org/orlandohandouts

Behind the Scene: MathML

  • The language of math on the web

    • HTML5, eBooks

    • Browser support & MathJax

  • Designed for Accessibility

    • Daisy players

    • IE + MathPlayer + AT


Handouts are available at: www.atia.org/orlandohandouts

What is MathML?

<math><mroot><mi>x</mi><mn>3</mn></mroot></math>


Project Software for Math

  • MathML Tools:

    • Authoring: MathType+Word

    • Audio rendering: MathPlayer

  • Screen reader

    • Window-Eyes (Word & IE)


Handouts are available at: www.atia.org/orlandohandouts

Many ways to Speak Math

  • How do you say…


Handouts are available at: www.atia.org/orlandohandouts

Many ways to Speak Math

  • How do you say…


Handouts are available at: www.atia.org/orlandohandouts

Many ways to Speak Math

  • How do you say…


Handouts are available at: www.atia.org/orlandohandouts

Many ways to Speak Math

  • How do you say…


Handouts are available at: www.atia.org/orlandohandouts

Many ways to Speak Math

  • How do you say…


Handouts are available at: www.atia.org/orlandohandouts

Many ways to Speak Math

  • How do you say…


Handouts are available at: www.atia.org/orlandohandouts

How Math Speech Works

  • Rules

  • Preferences

  • Exact Speech


Handouts are available at: www.atia.org/orlandohandouts

ClearSpeak

  • Many ways to speak math

  • ClearSpeak design philosophy

  • Other design philosophies

    • MathSpeak

    • SimpleSpeech


Handouts are available at: www.atia.org/orlandohandouts

Demonstration

  • Authoring

    • Using MathType in Word to enter math and use preferences

    • Entering exact speech in Word

  • Playback

    • Word with Window-Eyes


Handouts are available at: www.atia.org/orlandohandouts

Project Goals Recap

  • ClearSpeak

  • Author in Word

    • Allow setting preference and exact speech

  • Playback in Word and IE

  • Interactive navigation


Creating Expressions and Questions for Studies

  • Level

  • Degree of complexity

  • Relevance of speech variations

  • Provide useful data

    • Test comprehension, not computation

    • Guide decisions about speech rules, preferences


Handous are available at: www.atia.org/orlandohandouts

Feedback Study #1

  • Compared ClearSpeak, MathSpeak, SimpleSpeech

  • Fractions, exponents, parentheses

  • Focus: was expression understood?

  • Research/Statistical consultation

  • 16 HS students: blind or low vision


Handouts are available at: www.atia.org/orlandohandouts

Results Summary

  • ClearSpeak more understandable than Simple Speech or MathSpeak

  • Students overall preferred ClearSpeak

  • Students got more answers correct with ClearSpeak than with Simple Speech or MathSpeak


Handouts are available at: www.atia.org/orlandohandouts

One Expression’s Results


Familiarity and Understanding


Handouts are available at: www.atia.org/orlandohandouts

Feedback Study #2

  • Can Prosody help understanding?

    • Pauses

    • Pitch

    • Rate Changes

    • Volume Changes

  • Rejected pitch and volume changes

  • non-speech sounds not an option

  • Focus on pauses, rate-change vs. start/end


Handouts are available at: www.atia.org/orlandohandouts

Feedback #2 Example

vs.

  • With Pauses / rate change

    • Expression 1

    • Expression 2

  • With “end root”

    • Expression 1

    • Expression 2


Handouts are available at: www.atia.org/orlandohandouts

Feedback #2 Another Example

Nested Parentheses:

  • Uniform Pauses

  • Non-uniform pauses

  • Non-uniform pauses and “First Paren”


Handouts are available at: www.atia.org/orlandohandouts

Navigation

  • Simple char by char mode for beginners

  • Powerful navigation features for experts

    • Read

    • Describe

  • Multiple ways of moving

    • Tree

    • Character, Placemarker, Semantic

  • After tree move: read or describe

  • 10 Placemarkers, 2 Cursors, Where am I?


Handouts are available at: www.atia.org/orlandohandouts

Participation Opportunities

  • Blind or Visually Impaired Students

  • Teachers


Handouts are available at: www.atia.org/orlandohandouts

Contact Information

  • Lois Frankel: [email protected]

  • Neil Soiffer: [email protected]

  • Beth Brownstein: [email protected]

  • MathPlayer: http://www.dessci.com/en/products/mathplayer/

    The research reported here was supported by the Institute of Education Sciences, U.S. Department of Education, through Grant R324A110355 to the Educational Testing Service. The opinions expressed are those of the authors and do not represent views of the Institute or the U.S. Department of Education.


Handouts are available at: www.atia.org/orlandohandouts

Thank you for attending this session


  • Login