Navigable customizable tts for algebra
This presentation is the property of its rightful owner.
Sponsored Links
1 / 30

Navigable, Customizable TTS for Algebra PowerPoint PPT Presentation


  • 79 Views
  • Uploaded on
  • Presentation posted in: General

Navigable, Customizable TTS for Algebra. Lois Frankel Educational Testing Service (ETS) Neil Soiffer Design Science, Inc . CSUN March 1, 2013. Presentation Overview. Project Motivation, Goals, and Background Development to date: discussion and demonstration Research Studies Next Steps.

Download Presentation

Navigable, Customizable TTS for Algebra

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Navigable customizable tts for algebra

Navigable, Customizable TTS for Algebra

Lois Frankel

Educational Testing Service (ETS)

Neil Soiffer

Design Science, Inc.

CSUN

March 1, 2013


Presentation overview

Presentation Overview

  • Project Motivation, Goals, and Background

  • Development to date: discussion and demonstration

  • Research Studies

  • Next Steps


Project motivation

Handouts are available at: www.atia.org/orlanohandouts

Project Motivation

  • Text-to-speech (TTS) vs. Math-to-speech

    • Limited choice of syntax/semantics

    • Limited screen-reader support

    • Limited or no within-expression navigation

    • Difficult to author

    • Works in limited environments

  • ETS Experience


Project goals

Handouts are available at: www.atia.org/orlandohandouts

Project Goals

  • Focus on instruction, not assessment

  • High school algebra

  • Classroom-like synthesized speech “style”: ClearSpeak

  • Customization features

  • Interactive navigation

  • Author in Word

  • Playback in Word and IE


Not part of project

Handouts are available at: www.atia.org/orlandohandouts

Not Part of Project

  • Braille

  • Support for other formats

  • Authoring by people with visual impairment

  • Solving math problems

  • Tutoring/Curriculum

  • Integration with standardized testing


Behind the scene mathml

Handouts are available at: www.atia.org/orlandohandouts

Behind the Scene: MathML

  • The language of math on the web

    • HTML5, eBooks

    • Browser support & MathJax

  • Designed for Accessibility

    • Daisy players

    • IE + MathPlayer + AT


What is mathml

Handouts are available at: www.atia.org/orlandohandouts

What is MathML?

<math><mroot><mi>x</mi><mn>3</mn></mroot></math>


Project software for math

Project Software for Math

  • MathML Tools:

    • Authoring: MathType+Word

    • Audio rendering: MathPlayer

  • Screen reader

    • Window-Eyes (Word & IE)


Many ways to speak math

Handouts are available at: www.atia.org/orlandohandouts

Many ways to Speak Math

  • How do you say…


Many ways to speak math1

Handouts are available at: www.atia.org/orlandohandouts

Many ways to Speak Math

  • How do you say…


Many ways to speak math2

Handouts are available at: www.atia.org/orlandohandouts

Many ways to Speak Math

  • How do you say…


Many ways to speak math3

Handouts are available at: www.atia.org/orlandohandouts

Many ways to Speak Math

  • How do you say…


Many ways to speak math4

Handouts are available at: www.atia.org/orlandohandouts

Many ways to Speak Math

  • How do you say…


Many ways to speak math5

Handouts are available at: www.atia.org/orlandohandouts

Many ways to Speak Math

  • How do you say…


How math speech works

Handouts are available at: www.atia.org/orlandohandouts

How Math Speech Works

  • Rules

  • Preferences

  • Exact Speech


Clearspeak

Handouts are available at: www.atia.org/orlandohandouts

ClearSpeak

  • Many ways to speak math

  • ClearSpeak design philosophy

  • Other design philosophies

    • MathSpeak

    • SimpleSpeech


Demonstration

Handouts are available at: www.atia.org/orlandohandouts

Demonstration

  • Authoring

    • Using MathType in Word to enter math and use preferences

    • Entering exact speech in Word

  • Playback

    • Word with Window-Eyes


Project goals recap

Handouts are available at: www.atia.org/orlandohandouts

Project Goals Recap

  • ClearSpeak

  • Author in Word

    • Allow setting preference and exact speech

  • Playback in Word and IE

  • Interactive navigation


Creating expressions and questions for studies

Creating Expressions and Questions for Studies

  • Level

  • Degree of complexity

  • Relevance of speech variations

  • Provide useful data

    • Test comprehension, not computation

    • Guide decisions about speech rules, preferences


Feedback study 1

Handous are available at: www.atia.org/orlandohandouts

Feedback Study #1

  • Compared ClearSpeak, MathSpeak, SimpleSpeech

  • Fractions, exponents, parentheses

  • Focus: was expression understood?

  • Research/Statistical consultation

  • 16 HS students: blind or low vision


Results summary

Handouts are available at: www.atia.org/orlandohandouts

Results Summary

  • ClearSpeak more understandable than Simple Speech or MathSpeak

  • Students overall preferred ClearSpeak

  • Students got more answers correct with ClearSpeak than with Simple Speech or MathSpeak


One expression s results

Handouts are available at: www.atia.org/orlandohandouts

One Expression’s Results


Navigable customizable tts for algebra

Familiarity and Understanding


Feedback study 2

Handouts are available at: www.atia.org/orlandohandouts

Feedback Study #2

  • Can Prosody help understanding?

    • Pauses

    • Pitch

    • Rate Changes

    • Volume Changes

  • Rejected pitch and volume changes

  • non-speech sounds not an option

  • Focus on pauses, rate-change vs. start/end


Feedback 2 example

Handouts are available at: www.atia.org/orlandohandouts

Feedback #2 Example

vs.

  • With Pauses / rate change

    • Expression 1

    • Expression 2

  • With “end root”

    • Expression 1

    • Expression 2


Feedback 2 another example

Handouts are available at: www.atia.org/orlandohandouts

Feedback #2 Another Example

Nested Parentheses:

  • Uniform Pauses

  • Non-uniform pauses

  • Non-uniform pauses and “First Paren”


Navigation

Handouts are available at: www.atia.org/orlandohandouts

Navigation

  • Simple char by char mode for beginners

  • Powerful navigation features for experts

    • Read

    • Describe

  • Multiple ways of moving

    • Tree

    • Character, Placemarker, Semantic

  • After tree move: read or describe

  • 10 Placemarkers, 2 Cursors, Where am I?


Participation opportunities

Handouts are available at: www.atia.org/orlandohandouts

Participation Opportunities

  • Blind or Visually Impaired Students

  • Teachers


Contact information

Handouts are available at: www.atia.org/orlandohandouts

Contact Information

  • Lois Frankel: [email protected]

  • Neil Soiffer: [email protected]

  • Beth Brownstein: [email protected]

  • MathPlayer: http://www.dessci.com/en/products/mathplayer/

    The research reported here was supported by the Institute of Education Sciences, U.S. Department of Education, through Grant R324A110355 to the Educational Testing Service. The opinions expressed are those of the authors and do not represent views of the Institute or the U.S. Department of Education.


Thank you for attending this session

Handouts are available at: www.atia.org/orlandohandouts

Thank you for attending this session


  • Login