1 / 8

Sign Language Synthesis and Animation Project Overview

This project focuses on improving realism in sign language synthesis, optimizing visual appearance, enhancing movement dynamics, and integrating facial expressions for authentic signing animations.

benedict-griffin
Download Presentation

Sign Language Synthesis and Animation Project Overview

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. WP3: Synthesis and Animation John Glauert • Background • Interaction with other WPs • Organisation of Work • Resources Available • Resources Needed • Coordination Strategy • Cooperation with Partners

  2. Background • Several leading systems developed by partners • Late stage of synthesis pipeline • Aim for Authentic or Realistic natural signing • Core support for HamNoSys attributes • Respond to enhanced linguistic modelling work • Improve realism of signing

  3. Interaction with other WPs • WP1, WP2: Reference Animation • Assumes link between elements used in recognition and synthesis • WP4: Reflect Linguistic Model • Important interface • How much of the linguistic structure is required for good synthesis? • WP5: Provide animation of annotations • Precise notation supports faithful playback • WP7: Supports Applications • WP8: Via WP 7 • WP9, WP10

  4. Organisation of Work • Improve realism of signing • Optimise acceptability of visual appearance • Improve dynamics of movement maybe by sampling • Improve repertoire and appearance of facial NMFs • Improve integration of face and body NMFs with manual • Include ambient motion • Produce Open Architecture • Flexible representation of Tiers • Flexible synchronisation model • Variety of sources: synthesis, mocap, rotoscope • Represented via Enhanced HamNoSys/SiGML • Cross-Platform support

  5. Resources Available • Sufficient avatar technology is available • Avatar animation systems from Partners

  6. Resources Needed • Better Definition and Tutorial for HamNoSys 4 • Beneficial to build links with outside projects • VCom3D as Supporter • ... • Early examples of Annotation framework

  7. Coordination Strategy • Early phase of understanding partner systems • Exchange of Technology • Identification of Common Properties • Identification of Variety to Support • Distribution of Partner Systems • SiGML animation system widely available • Early support for annotation tools • Other systems on demand • Frequent but Controlled release of Prototypes

  8. Cooperation with Partners • Detailed Technical Survey of existing systems • Comparative Evaluation of systems • Proposals for interworking of systems • Experiments on interworking

More Related