Simcoach authoring
This presentation is the property of its rightful owner.
Sponsored Links
1 / 15

SimCoach – Authoring PowerPoint PPT Presentation


  • 120 Views
  • Uploaded on
  • Presentation posted in: General

SimCoach – Authoring. Eric Forbell , Nicolai Kalisch, Kelly Christoffersen , Glenn Storm, Kevin Feeley , Fabrizio Morbini. USC Institute for Creative Technologies. 2. SimCoach as a Platform.

Download Presentation

SimCoach – Authoring

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Simcoach authoring

SimCoach– Authoring

Eric Forbell, Nicolai Kalisch, Kelly Christoffersen,

Glenn Storm, Kevin Feeley, Fabrizio Morbini

USC Institute for Creative Technologies

2


Simcoach authoring

SimCoach as a Platform

  • SimCoach is a technology platform thatenables rapidly developed virtual humans hosted in a web environment

    • Enables more ubiquitous and scalable virtual humans and content

    • Builds upon maturing virtual human technologies

    • Built upon open web standards, promoting adoption

    • Supports true conversational agents that take initiative

      • Suitable for a variety of complex domains

    • Enables interactivity with a vast set of existing and future web resources

      • Direct embedding of YouTube, Web articles, Website links, other online media


Simcoach authoring

Building authorable virtual humans

  • Challenges

  • Virtual Humans have complex data-driven components

  • Tools are typically not unified and unwieldy for non-technical authors

  • Balance between simplicity and expressivity

  • Different applications impose different requirements

    • Training is more focused, but requires assessment

    • Support systems like SimCoach face more uncertainty with users

Agent

Natural

Language

Understanding

Nonverbal

Behavior

Generation

Natural

Language

Generation

Multimodal

Perception &

Understanding

Speech

Recognition

Animation

Speech

Generation

Renderer

Human User

Framework


Simcoach authoring

SimCoach Authoring Approach

  • Preliminary Goals

  • Build a unified tool to create complete virtual characters

  • Author, test and iterate – all in the same environment

  • Minimize barriers for getting started

    • Tool is fully web-based, nothing to install or configure

  • Use available technologies, invent only when necessary

  • Empower the author, restrict only when necessary

  • Construct a solid architectural foundation to support domain-specific authoring applications


Simcoach architecture what needs authoring

SimCoach Architecture – What needs authoring?

Dialogue

policy

Dialogue Management

Information

state

Utterances

Speech

Audio

Action

Realization

Resources

Speech

Analysis

Non-verbal

Behavior

generation

Classifier

model

Textual

Language

Understanding

Multimedia

Resources

Animation

Video

Animation

Fusion

Speech

Audio

Animation

Library

3D Character

Web client

Human User

Behavior

Rules

Framework


Simcoach authoring tools

SimCoach Authoring Tools

Early design iterations


Authoring process

Authoring Process

  • Create project

    • Select 3D character model from library

  • Build interaction logic

    • Compose interaction through sub-dialogue scripts activated by state variables and user actions

Question.what-is-PTSD

question.confidentiality

consentToPTSDQuestionnaire == true

  • Train language understanding

    • For all specified user dialogue actions, provide exemplar text and variants

  • Refine character actions

    • Edit character utterances

    • Import speech audio, render animations


Automated character animation workflow

Automated Character Animation Workflow

FaceFX

Enabling technology for web-hosted characters

NVBG

Smartbody

Maya

encoder

Can parallelize here!

Maya

Maya

Maya

Maya

Maya


Tools demo

TOOLS DEMO

PRE-ALPHA TECH PREVIEW


Future work

Future Work

  • Build tutorials and in-tool support for new authors

  • Improve overall usability

    • Some changes may be very invasive, but necessary

  • Simplify creation of common dialogue behaviors

    • Introduce behavior templates

  • Improve author control and preview of nonverbal behavior

    • In process on DCAPS

  • Enhance testing framework to help debug

  • Provide support for other simulation environments

    • Standalone, non-web simulations


Tools demo1

TOOLS DEMO

PRE-ALPHA TECH PREVIEW


  • Login