the entertainment industry meets simulation the challenge of the holodeck
Download
Skip this Video
Download Presentation
The Entertainment Industry Meets Simulation: The Challenge of the Holodeck

Loading in 2 Seconds...

play fullscreen
1 / 23

brief - PowerPoint PPT Presentation


  • 371 Views
  • Uploaded on

The Entertainment Industry Meets Simulation: The Challenge of the Holodeck. Bill Swartout Institute for Creative Technologies University of Southern California. The ICT is intended to serve as a nexus between the simulation and entertainment communities. Institute For Creative Technologies.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'brief' - paul2


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
the entertainment industry meets simulation the challenge of the holodeck

The Entertainment Industry Meets Simulation:The Challenge of the Holodeck

Bill Swartout

Institute for Creative TechnologiesUniversity of Southern California

slide2
The ICT is intended to serve as a nexus between the simulation and entertainment communities
how can we best simulate reality
How can we best simulate reality?
  • Two approaches
    • Military simulation
    • Entertainment industry
simulating reality two approaches
Simulating Reality:Two Approaches

Military Simulation

  • Literal: try to include as much reality in simulation as possible
  • Homogeneous

Entertainment Industry

  • Goal-directed: create effect of real experience by selectively focusing on elements (real and unreal)
  • Hybrid Approach: combine disparate elements
new research areas
New Research Areas
  • Speech Recognition
  • Natural Language Understanding
  • Dialogue Management
  • Natural Language Generation
  • Speech Synthesis
  • Gesture Generation
  • Perception
  • Personality Variation
  • Sound Spatialization
  • Interactive Story Structure
slide13

Integration Raises New Challenges: Natural LanguageProject Leaders: Ed Hovy (ISI), Kevin Knight (ISI), David Traum (ISI), Shri Narayanan (IMSC)

  • Speech recognition: Noisy environment
  • Multimodal: Face To Face (speech+gesture), Radio
  • Multiple Interactors (Sgt, medic, squads,…)
    • Messages tailored for multiple addressees/overhearers
  • Emotion
challenge speech synthesis project leaders lewis johnson isi shri narayanan imsc

“Squad Leaders listen up!”

Challenge: Speech SynthesisProject Leaders: Lewis Johnson (ISI), Shri Narayanan (IMSC)
  • Most speech synthesis sounds unnatural
  • Even the best have limited expression (AT&T NextGen)
    • No command voice
  • Use hybrid approach:
    • Multiple synthesizers withdifferent “voices”
    • Command voice

Text toSpeechSynthesis

  • Use pre-recorded library for highly emotional speech
challenge modeling emotions project leaders jon gratch ict stacy marsella isi1
Challenge: Modeling EmotionsProject Leaders: Jon Gratch (ICT), Stacy Marsella (ISI)

Movie clip

challenge modeling emotions project leaders jon gratch ict stacy marsella isi2
Challenge: Modeling EmotionsProject Leaders: Jon Gratch (ICT), Stacy Marsella (ISI)
  • Problem addressed:
    • Virtual humans need emotions to be believable & realistic
  • Approach:
    • Characters have beliefs, goals, utilities
    • Construct plans
    • Events evaluated against plans
    • If goals thwarted (or enabled) characters react
modeling emotions issues
Modeling Emotions: Issues
  • Integrating gesture, natural language & voice to project realistic behavior
      • Managing unintended interpretations
  • Hollywood vs. Psychology
      • Movie emotions quite different from natural emotions
  • Recognizing human emotions
challenge story is critical
Challenge:Story is Critical
  • More than an event list
  • Successful stories:
    • Juxtapose contrasting elements
    • Surprise (plot twists)
    • Dilemmas
    • Things go wrong
    • Build to climax (and ebb)
structuring stories for intelligent agents issues
Structuring Stories for Intelligent Agents: Issues
  • Traditional story telling tricks require linear structure
  • Immersed participant needs freewill
  • Need “bumpers”
    • Possibility: director agent controls environment & characters to limit choice
reasons for optimism
Reasons for Optimism
  • Hybrid approach
    • Use all the tools in the toolbox
  • Entertainment industry as source of knowledge and techniques
  • Story context constrains possibilities
  • Synergy from graphics, sound & emotional engagement
    • The mind is a willing collaborator
ad