Immersive virtual characters for educating medical communication skills
This presentation is the property of its rightful owner.
Sponsored Links
1 / 13

Immersive Virtual Characters for Educating Medical Communication Skills PowerPoint PPT Presentation


  • 81 Views
  • Uploaded on
  • Presentation posted in: General

Immersive Virtual Characters for Educating Medical Communication Skills. J. Hernendez, A. Stevens, D. S. Lind Department of Surgery (College of Medicine) M. Duerson Department of Community Health and Family Medicine (College of Medicine) K. Johnsen, R. Dickerson, A. Raij, B. Lok

Download Presentation

Immersive Virtual Characters for Educating Medical Communication Skills

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Immersive virtual characters for educating medical communication skills

Immersive Virtual Characters for Educating Medical Communication Skills

J. Hernendez, A. Stevens, D. S. Lind

Department of Surgery (College of Medicine)

M. Duerson

Department of Community Health and Family Medicine (College of Medicine)

K. Johnsen, R. Dickerson, A. Raij, B. Lok

Department of Computer and Information Science and Engineering (College of Engineering)

The University of Florida, Gainesville, FL

J. Jackson, M. ShinDepartment of Computer Science

The University of North Carolina at Charlotte, Charlotte, NC


What is a virtual character

What is a Virtual Character?

  • Virtual character - a character who represents the state of a system

  • In TRON (1982), humans and humans that represents software interacted within a world that represented the hardware.


What is a virtual character1

What is a Virtual Character

  • We aim to to have humans and human the represent software interact in the real world.

    r


Virtual character research

Virtual Character Research

  • Mostly

    • Rendering

    • Animation

    • Artificial Intelligence

  • Newer approaches

    • Affective power

    • Human response to VCs

  • Clinical Psychology

    • Fear of public speaking


Motivation

Motivation

  • “Doctor, I have a pain in my side!”

  • What you do next depends on:

    • Age

    • Gender

    • Ethnicity

    • Visual Cues

    • Audio Cues


Motivation1

Motivation

  • Current methodologies

    • Books

    • Standardized Patients (actors)

  • Restricted in:

    • Training frequency

    • Scenario variety

    • Immediate feedback

  • Affects medical student preparedness

  • Provide additional training opportunities


Solution

Solution

  • Interactive Virtual Characters

    • Life-Sized

    • Computer Generated

    • Natural Interaction

    • Responds to User

    • Responses based on accepted medical procedure

  • COTS Equipment:

    • Projectors

    • Laptops

    • Web cameras

    • Tablet PC


Why do we want virtual characters

Why Do We Want Virtual Characters?

  • Propose: Digital Characters as a new (meta-) medium to interact with information

  • Effective Interaction

    • Better than keyboard and mouse for certain tasks

    • Dynamic

    • 3D

    • Natural interaction

    • Low Bandwidth

  • Effective Collaboration

    • Controlled conveyed visual information

    • Non-verbal communication (60%)


Let s look at interaction

Thinking

Digital Character

Responding

Perceiving

Let’s look at interaction

  • Each participant in a communication has three stages: perception, cognition, and response

  • Define interaction as both the input and output

Digital Character

Thinking

Responding

Perceiving

Interaction

Perceiving

Responding

Thinking

Participant


Combines

Combines

  • Speech

  • Computer Vision

    • Eye Gaze

    • Gesture Recognition

    • Repeat your gestures

  • High Quality 3D models

    • Animation

    • Rendering

    • Visualization


Integrates

Integrates

  • Computer Science

    • Computer Graphics

    • Image Processing

    • Natural Language Processing

  • Medicine

    • Training

    • Education

    • Standardization

  • Education

    • Multimedia Learning

    • Technology based Learning

    • Training

  • What other areas could this be used for?

    • Psychology

    • Social Science

    • Education


Current and future work

Current and Future Work

  • Current Status:

    • Initial scenario created with gesture, speech, and visualization components integrated

    • Evaluating with a group of Medical Students Year 2

  • Future Work:

    • Formal evaluation studies

    • Increase and improve scenarios

    • Enhance interactivity

  • Show video


Play video

Play Video


  • Login