Immersive virtual characters for educating medical communication skills
Download
1 / 13

Immersive Virtual Characters for Educating Medical Communication Skills - PowerPoint PPT Presentation


  • 96 Views
  • Uploaded on

Immersive Virtual Characters for Educating Medical Communication Skills. J. Hernendez, A. Stevens, D. S. Lind Department of Surgery (College of Medicine) M. Duerson Department of Community Health and Family Medicine (College of Medicine) K. Johnsen, R. Dickerson, A. Raij, B. Lok

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' Immersive Virtual Characters for Educating Medical Communication Skills' - vaughan


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Immersive virtual characters for educating medical communication skills

Immersive Virtual Characters for Educating Medical Communication Skills

J. Hernendez, A. Stevens, D. S. Lind

Department of Surgery (College of Medicine)

M. Duerson

Department of Community Health and Family Medicine (College of Medicine)

K. Johnsen, R. Dickerson, A. Raij, B. Lok

Department of Computer and Information Science and Engineering (College of Engineering)

The University of Florida, Gainesville, FL

J. Jackson, M. ShinDepartment of Computer Science

The University of North Carolina at Charlotte, Charlotte, NC


What is a virtual character
What is a Virtual Character? Communication Skills

  • Virtual character - a character who represents the state of a system

  • In TRON (1982), humans and humans that represents software interacted within a world that represented the hardware.


What is a virtual character1
What is a Virtual Character Communication Skills

  • We aim to to have humans and human the represent software interact in the real world.

    r


Virtual character research
Virtual Character Research Communication Skills

  • Mostly

    • Rendering

    • Animation

    • Artificial Intelligence

  • Newer approaches

    • Affective power

    • Human response to VCs

  • Clinical Psychology

    • Fear of public speaking


Motivation
Motivation Communication Skills

  • “Doctor, I have a pain in my side!”

  • What you do next depends on:

    • Age

    • Gender

    • Ethnicity

    • Visual Cues

    • Audio Cues


Motivation1
Motivation Communication Skills

  • Current methodologies

    • Books

    • Standardized Patients (actors)

  • Restricted in:

    • Training frequency

    • Scenario variety

    • Immediate feedback

  • Affects medical student preparedness

  • Provide additional training opportunities


Solution
Solution Communication Skills

  • Interactive Virtual Characters

    • Life-Sized

    • Computer Generated

    • Natural Interaction

    • Responds to User

    • Responses based on accepted medical procedure

  • COTS Equipment:

    • Projectors

    • Laptops

    • Web cameras

    • Tablet PC


Why do we want virtual characters
Why Do We Want Virtual Characters? Communication Skills

  • Propose: Digital Characters as a new (meta-) medium to interact with information

  • Effective Interaction

    • Better than keyboard and mouse for certain tasks

    • Dynamic

    • 3D

    • Natural interaction

    • Low Bandwidth

  • Effective Collaboration

    • Controlled conveyed visual information

    • Non-verbal communication (60%)


Let s look at interaction

Thinking Communication Skills

Digital Character

Responding

Perceiving

Let’s look at interaction

  • Each participant in a communication has three stages: perception, cognition, and response

  • Define interaction as both the input and output

Digital Character

Thinking

Responding

Perceiving

Interaction

Perceiving

Responding

Thinking

Participant


Combines
Combines Communication Skills

  • Speech

  • Computer Vision

    • Eye Gaze

    • Gesture Recognition

    • Repeat your gestures

  • High Quality 3D models

    • Animation

    • Rendering

    • Visualization


Integrates
Integrates Communication Skills

  • Computer Science

    • Computer Graphics

    • Image Processing

    • Natural Language Processing

  • Medicine

    • Training

    • Education

    • Standardization

  • Education

    • Multimedia Learning

    • Technology based Learning

    • Training

  • What other areas could this be used for?

    • Psychology

    • Social Science

    • Education


Current and future work
Current and Future Work Communication Skills

  • Current Status:

    • Initial scenario created with gesture, speech, and visualization components integrated

    • Evaluating with a group of Medical Students Year 2

  • Future Work:

    • Formal evaluation studies

    • Increase and improve scenarios

    • Enhance interactivity

  • Show video


Play video
Play Video Communication Skills


ad