1 / 20

Lab Seminar

Lab Seminar. Exploring Tactile Movies: An Initial Glove Design and Concept Evaluation Written by Yoengmi Kim, Jeha Ryu Seminar Presented by Myongchan Kim. Overview. Background Information Haptic Interaction Haptic Contents Tactile Movie System Evaluation Recap Further Discussion.

tacita
Download Presentation

Lab Seminar

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Lab Seminar Exploring Tactile Movies: An Initial Glove Design and Concept Evaluation Written by Yoengmi Kim, JehaRyu Seminar Presented by Myongchan Kim

  2. Overview • Background Information • Haptic Interaction • Haptic Contents • Tactile Movie System • Evaluation • Recap • Further Discussion

  3. Background Information • Demanded More Pleasing Multimedia Formats • PerceptoSystem Installed in 1950’s • 3-D Projection with Additional Physical Stimuli in Theatres (a.k.a 4-D) • Haptic Contents Authoring (e.g. VibeTonz) • Synchronization Between Tactile and Audio-visual Media

  4. Background Information: Haptic Interaction

  5. Haptic Interaction • Passive Interaction: Movie Watching Scenario • Active Interaction: Home Shopping scenario

  6. Haptic Interaction • Tactile Movie System • More Interactive haptic Feedback System • Tactile Cues as Artistic Ways • 1st and 3rd Person Sensation • Background tactile Effects are Non-visual, Ambient Scene Contents Attempting to Establish Mood

  7. Haptic Content (Tactile Format) • MPEG-4 Binary Format for Scene (BIFS) • Scene-descriptor Format Capable of Encapsulating the Spatiotemporal Arrangements of Media Elements • Extended MPEG-4 Format With the New Tactile Node • Re-synchronized with Audio-visual Contents • Haptic Device for Tactile Display • PHANToM or CyberForce Gloves • Greyscale Data – Actuation Intensity • Saved in avi or H.264 for Export

  8. Haptic Content (Haptic Nodes) • BIFS Enables Spatio-Temporal Relationships Between Haptic and Audio-visual Media, and Supports the Synchronized Representation and Transmission of a Media Stream Including Haptic media • The New Nodes: • Haptic Surface Properties • Dynamic Properties • Tactile Video • Encoding Method • MPEG-4 Transmission: • Broadcasting Method • IP networks

  9. Haptic Contents • How Haptic Media is Created: • Data Can be Recorded with Physical Sensors • It Can be Generated using Specialized Modeling Tools • Software that Communicates With Dynamic Human Motion • It Can be Derived Automatically from Analysis of Other Media • Automatic Generation of Haptic Media From Audio-Visual Sources

  10. Tactile Movie System • System Configuration System Diagram: the tactile information is displayed through a streaming server

  11. Tactile Movie System • Tactile Display and Rendering Process

  12. Tactile Movie System • Authoring Tool

  13. Tactile Movie System • Importance of Grey Scale • Intensity of grey scale in a tactile video determines magnitude of the cue (Stored in SFTexture Node) • A Line Can be Presented as a Sequential Tactile Events

  14. Evaluation • Objective and Measured Latency • User Perceptions Delivered by the System • User Opinions of the Cues Delivered by the System

  15. Latency Measurement • Latency Between a Command and a Tactile Display • Technological Lags: • Bluetooth Transmission Time • Mechanical Activation Time • Processing Overheads • Rising Time: 92 ms • Bluetooth Transmission Time: 50ms

  16. Objective Evaluation • 3 Movies and 3 Perspective Points • 10 Participants, 6 have Previous Haptic Exps. • A Forced-choice Pairwise Comparison

  17. Subjective Evaluation • 80 Responses, age between 17 to 43 Q) What tactile display was the most impressive among the three movies? Q) What tactile display was the most impressive among the three movies?

  18. Recap • 1st Person Tactile Sensation are the Most Appropriate • Background Music Can be Used for Tactile Media • Tactile Saliency vs. Audio-Visuo Saliency • This Paper Only Focuses on Haptics in Hands • Convenient and Applicable • Automatic Capture of Tactile Media • Broadcasting for Convenience and IPTV

  19. Further Research Discussion • Automatic Tactile Feedback Based On Visual Saliency • Color, Hue, Features • Based On Saliency or Motions • Automatic Tactile Feedbacks • Averaged and Grey-scaled Data Contributes Intensities • Automatic Tactile Feedback Based On Audio Saliency • 3D Audio for Position Information • Audio Sound for Tactile Intensity

  20. Thank You

More Related