1 / 60

On-going Research Projects Prof. Hanqiu Sun Dept. of Computer Science & Eng., CUHK hanqiu@cse.cuhk.hk

On-going Research Projects Prof. Hanqiu Sun Dept. of Computer Science & Eng., CUHK hanqiu@cse.cuhk.edu.hk Virtual-hand Interfaces Multi-sensory Surgical Simulation & Training Interactive Fish Behavioral Animation in VR Two-handed Task Planning in Virtual Assembly

Download Presentation

On-going Research Projects Prof. Hanqiu Sun Dept. of Computer Science & Eng., CUHK hanqiu@cse.cuhk.hk

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. On-going Research ProjectsProf. Hanqiu SunDept. of Computer Science & Eng., CUHKhanqiu@cse.cuhk.edu.hk • Virtual-hand Interfaces • Multi-sensory Surgical Simulation & Training • Interactive Fish Behavioral Animation in VR • Two-handed Task Planning in Virtual Assembly • Web-based Virtual Country Parks in HK • Haptic Sculpting in Virtual Volume Space

  2. Virtual-hand Interfaces The whole-hand input interface has three novel properties: • intuitive use of the hand • smooth transition of control modes • reduced interface complexity Hand interface is formed by both postures and gestures. It is difficult to recognize both due to: • the complexity of hand structure • the lack of accurate measure Hand itself is an articulated structure with multiple degrees of freedom (DOFs) (17 active joints --> 23 degrees + 6 degrees)

  3. Human Hand

  4. Finger Tip Position

  5. System Model

  6. Accuracy

  7. Efficiency

  8. State Transition Diagram

  9. Virtual Robot Model

  10. Physics-based virtual-hand grasping • three states : free, upward, dropping • free : no collision is detected • upward : collision is detected, object is held firmly • dropping : collision is detected, object is slipping from the hand • two stages : Visual Correction and Active Grasping

  11. State diagram

  12. Visual correction (cont.)

  13. Active grasping (cont.)

  14. Experimental results (sphere)

  15. Experimental results (box)

  16. Virtual tools in multi-sensory interaction • Display two models simultaneously for comparison • Two–handed comparison

  17. Virtual tools in multi-sensory interaction • Display modes: • Full Volume • Monoplanar • Triplanar

  18. Virtual tools in multi-sensory interaction • Fork tool • to position and orientate any object • Clip tool • reveal cross-sections • Crop tool • show sub volume

  19. Interactive Medical data Interface

  20. Two-handed Interface

  21. Interactive Fish Behavioral Animation in VR Behavioral Animation • random movement • collision between fishes • collision between fish and the env. • random swimming • behavior of crowds • speed match • school movement • behavior patterns (chaos models) • food searching behavior • fish preying behavior • danger escaping behavior

  22. Fish Model Creation • use of fish skeleton Relation between control points and surface points

  23. Behavior of Crowds • Schooling behavior

  24. Fish Preying Behavior • similar as food searching behavior • shark attacking the fish

  25. Demonstration

  26. Two-handed Task Planning in Virtual Assembly Assembly modeling is the process of capturing entities and activity information related to assembling and assembly. Our task planner incorporates with a VR interface for 3D immersive interaction of CAD models and high-level task planning of mating processes. • 3D immersive VR interface • Assembly analysis • Feature/constraint update • Assembly task planning (collision-free interaction, allowable motion)

  27. Two-handed Virtual Assembly

  28. Geographic Information Systems GIS is a System ofcomputer software, hardware and data, and personnel to help manipulate, analyze and present information that is tied to a spatial location • spatial location– a geographic location • information– visualization of data analysis • system– linking software, hardware, data • personnel– explorers key to the power of GIS

  29. Web-based Virtual Country Parks • Provide on-line visualization of multi-scale, multi-dimension, and multi-source data of HK country parks • Promote the ecological tourism and public recreation in our nature, improve the parks with the collection of public suggestions • Interactive network for citizens to know more about our country parks, communication with voice or text, even play in the parks

  30. System Architecture • 3-tier architecture system with Internet-enabled environment and database system support

More Related