On going research projects prof hanqiu sun dept of computer science eng cuhk hanqiu@cse cuhk edu hk
Download
1 / 60

On-going Research Projects Prof. Hanqiu Sun Dept. of Computer Science & Eng., CUHK hanqiu@cse.cuhk.hk - PowerPoint PPT Presentation


On-going Research Projects Prof. Hanqiu Sun Dept. of Computer Science & Eng., CUHK hanqiu@cse.cuhk.edu.hk Virtual-hand Interfaces Multi-sensory Surgical Simulation & Training Interactive Fish Behavioral Animation in VR Two-handed Task Planning in Virtual Assembly

Related searches for On-going Research Projects Prof. Hanqiu Sun Dept. of Computer Science & Eng., CUHK hanqiu@cse.cuhk.hk

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha

Download Presentation

On-going Research Projects Prof. Hanqiu Sun Dept. of Computer Science & Eng., CUHK hanqiu@cse.cuhk.hk

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


On going research projects prof hanqiu sun dept of computer science eng cuhk hanqiu@cse cuhk edu hk l.jpg

On-going Research ProjectsProf. Hanqiu SunDept. of Computer Science & Eng., CUHKhanqiu@cse.cuhk.edu.hk

  • Virtual-hand Interfaces

  • Multi-sensory Surgical Simulation & Training

  • Interactive Fish Behavioral Animation in VR

  • Two-handed Task Planning in Virtual Assembly

  • Web-based Virtual Country Parks in HK

  • Haptic Sculpting in Virtual Volume Space


Slide2 l.jpg

  • Virtual-hand Interfaces

    The whole-hand input interface has three novel properties:

    • intuitive use of the hand

    • smooth transition of control modes

    • reduced interface complexity

      Hand interface is formed by both postures and gestures. It is difficult to recognize both due to:

    • the complexity of hand structure

    • the lack of accurate measure

      Hand itself is an articulated structure with multiple degrees of freedom (DOFs)

      (17 active joints --> 23 degrees + 6 degrees)


Slide3 l.jpg

Human Hand


Finger tip position l.jpg

Finger Tip Position


System model l.jpg

System Model


Accuracy l.jpg

Accuracy


Efficiency l.jpg

Efficiency


State transition diagram l.jpg

State Transition Diagram


Virtual robot model l.jpg

Virtual Robot Model


Physics based virtual hand grasping l.jpg

Physics-based virtual-hand grasping

  • three states : free, upward, dropping

    • free : no collision is detected

    • upward : collision is detected, object is held firmly

    • dropping : collision is detected, object is slipping from the hand

  • two stages : Visual Correction and Active Grasping


State diagram l.jpg

State diagram


Visual correction cont l.jpg

Visual correction (cont.)


Active grasping cont l.jpg

Active grasping (cont.)


Experimental results sphere l.jpg

Experimental results (sphere)


Experimental results box l.jpg

Experimental results (box)


Virtual tools in multi sensory interaction l.jpg

Virtual tools in multi-sensory interaction

  • Display two models simultaneously for comparison

  • Two–handed

    comparison


Virtual tools in multi sensory interaction22 l.jpg

Virtual tools in multi-sensory interaction

  • Display modes:

    • Full Volume

    • Monoplanar

    • Triplanar


Virtual tools in multi sensory interaction23 l.jpg

Virtual tools in multi-sensory interaction

  • Fork tool

    • to position and orientate any object

  • Clip tool

    • reveal cross-sections

  • Crop tool

    • show sub volume


Interactive medical data interface l.jpg

Interactive Medical data Interface


Two handed interface l.jpg

Two-handed Interface


Slide26 l.jpg

  • Interactive Fish Behavioral Animation in VR

    Behavioral Animation

    • random movement

      • collision between fishes

      • collision between fish and the env.

      • random swimming

    • behavior of crowds

      • speed match

      • school movement

    • behavior patterns (chaos models)

      • food searching behavior

      • fish preying behavior

      • danger escaping behavior


Slide27 l.jpg

  • Fish Model Creation

    • use of fish skeleton

Relation between control points and surface points


Behavior of crowds l.jpg

Behavior of Crowds

  • Schooling behavior


Fish preying behavior l.jpg

Fish Preying Behavior

  • similar as food searching behavior

  • shark attacking the fish


Slide36 l.jpg

  • Demonstration


Slide37 l.jpg

  • Two-handed Task Planning in Virtual Assembly

    Assembly modeling is the process of capturing entities and activity information related to assembling and assembly.

    Our task planner incorporates with a VR interface for 3D immersive interaction of CAD models and high-level task planning of mating processes.

    • 3D immersive VR interface

    • Assembly analysis

    • Feature/constraint update

    • Assembly task planning

      (collision-free interaction, allowable motion)


Two handed virtual assembly l.jpg

Two-handed Virtual Assembly


Slide48 l.jpg

  • Geographic Information Systems

    GIS is a System ofcomputer software, hardware and data, and personnel to help manipulate, analyze and present information that is tied to a spatial location

    • spatial location– a geographic location

    • information– visualization of data analysis

    • system– linking software, hardware, data

    • personnel– explorers key to the power of GIS


Web based virtual country parks l.jpg

Web-based Virtual Country Parks

  • Provide on-line visualization of multi-scale, multi-dimension, and multi-source data of HK country parks

  • Promote the ecological tourism and public recreation in our nature, improve the parks with the collection of public suggestions

  • Interactive network for citizens to know more about our country parks, communication with voice or text, even play in the parks


System architecture l.jpg

System Architecture

  • 3-tier architecture system with Internet-enabled environment and database system support


System architecture51 l.jpg

System Architecture

  • 3-tier Layer


Slide52 l.jpg

Web-based VCP System


Web based vcp system l.jpg

Web-based VCP System


Slide54 l.jpg

Objectives –VBVR System

  • VBVR System - Volume-Based Virtual Reality System

  • Real Time Volume Sculpting


System architecture55 l.jpg

System Architecture

  • Platform

    • SGI IRIX

  • Hardware

    • PHANToM

  • Software

    • GHOST SDK

    • C++

    • OpenGL


Slide56 l.jpg

Volume Data


Slide57 l.jpg

Virtual Tools in VBVR System

Stamp

Melt


Slide58 l.jpg

Virtual Tools in VBVR System

Stamp


Slide59 l.jpg

Virtual Tools in VBVR System

  • Melting Manipulation

Volume::display()

Check collision

Display::collideDetect()

If collide

Get the last Phantom position and the current position

Load the texture volume again

Set the pixel value to 0

Convert the coordinates from World Coordinates to Volume Coordinates


ad
  • Login