coding scheme in gestures analysis n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
Coding Scheme in Gestures Analysis PowerPoint Presentation
Download Presentation
Coding Scheme in Gestures Analysis

Loading in 2 Seconds...

play fullscreen
1 / 22

Coding Scheme in Gestures Analysis - PowerPoint PPT Presentation


  • 248 Views
  • Uploaded on

Coding Scheme in Gestures Analysis. Liang Zhou Dr. Manolya Kwa. What are Gestures and G-Analysis?. Gesture is the special motion(s) which express specific meaning from thought. ( Another form of Speech)

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Coding Scheme in Gestures Analysis' - dericia


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
coding scheme in gestures analysis

Coding Scheme in Gestures Analysis

Liang Zhou

Dr. Manolya Kwa

what are gestures and g analysis
What are Gestures and G-Analysis?
  • Gesture is the special motion(s) which express specific meaning from thought. ( Another form of Speech)
  • G-Analysis is the studying of human behaviour which purpose to understand the human actions and their thought.
why g analysis
Why G-Analysis?
  • Gesture analysis by computer becomes an important role in science studying field. (Sign language)
  • it is key role in human and computer interaction research
  • It has significant scientific value.
why coding gesture
Why coding gesture?
  • Coding Gestures is the process of translating attributes or properties of the gestures (i.e Finger Form) into a form that

researchers can systematically analyse.

  • Coding gesture is the important to
  • HCI need coding gesture. (One of the most important concepts is that of direct manipulation)
problem
Problem

In Cognitive studying, the abstract concept

of coding scheme can’t be implement in HCI.

Reason:

  • Abstract Code
  • Ambiguous Expression.
cognitive actions
Cognitive Actions
  • Physical Actions:

L-Action, M-Action, D-Action

  • Perceptual Action
  • Functional Action
  • Conceptual Action: Goals etc.
why coding gesture in ca
Why Coding Gesture in CA?
  • 1. Speech and Gesture are the same system.
  • 2. Interpret the thought more clearly than the sentence and words (Better Understanding)
  • 3. Gesture express the thought instantly but speech systematically .
  • 4. Gesture Recognition Tools are mature and widely use in Gesture Analysis.
challenge
Challenge
  • How to prove it?
  • How to Code the gesture ?
  • How to improve the reliability of Coding Scheme?
  • How to get the sufficient data ?
method
Method
  • 4 participants : 2 task
  • Task 1: Cognitive Progress
  • Task 2: Gesture Capture Phase.
  • Cognitive progress : Sketching the chair and record the whole phase.
  • Capture the gesture and motion by 2 cameras. One for body motion, one for Hand motion.
data collection
Data Collection
  • Sketching Record

2. Gesture Image.

coding scheme
Coding Scheme
  • Motion::
  • attributes: M_Name, Hand_type frequency(default) TimeStamp Position Direction FingerForm
  • M_Name: {}
  • Hand_type: {LH,RH,TH}
  • frequency: {Single, Repeated }
  • TimeStamp: {ST,FT}
  • Position: {Left, Lower-Left, Upper-Left, Center, Right, Lower-Right, Upper-Right, Lower}
  • Direction {(1,0), (1,1),(-1,0),….}
coding scheme1
Coding Scheme
  • Gesture ::
  • Attributes : Name, TimeGap, PosSS, Objects
  • Name: (GestureName)
  • TimeGap: (Time Second)
  • PosSS: (Distance)
  • Objects( parts of chair)
tools
Tools
  • The Anvil could compute statistics on an annotated video sequence and the annotation element which we defined in the coding scheme will be represented the same behavior and grouped together. Then, we will understand the label between Gestures and Objects. Basic on the Kawali‘s experiment result, we will understand that what kind of the gestures is mapping to which behaviors and the gestures is mapping to the goal /goals or not.
current works
Current Works
  • We have found out 6 common gestures
  • However, because of lack of the data , we just can simply to capture and represent it by our coding scheme.
  • But we’ve already find that some data in cognitive actions show a strong correlation with gestures.
what we find
What we find
  • One of the most occurring gesture:
  • “This part of the chair I think is too small or big.”
  • The hand focus on the size of the part they drew. The level of the size and amount should be expressed..
  • P1, P3, P4, P5
conclusion
Conclusion
  • We provide a new methodology to understand the cognitive actions and provide its possibility to implement HCI in design field
  • Future work :
  • 1. Coding scheme need to cover more other’s field. For example , facial and Head movement.
  • 2. More task in the experiment will gain sufficient data to analysis and explore the gesture.
thanks
Thanks

Question?