HUMAN ACTION RECOGNITION IN TEMPORAL-VECTOR TRAJECTORY LEARNING FRAMEWORK
This presentation is the property of its rightful owner.
Sponsored Links
1 / 20

HUMAN ACTION RECOGNITION IN TEMPORAL-VECTOR TRAJECTORY LEARNING FRAMEWORK PowerPoint PPT Presentation


  • 152 Views
  • Uploaded on
  • Presentation posted in: General

HUMAN ACTION RECOGNITION IN TEMPORAL-VECTOR TRAJECTORY LEARNING FRAMEWORK. Chin-Hsien Fang( 方競賢 ), Ju-Chin Chen( 陳洳瑾 ), Chien-Chung Tseng( 曾建中 ),and Jenn-Jier James Lien( 連震杰 ) Department of Computer Science and Information Engineering, National Cheng Kung University. Outline. Motivation

Download Presentation

HUMAN ACTION RECOGNITION IN TEMPORAL-VECTOR TRAJECTORY LEARNING FRAMEWORK

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Human action recognition in temporal vector trajectory learning framework

HUMAN ACTION RECOGNITION IN TEMPORAL-VECTOR TRAJECTORY LEARNING FRAMEWORK

Chin-Hsien Fang(方競賢), Ju-Chin Chen(陳洳瑾), Chien-Chung Tseng(曾建中),and Jenn-Jier James Lien(連震杰)

Department of Computer Science and Information Engineering,

National Cheng Kung University


Outline

Outline

  • Motivation

  • System flowchart

  • Training Process

  • Testing Process

  • Experimental Results

  • Conclusions


Motivation

Motivation

  • Traditional Manifold classification (ex: LDA , LSDA…)

    *Only spatial information

    *The input data are continuous sequences

    *Temporal information should be considered


System flowchart

System flowchart

h*w

h*w

d

d

A

S

M

d*(2t+1)

d*(2t+1)

d*(2t+1)

d*(2t+1)


Training process

Training process

LPP

Temporal data

Metric Learning


Dimension reduction

Dimension Reduction

  • Why dimension reduction?

    • To reduce the calculation cost

  • Why LPP (Locality Preserving Projections)?

    • Can handle non-linear data with linear transformation matrix

    • Local structure is preserved


Human action recognition in temporal vector trajectory learning framework

Locality Preserving projection(1/2)

Try to keep the local structure while reducing the dimension


Locality preserving projection 2 2

Locality Preserving projection(2/2)

Objective function:

L : Laplacian matrix

Where L = (D - W)

D : Diagonal matrix

W : Weight matrix

Subject to


Temporal information

Temporal Information

  • Three kinds of temporal information

    • LTM(Locations temporal motion of Mahalanobis distance)

    • DTM(Difference temporal motion of Mahalanobis distance)

    • TTM(Trajectory temporal motion of Mahalanobis distance)


Human action recognition in temporal vector trajectory learning framework

LTM

An input sequence:

LPP

Temporal

where


Human action recognition in temporal vector trajectory learning framework

DTM

where


Human action recognition in temporal vector trajectory learning framework

TTM

where


Metric learning

Metric Learning

  • Mahalanobis distance

    • Preserving the relation of the data

    • Doesn’t depend on the scale of the data


Human action recognition in temporal vector trajectory learning framework

LMNN

Minimize :

yj

yi

yi

LMESpace

Subject to :

yl

yj

LPP+Temporal Space

(i)

yi

yi

yl

(ii)

LMNN

yj

yl

(iii) M has to be positive semi-definite


Recognition process

Recognition process

LPP

Temporal data

Metric Learning

K-NN


Human action recognition in temporal vector trajectory learning framework

KNN

The number of nearest neighbor

Test data

3

1

Training data

1

The winner takes all~~

Labeled as

K=5


Experimental results 1 2

Experimental results(1/2)


Experimental results 2 2

Experimental results(2/2)


Conclusions

ConclusionS

  • Our TVTL framework makes impressive progress compared to other traditional methods such as LSDA

  • Temporal information do have positive influence

  • DTM , TTM are better than LTM because they consider the correlation of the data


Human action recognition in temporal vector trajectory learning framework

Thank You!!


  • Login