200 likes | 222 Views
Exploring how motion is perceived in computer vision through concepts like counterphase sin grating and spatio-temporal patterns. Discusses the Reichardt detector, gradient correlation, spatiotemporal filters, and Gabor functions. Unifying models for motion perception are detailed with a focus on spatial and temporal responses. Highlights the importance of evolutionary motion detection and the complexity of higher processing levels.
E N D
Sensing and Perceiving Motion Cmput 610 Martin Jagersand 2001
How come perceived as motion? Im = sin(t)U5+cos(t)U6 Im = f1(t)U1+…+f6(t)U6
Counterphase sin grating • Spatio-temporal pattern • Time t, Spatial x,y
Counterphase sin grating • Spatio-temporal pattern • Time t, Spatial x,y Ignoring Phi: = +
Notes: • Only one term: Motion left or right • Mixture of both: Standing wave • Direction can flip between left and right
QT movie Reichardt detector
Gradient: in Computer Vision Correlation: In bio vision Spatiotemporal filters: Unifying model Severalmotion models
Spatial response:Gabor function • Definition:
Temporal response: Adelson, Bergen ’85 Note: Terms from taylor of sin(t) Spatio-temporal D=DsDt
Receptor response toCounterphase grating • Separable convolution
Simplified: • For our grating: (Theta=0) • Write as sum of components: = exp(…)*(acos… + bsin…)
Combined cells • Spat: Temp: • Both: • Comb:
Result: • More directionally specific response
Energy model: • Sum odd and even phase components • Quadrature rectifier
Conclusion • Evolutionary motion detection is important • Early processing modeled by Reichardt detector or spatio-temporal filters. • Higher processing poorly understood