1 / 11

Unseen Joint Kinematics for Vision System Estimation

Explore methods to estimate hidden joint movements impacting visual systems. Discover how Nico, the robotic self-model, incorporates sensory data and causal modeling to enhance understanding. Learn about stereo vision fundamentals, epipolar geometry, and neck joint kinematics.

kennerg
Download Presentation

Unseen Joint Kinematics for Vision System Estimation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Estimating the Kinematics of Unseen Joints that Affect the Vision SystemJustin Hart, Brian Scassellati, Steven ZuckerDepartment of Computer ScienceYale University

  2. Nico

  3. Robotic Self-Modeling • Sensory Systems • Kinematics • Causal Modeling Photo Credit: Jeremiah Owyang

  4. Stereo Vision in a Nutshell Pinhole Camera Illustration Credit: Wikimedia Commons • Pinhole Camera Model • Camera Center • Stereo Correspondence • Epipolar Geometry

  5. Epipolar Geometry in a Nutshell • Epipole • Epipolar Line • Cameras • Positioning • Orientation

  6. Nico's Head • Nico's eyes • Yaw independently • Majority approaches • Assume fixed epipolar geometry • Assume unknown epipolar geometry • Other approaches • Compute ego-motion visually • Hand/Head-eye calibration

  7. Epipolar Kinematic Model

  8. Results Right camera image, with epipolar lines Left camera image

  9. Kinematics

  10. Neck Joints

  11. Some Projective Geometry Formulas

More Related