1 / 20

KINECT

KINECT. Vinayak Thapliyal and Noah Balsmeyer. Overview. What is the Kinect? Why was it made? How does it work? How does it compare to other sensors? How can we use it?. http://cdn.leviathyn.com/wp-content/uploads/2012/04/kinect_360.jpg. What is the Kinect?. Input Device

raffaello
Download Presentation

KINECT

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. KINECT Vinayak Thapliyal and Noah Balsmeyer

  2. Overview • What is the Kinect? • Why was it made? • How does it work? • How does it compare to other sensors? • How can we use it? http://cdn.leviathyn.com/wp-content/uploads/2012/04/kinect_360.jpg

  3. What is the Kinect? • Input Device • Gesture Recognition • Facial Recognition • Voice Recognition • Programmable • C++ • C# • Visual Basic .NET http://www.ehomeupgrade.com/wp-content/uploads/xbox_360_kinect_diagram.jpg

  4. What is the Kinect? • Gesture and Facial Recognition • RGB Camera • Depth Sensor • Infrared Laser Projector • Monochrome CMOS Sensor • Voice Recognition • Multi-Array Microphone http://upload.wikimedia.org/wikipedia/commons/7/76/Kinect2-ir-image.png http://upload.wikimedia.org/wikipedia/commons/9/90/Kinect2-deepmap.png

  5. Why was the Kinect made? • Make UI More Intuitive to Human Motion • Release a Competitor to Nintendo Wii • Led to More Affordable 3D Imaging and Motion Detection

  6. How Does it Work? • Infrared Projection • Dot Pattern • Motion Detection • 30 Hz Output from CMOS Sensor • 40 Tracking Points • 20 joints per player • Depth Mapping • Object Triangulation • Device Reaction http://blogs.microsoft.co.il/blogs/shair/image_thumb_6F4828EC.png http://api.ning.com/files/46-6*7H3sr0HeW9nwDwZoG5vvjKRIu26Kvy4VhyytnE1DTUjsfQ5OZFQ5g8LFS-Il5DwjPVHn5NMQl*Ugoh8CpXN-W9b82XW/PrimeSensorDepth_Diagram.gif

  7. Kinect Pin Layout • Modified USB Connector for More Power • Motorized Tilt Mechanism • RGB Camera, IR Projector, and CMOS Sensor • Internal Components http://img51.imageshack.us/img51/8168/pinout21.png http://home.comcast.net/~sowndwayv/cablebuild_large.PNG

  8. Depth Sensor • Field of View • 57 Degree Horizontal, 43 Vertical • Movable by additional 27 Degrees Up or Down • IR Projector • Received by Monochrome CMOS Sensor • Video Output • 9 – 30 Hz • 640 x 480px • Additional Processing • IR Filter at Projector Wavelength

  9. Depth Sensor • IR Projector emits predefined Dotted Pattern • Lateral Shift between projector and sensor • Shift in pattern dots • Shift in Dots determines Depth of Region http://www.futurepicture.org/?p=116

  10. Kinect Accuracy • OpenKinect SDK • 11 Bit Accuracy • 211 = 2048 possible values • Measured Depth • Calculated 11 bit value • 2047 = maximum distance • Approx. 16.5 ft. • 0 = minimum distance • Approx. 1.65 ft. • Reasonable Range • 4 – 10 feet • Provides Moderate Slope Values from: http://mathnathan.com/2011/02/depthvsdistance/

  11. Kinect Accuracy • OpenKinect SDK • 11 Bit Accuracy • 211 = 2048 possible values • Measured Depth • Calculated 11 bit value • 2047 = maximum distance • Approx. 16.5 ft. • 0 = minimum distance • Approx. 1.65 ft. • Reasonable Range • 4 – 10 feet • Provides Moderate Slope Values from: http://mathnathan.com/2011/02/depthvsdistance/

  12. http://media.digikey.com/Photos/AMS-Taos%20USA%20Photos/TSL2771xFN_sml.jpghttp://media.digikey.com/Photos/AMS-Taos%20USA%20Photos/TSL2771xFN_sml.jpg http://gemini3dcamera.com/Home_files/smGemni%26FinderDSDa_5070.jpg How Does the Kinect Compare? • Distance Sensing • Alternatives Cheaper than Kinect • ~$2 Single-Point Close-Range Proximity Sensor • Motion Sensing and 3D Mapping • High Performing Devices with Higher Cost • Good Performance for Distance and Motion Sensing • Provides a bridge between low cost and high performance sensors

  13. How Can We Use the Kinect? • Kinect Software Development Kit (SDK) • Free Download available for Windows 7 and 8 • Http://www.microsoft.com/en-us/kinectforwindows/develop/overview.aspx • Must have Windows OS Capable Processor • Very well documented and great online community support • Other SDKs, including OpenKinect, have been ported to Linux and Mac

  14. How Can We Use the Kinect?

  15. How Can We Use the Kinect? • 3D Room Mapping http://www.blogcdn.com/www.engadget.com/media/2011/03/3-31-11-kinect-slam.jpg

  16. How Can We Use the Kinect? • Hand Signals and Motion Recognition http://www.popsci.com/files/imagecache/article_image_large/articles/Picture%202_54.png

  17. How Can We Use the Kinect? • Object Tracking http://geektech.ie/wp-content/uploads/2011/04/eye-object-tracking.jpg http://hackadaycom.files.wordpress.com/2011/04/tld_object_tracking.jpg?w=470&h=313

  18. How Can We Use the Kinect? • Wide Range of Applications • Possibly for your EECS 373 Project!

  19. Questions?

  20. References • http://openkinect.org/wiki/Hardware_info • http://www.jameco.com/Jameco/workshop/howitworks/xboxkinect.html • http://mirror2image.wordpress.com/2010/11/30/how-kinect-works-stereo-triangulation/ • http://openkinect.org/wiki/Main_Page • http://mathnathan.com/2011/02/depthvsdistance/ • http://www.ros.org/wiki/openni_kinect/kinect_accuracy • http://eng.au.dk/fileadmin/DJF/ENG/PDF-filer/Tekniske_rapporter/Technical_Report_ECE-TR-6-samlet.pdf • http://social.msdn.microsoft.com/Forums/en-US/kinectsdknuiapi/thread/4da8c75e-9aad-4dc3-bd83-d77ab4cd2f82

More Related