1 / 15

DIGITAL DANCING

This exploration delves into the world of depth perception, comparing human versus computer abilities and delving into technologies like infrared depth measurement and Kinect. Learn about the hardware, software toolkits, and techniques used, as well as tips on displaying point data, floor removal, and manipulating shadows. Kate Rafter shares resources for learning trigonometry, linear algebra, and C++ for performance enhancement. Keep progressing by identifying real-world features for projection mapping and depth integration. Contact Ethan Brown and Kate Rafter for more info.

meden
Download Presentation

DIGITAL DANCING

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. DIGITAL DANCING • ETHAN BROWN / KATE RAFTER

  2. What I learned…

  3. SEEING THE WORLD IN THREE DIMENSION Humans are good at understanding depth from a multitude of cues: FAMILIAR SIZE DEPTH PARALLAX PERSPECTIVE RELATIVE SIZE MANY MORE…. STEREOPSIS OCCLUSION CONVERGENCE Computers: not so much.

  4. INFRARED DEPTH MEASUREMENT: A CLEVER CHEAT • Infrared laser projects a pattern of infrared dots • Depth inferred from multiple cues • Kinect uses proprietary technology developed by PrimeSense

  5. HARDWARE Occipital Microsoft STRUCTURE SENSOR KINECT 1 KINECT 2

  6. SKELETON TRACKING • Complicated problem • Uses techniques from artificial intelligence, machine learning, and computer vision • Requires massive amounts of training data

  7. SOFTWARE TOOLKITS • OpenFrameworks (C++) • Cinder (C++) • Kinect .NET SDK (C#) • Point Cloud Library (C++) • OpenNI (C++) • OpenCV (C++)

  8. NODE / JAVASCRIPT • Edge.js makes Kinect SDK available • THREE.js / Canvas 3D / CubicVR • Distinct lack of libraries (OpenCV, PCL)

  9. DISPLAYING POINT DATA • OpenFrameworks / OpenGL • Kinect provides world coordinates; store as vectors (ofVec3f) • Convert point cloud vectors to mesh (ofMesh) • Some effects “accidental” artifacts of mesh rendering

  10. FLOOR REMOVAL • Plane detection with RANSAC algorithm, courtesy PCL • Hooray math! Point/plane distance • Expensive filtering: optimization pays

  11. “EXPLODING” SHADOWS • Easy centroid calculation: • Subtract centroid from each point and normalize: unit vector away from centroid • Scale unit movement vector and add to point to move away from centroid

  12. KATE RAFTER ON TECHNOLOGY AND PERFORMANCE

  13. LEARNING MORE • Trigonometry (Kahn Academy) • Linear Algebra (Kahn Academy) • The C++ Programming Language, 4th Edition • Making Things See by Greg Borenstein • Books on OpenFrameworks and Cinder from Pact Publishing

  14. ONWARD…. • Projector/real-world correspondence • Identify real-world features (with depth and/or visual data)

  15. THANK YOU • ethan.brown@popart.com • @EthanRBrown • k.e.rafter@gmail.com • www.katerafter.com www.popart.com zepln.com/wdne

More Related