280 likes | 359 Views
Join our team in developing a cutting-edge system using infrared technology for gesture interaction and augmented reality. Our emphasis on teamwork and communication ensures progress through bi-weekly meetings and frequent online conversations. We utilize tools like Skype, Git, and Dropbox for efficient collaboration. Achievements include IR glove technology, floor projection, LED mapping, and more. Our design process focuses on gesture interactions and IR filters/camera integration. With success criteria in mind, we aim for a user-friendly system with minimal assistance requirements and accurate gesture recognition. Join us on this innovative journey to enhance digital catalog experiences!
E N D
IENV3000 Prototype Team Chang “Simply revolutionary.” - Plato
TEAMWORK • Emphasis on communication • At least bi-weekly meetings in person (usually more) • Skype/IM conversations very frequently • Work split into small groups (2 people) • Version control for code (git) • Dropbox to share files and collaborate
Where We’re At Now [achievements] • IR Glove and Modes of interaction • IR Recognition • Floor projection • Mapping LED position to projected objects • When LED turns on, the code can map it as a mouse
Design process • Gesture Interaction • IR Filters/Camera • Glove Construction
Gesture Interaction • Use of context may have user carry around the catalogue iPad • This means user can only perform gestures with one hand
Gesture Interaction • Move: 1 hand grip • Rotate: 2 hand grip and rotate • Delete: On virtual catalogue
INFRARED Filters / Camera Kinect IR light up to 10 meters
Infrared Recognition Motion data Motion data
Design Application Classes in AS3 extend Sprite
Success Criteria • Conceptual: • Most people can interact with minimal assistance • Majority of users spend > 1 minute using system • Most people can learn the interaction in >30 seconds • Technological: • Users don’t need assistance to put on gloves/arm straps • Accurate mapping of IR/Fluid motion (>0.5s delay) • No shadows that inhibit use of system • Every user can move and rotate with intended gestures
Where we aim to get • Digital catalogue functioning on portable device • Catalogue can add/remove products to floor space • Acquire 3D models • Augmented Reality • Polishing existing work
Interaction Plan [demo] • Put on gloves and catalogue • Select products from catalogue • Move/Rotate objects by grabbing and moving hands • View augmented 3D models on screen
Links/Background Research • OpenKinect - http://openkinect.org/wiki/Main_Page • AS3Kinect - http://www.as3kinect.org/ • LED series/parallel array wizard - http://led.linear1.org/ • Led.wizProjection Calculator Pro - http://www.projectorcentral.com/Dell-S300-projection-calculator-pro.htm • Augmented Reality - http://www.youtube.com/watch?v=1jaXk4Z1OgM • QR codes - http://www.youtube.com/watch?v=tWHYnuB7OYw • Floppy as IR Filter - http://hackscape.wordpress.com/2010/11/27/using-a-floppy-disk-as-an-ir-filter/