1 / 26

Kinect Interface

Project By: Brent Elder, Mike Holovka, Hisham Algadaibi. Kinect Interface. What is our project about?. Design an interface for Window 7 Controlled by the Microsoft Kinect Device. Why?. Gesture based interaction between humans and computers have seen a large growth in popularity

babu
Download Presentation

Kinect Interface

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Project By: Brent Elder, Mike Holovka, HishamAlgadaibi Kinect Interface

  2. What is our project about? • Design an interface for Window 7 • Controlled by the Microsoft Kinect Device

  3. Why? • Gesture based interaction between humans and computers have seen a large growth in popularity • To start developing towards interfaces that adapt more to humans • Get beyond the traditional input devices • Break into the field of gesture recognition

  4. Goals • Gesture Recognition • Software that will translate our gestures and movements recorded by the Kinect into commands that will control our interface • Voice Recognition • Applications • An array of different interface components and applications that will respond our gestures

  5. Who is it for? • We are the clients • Research into the field of Human – Computer interaction • Benefit our future careers • Help to inspire future students

  6. How? • Kinect SDK • Rainmeter: Desktop Customization Tool

  7. Hardware RGB Camera 3D depth sensors Multi-array microphones Motorized tilt

  8. What is Kinect SDK? • Programming toolkit • Drivers • Rich APIs for raw sensor streams • Languages

  9. Concept Video

  10. Features • Raw sensor streams • Skeletal tracking • Depth Data • Advanced audio capabilities

  11. Rainmeter • Desktop Customization Tool • Allows you to place fully customizable widgets on desktop • Range from monitoring system resources to controlling media player • Run shell commands • Free and open source • Source Code available at Google Project site • Vocab

  12. Rainmeter Plugins • Plugins: • .dll file which provides additional functionality not included in installation • Plugins are developed using C# or C++ • Same as Kinect SDK • Development team includes plugin template file • On Google Project Site

  13. Rainmeter Plugins Continued • Also include toolkit (Rainmeter.cs) which provides the necessary development tools • Soon to be Wiki page up for plugin development as well

  14. Success Criteria • Creation of software that will translate predefined gestures into commands • Interface that will respond accordingly to those commands • Learning experience

  15. Risks • Programming difficulties • Not enough time to finish all features • Kinect SDK in Beta 2 • Inaccuracy of the Kinect Device • Incapability of Kinect SDK with Rainmeter

  16. Design

  17. Planned Gestures • Hand moving (Mouse movement) • One Finger Click (Left mouse click) • Two Finger Click (Left mouse double click) • Horizontal and Vertical Swipe motion • Grab and hold (ex. Dragging files) • Keyboard command short-cuts

  18. Planned Voice Commands • Kinect Activate • Kinect Deactivate • Kinect Shutdown • Kinect Restart • Kinect Sleep

  19. Data Modeling • Not a database driven system • Gestures will be identified within the code • Voice commands may be able to be store in a database

  20. Functional Requirements • Accept input from the Kinect sensor • Ability to interpret different hand gestures • Ability to interpret different voice commands • Simple mouse control • A variety of different applications that are part of the interface. • The interface will recognize at most two hands and one person

  21. Gantt Chart - Research

  22. Gantt Chart – Development Phase 1

  23. Gantt Chart –Development Phase 2

  24. Gantt Chart – System Testing/Refactoring

  25. Division of Labor • We are all knowledgeable with code development • We will each be working on every level of the project • Work will be divided evenly among us

  26. Questions?

More Related