slide1 n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
Connect with your PowerPoint Presentation
Download Presentation
Connect with your

Loading in 2 Seconds...

play fullscreen
1 / 45

Connect with your - PowerPoint PPT Presentation


  • 100 Views
  • Uploaded on

Connect with your. Wow!. 3D Depth Sensors. Microphone Array. Motorized Tilt. RGB Camera. openkinect.org. www.openni.org. kinectforwindows.org. Kinect for Windows. Xbox Kinect. You’ll need this. That’s not USB. What you Need. SDK. Demo 0 Hello Tilt. BGR32 Format. Byte Array:.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Connect with your' - habib


Download Now An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
slide11

3D Depth Sensors

Microphone Array

Motorized Tilt

RGB Camera

slide12

openkinect.org

www.openni.org

kinectforwindows.org

slide14

Xbox Kinect

You’ll need this

That’s not USB

slide16

Demo 0

Hello Tilt

slide17

BGR32 Format

Byte Array:

4 Bytes Per pixel

Stride= Bytes Per Row

= bytes per pixel * width

= 4 * width

width in pixels

height in pixels

slide18

Demo 1

Hello Colorful World

slide19

Depth data

500mm

500mm

500mm

500mm

500mm

500mm

500mm

2500mm

2000mm

2000mm

2030mm

2010mm

slide20

Depth data

Max resolution for raw depth data is 640 x 480

2 bytes per pixel of depth data (short)

  • 000

00001

11101010

11011110

00001

11101010

  • 000
  • 000

00000

pixel

pixel

pixel

depthInMM = pixel >> DepthImageFrame.PlayerIndexBitmaskWidth

slide21

Demo 2

Depth

slide22

Depth + Player Data

SkeletonStream.Enable();

player 1

player 1

player 1

player 1

500mm

500mm

500mm

500mm

player 1

player 1

player 1

500mm

500mm

500mm

2500mm

2000mm

2000mm

2030mm

2010mm

var player = pixel & DepthImageFrame.PlayerIndexBitmask;

11011110

00001

  • 010
slide23

Demo 3

Depth + Player Data

slide25

from skeleton inskeletonFrame.Skeletons

whereskeleton.TrackingState == SkeletonTrackingState.PositionOnly

skeletonFrame.Skeletons

skeletonFrame.Skeletons

whereskeleton.TrackingState == SkeletonTrackingState.Tracked

slide26

hand_right

hand_left

head

wrist_right

wrist_left

shoulder_center

elbow_left

elbow_right

shoulder_left

shoulder_right

Skeleton.Joints[JointType]

spine

hip_right

hip_left

hip

center

Joint.Position (X,Y,Z)

Skeletons are mirrored

X, Y, Z in meters

Origin(0,0,0) = center of camera.

+Z is out

+X is to the right

+Y is up

knee_right

knee_left

ankle_right

ankle_left

foot_left

foot_right

slide27

Demo 3

Skeletal Tracking

slide28

Composites

+

+

Color

slide29

Composites

Color

+

MapSkeletonPointToColor

MapDepthToColorImagePoint

Color

+

MapDepthFrameToColorFrame

MapDepthToSkeletonPoint

+

MapSkeletonPointToDepth

slide30

Demo 4

Green Screen

slide34

Echo Cancellation

  • EchoCancellationMode: None, CancellationOnly, CancellationAndSuppression
  • intEchoCancellationSpeakerIndex: Index of speaker to cancel
slide36

Noise Supression

  • boolNoiseSuppression – true, false
slide38

Automatic Gain Control

  • boolAutomaticGainControl– true, false
slide40

Beam Forming

0.875 radians

50 degrees

-0.875 radians

-50 degrees

.0175 radians

10 degrees

slide41

Demo 5

Speech Recognition

slide42

Audio @!%!#!! Gotchas

Must run in an MTA

AEC SystemModes crash if no speaker output.

Use Microsoft.Speech not System.Speech

DevicePairGuid / Qualitymetrics= crash

Should run in ThreadMode Priority Highest?

Must plug Kinect into Wall

slide43

Demo 6

Beam Forming

slide44

Kinect SDK 1.5!

Seated Skeletal Tracking

Kinect Studio

Face Tracking

Joint Rotation

creative commons acknowledgments
Creative Commons Acknowledgments
  • Flickr by Ian Lewis
  • Flickr by major nelson
  • Flickr by markodesign
  • Flickr by stephantom
  • Flickr by Abstract Machine
  • Flickr By Aixo.co.kr
  • Flickr By Andresmh
  • Flickr by Antony Bennison
  • Flickr by Ars Electronica
  • Flickr By bm.iphone
  • Flickr by campuspartymexico
  • Flickr by Chris Jagers
  • Flickr By ci_polla Paola Sucato
  • Flickr by creepyhalloweenimages
  • Flickr by cvander
  • Flickr by IMAL.org
  • Flickr by Institut Douglas
  • Flickr by Joshua and AmberFlickr by Logon Sakai
  • Flickr by openexhibits
  • Flickr by Paul_Clarke
  • Flickr by petyr.rahl
  • Flickr by pt
  • Flickr by Stilldavid
  • Flickr by y3rdua
  • Flickr by yesyesnono
  • Flickr by yum9me
  • Flickr by Jeff Howard
  • Flickr by jhscreenwm
  • Flickr by Kyle McDonald
  • Flickr by Morten Rand-Hendriksen
  • Flickr by Stuart Herbert
  • Flickr by Visiophone
  • Flickr by orkomedix
  • Michael Zöllner and Stephan Huber at the University of Konstanz
  • Openclip by J_Alves
  • Openclip by jetxee
  • Openclip by molumen
  • Openclip by shokunin
  • Openclip by Jhnri
  • Openclip by Machovka
  • Adafruit image of Hector Martin

Thanks!!