Pocket Projectors All-in-one Solution for Mobility, Augmentation, Communication

1. Pocket ProjectorsAll-in-one Solution for Mobility, Augmentation, Communication Ramesh Raskar Senior Research Scientist Mitsubishi Electric Research Labs, Cambridge, MA

2. Pocket ProjectorsAll-in-one Solution for Mobility, Augmentation, Communication Ramesh Raskar Mitsubishi Electric Research Labs (MERL) Cambridge, MA, USA

3. Ultimate Personal Display ? Mitsubishi Electric Pocket Projector DLP based with R, G, B LEDs Instant on, Battery-pack Available Now

4. DLP® 0.55” Chip • LED life >10,000 hours • SVGA 800 x 600 • ~ 250 LUX in brightness • Inputs VGA, RCA & S Video • Battery ~ 2.5 hours • Actual Size: 4.85”W x 1.85”H x 3.82”H • Weight ~ 1 pound (450g)

6. Big Projections… Small Projector… Estimates and Projections Quoted from Various Sources

7. Average Consumer Electronic Adoption Rate • 0.34% during the first year of product introduction • 0.84% during the second year • 1.54% during the third year

8. Problems • Brightness: LEDs and Optics • Price: $699+ • Applications: ?

9. Brightness and Power • More LEDs for illumination • Heat: Better thermal designs • Cost: LEDs are expensive ! • Size: Complex optics for multi-LEDs • White boost • Equivalent to transparent part of color wheel • All 3 R,G,B LEDs on at the same time • Blacks • LED Dimming • Limits • Difficult to match lamp based, AC powered projectors • Need to think about other applications

10. ApplicationsUnderstanding Projector Pro’s and Con’s • Large image with small device • Image overlay on real object • Ideal for augmentation • Superposition of images • Higher resolution, brightness Issues • Ambient bright light • Screens: Affected by display surface reflectance

11. New Opportunities • Aware Projectors • Decoupled display size

12. New Opportunities • Aware Projectors • Decoupled display size • Image Overlay on Real Objects • Decoupled device • Non-planar surfaces

13. New Opportunities • Aware Projectors • Decoupled display size • Image Overlay on Real Objects • Decoupled device • Non-planar surfaces • Machine Projection • Projector for non-display apps

14. New Opportunities • Aware Projectors • Decoupled display size • Image Overlay on Real Objects • Decoupled device • Non-planar surfaces • Machine Projection • Projector for non-display apps

15. Decoupled Image Size • Small group presentations • Pocket monitor • PDA, Digital Camera, Mobile phones, Video iPods • Gaming displays • Portable home theater • Camping entertainment • In-Car entertainment • Compact Tiled Displays (VideoWall)

16. Pocket Projector Developments Pocket Projector 2004-05 iLamps 2002 RFIG Lamps 2003-04

17. Stabilized Desktop-like Interaction Sensor support What components are needed ?

19. Desktop-like Interaction • Mouse Simulation • Cursor follows handheld projector motion • Pre-warped image remains stable

20. Image Quasi-Stabilization Eliminate hand jitter using inertial sensors+camera

21. Absolute Stabilization Image stays registered with world features

22. New Opportunities • Aware Projectors • Decoupled display size • Image Overlay on Real Objects • Decoupled device • Non-planar surfaces • Machine Projection • Projector for non-display apps

23. Changing Texture and Virtual Lighting Raskar, Welch, Low, Bandyopadhyay, “Shader Lamps” (2000)

25. Image Overlay on Objects Raskar, vanBaar, Beardsley et al, Siggraph 2003

26. New Opportunities • Aware Projectors • Decoupled display size • Image Overlay on Real Objects • Decoupled device • Non-planar surfaces • Machine Projection • Projector for non-display apps

27. Machine ‘Projection’ • Images consumed not by humans but by other machines • Project images to assist machine computation • Unique compared to other display technologies Optical Communication Optical Etching Visual coding Robot Guidance Machines Produce images Machines consume images

28. MasklessLithography OpticalResists DLP Micro-mirror array Fast parallel operation on optical resists

29. Optical Networking Gear Parallel Switching and Routing at ~100KHz Fixed diffraction grating + Optical switches

30. Optical Communication Glorified Remote Control + Glorified Laser Pointer Pocket Projector =

31. R F I G R F I D (Radio Frequency Id & Geometry) Photosensing Wireless Tags Find tag location usingPocket Projector Interactive stabilized projection Many geometric ops Siggraph 2004

32. Conventional Passive RFID

33. Using Projector to Interact with Tagged Books in a Library With RFID, get list of books in RF range • With Precise Location Data • Find which books are out of sorted order !

34. Prototype Tag RF tag + photosensor

35. Support for handheld projection + RF Reader

36. RFIG: Finding Tag Location and Image Overlay Siggraph 2004

37. Directions for PocketProjector • ‘Personal’ display • Shrinking portable devices that carry more data • Opportunity to switch between personal and public • Modular • Low cost mass market product • Will become building block • Platforms: TV, Stereoscopic, Advertising, VideoWalls etc • Process: Tiling, Jittering, Superposition, Steering

38. Mitsubishi Pocket Projector • Mobility • Limited Brightness but new Applications • All-in-one • Display large with small device size • Augment image overlay on real objects • Communicate with tagged world (RFID, Sensors) • Collaborate using shared projection raskar@MERL.com

39. Mitsubishi PocketProjector™LED-Based DLP® Projector

40. END