PowerPoint Slideshow about 'A powerpoint presentation' - Patman
An Image/Link below is provided (as is) to download presentation
Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.
Display Registration for Device InteractionNick Pears1, Patrick Olivier2, Dan Jackson2Contact email: [email protected] Department of Computer Science, University of York, UK2. Culture Lab, King’s Walk, Newcastle University, Newcastle, UKPresented at VISAPP’09, Madeira, Portugal, January 2008
Lets say you have taken a digital picture using your mobile phone, whilst out walking and you want to transfer this to your PC when you get home.
It would be nice if you could manage all of this process using the phone itself.
Point the phone camera at the ‘My Documents’ folder, tap to select, twist the phone to open the folder, do the same for the ‘My Pictures’ folder, select the digital picture(s) on the mobile phone using the keypad, and push the phone towards the screen to transfer the images from the phone into the PC folder.
You want to get details from an estate agent window, where the properties are displayed on a screen.
Point the phone camera at the property that you are interested in, press the keypad or tap the touch sensitive phone screen, and this triggers the PC connected to the screen to send the property details to your phone wirelessly.
Another action, such as phone push, could trigger an email to be sent to your account, with the property details.
A twist of the phone could open larger images and more details onto the full screen, and so on.
If we can register the correct part of the PC display with the image of that display on the mobile phone, then we have established “display registration”.
This means that, for every pixel on the mobile phone, we know precisely the point on the PC display that it corresponds to or “points to”.
Thus we can choose one pixel, typically the centre pixel of the mobile display, as a pointing device, with which we can initiate any context dependent direct interaction (“push/pull/twist/tap”) with the PC (intelligent display).
Essentially we have a copy of a small part of the PC display on the mobile phone – and so we can interact with this, as if we were interacting directly with the PC screen, by echoing such interactions over the Bluetooth link to the appropriate screen position on the PC.
We developed a ‘write through’ application using a PDA – here you hold the PDA up to the PC screen, with the “MS Paint” application running on the PC. You can write text on the PDA and hand written text is echoed onto the PC to the place on the PC screen that the PDA is pointing to, as if you were writing on the PC screen itself..
A side effect of establishing display registration is that, if the cell phone is calibrated, we can compute the 6 DOF position and motion of the phone relative to the PC screen, and thus have Wii like interaction with the screen.
Typically, this manifests itself as push/pull and twist movements of the mobile phone, which can be detected, even without calibration.
PC moves markers (four green squares) around its screen, while the user points the phone anywhere on the screen.
The phone segments the markers, using colour, and transmits the positions of the centres of the fours squares to the PC.
The PC associates these positions with the centres of the four squares on its screen and computes the plane-to-plane homography between the phone image and PC display.
This homography is then used by the PC to compute where the corners of each individual green square should appear on the PC screen, such that the markers remain approximately constant in position and size on the cell-phone screen.
Marker positions and shapes on the PC screen are updated
For further cycles of the operation, the targets are switched between ‘filled’ and ‘hollow’ so we correctly associate pairs of PC target display position and imaged target position.