Ideixis-Image-Based Deixisfor Finding Location-Based Information Konrad Tollmar, Tom Yeh and Trevor Darrell MIT CASAIL
Scenario Hsiaowei is visiting campus for the first time ever. She is supposed to meet Lilu at 傅鐘. She is uncertain if this place is the 傅鐘. She takes an image of the bell in front her and sends it to the server.
Scenario This image is then used to search the web of pages that also contain images of this bell. The server returns the 5 most relevant web pages. By browsing these pages. She identifies the name 傅鐘 and concludes that this is the right place.
First Prototype • User takes an image of the location. • The image is then sent to a server via MMS. • 16 most relevant candidate images will be returned. • Selecting a candidate image brings up the associated web page.
Experiment • The database consists of 12,000 web images collected from the mit.edu domain. • Test query images were obtained by asking student volunteers to take a total of 50 images from three selected locations. • Images were collected on different days and with somewhat different weather conditions.
Deixis • In pragmatics and linguistics, deixis (Greek: δειξις display, demonstration, or reference, the meaning "point of reference" in contemporary linguistics having been taken over from Chrysippus, Stoica 2,65) is a process whereby words or expressions rely absolutely on context.