Visualize Textual Travelogue with Location-Relevant Images
Download
1 / 18

Xin Lu 1, Yanwei Pang 1, Qiang Hao 1, Lei Zhang 2 1 Tianjin University Corresponding Author 2 Microsoft Research Asia - PowerPoint PPT Presentation


  • 176 Views
  • Uploaded on

Visualize Textual Travelogue with Location-Relevant Images. Xin Lu 1 , Yanwei Pang 1 *, Qiang Hao 1 , Lei Zhang 2 1 Tianjin University * Corresponding Author 2 Microsoft Research Asia November 3, 2009. Outline. Motivation & Challenge Our Solution Framework Overview Data Source

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Xin Lu 1, Yanwei Pang 1, Qiang Hao 1, Lei Zhang 2 1 Tianjin University Corresponding Author 2 Microsoft Research Asia ' - terra


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Slide1 l.jpg

Visualize Textual Travelogue with Location-Relevant Images

Xin Lu 1, Yanwei Pang 1*, QiangHao1, Lei Zhang 2

1 Tianjin University

* Corresponding Author

2 Microsoft Research Asia

November 3, 2009


Outline l.jpg
Outline

  • Motivation & Challenge

  • Our Solution

    • Framework Overview

    • Data Source

    • Demo

  • Conclusions and Future Work


Outline3 l.jpg
Outline

  • Motivation & Challenge

  • Our Solution

    • Framework Overview

    • Data Source

    • Demo

  • Conclusions and Future Work


What is a travelogue l.jpg
What is a travelogue

  • What is a travelogue

    • Text/article that records one's travel experience

  • Where can we/you find travelogues

    • Blog, forum, Web2.0 community, etc.

  • What's the travelogue's difference from other text

    • User-generated content (UGC), rather than expert's articles large amount and booming informative to other tourists


Why we visualize the travelogue l.jpg
Why We Visualize the Travelogue

  • Travelogues are huge knowledge resources

    • People share others’ experience by reading travelogues online

  • Textual Travelogues

    • Long and noisy

    • Probably be written in foreign languages

  • Travelogue Visualizing

    • Highlight the useful information

    • Visualize the useful information


Why travelogue visualization is difficult l.jpg
Why Travelogue Visualization is difficult

  • Travelogue De-noising

    • Location-oriented

    • Context words

  • Image Retrieval and Ranking

    • Semantic Gap between texts and images


Outline7 l.jpg
Outline

  • Motivation & Challenge

  • Our Solution

    • Framework Overview

    • Data Source

    • Demo

  • Conclusions and Future Work


Slide8 l.jpg


Similarity measures l.jpg
Similarity Measures

  • Log-Model & Log-tag Model

    • Log refers to travelogue

    • Context words

Great Wall: ancient times; stable; impregnable pass; No.1 in the world

Sanya Bay: sea sight; beach; sea food


Similarity measures10 l.jpg
Similarity Measures

  • Tag-Model

    • Tags also are UGC

    • De-noise tags

Topic Space


Data source l.jpg
Data Source

  • 100K travelogues (automatically)

    • All written in Chinese

    • Downloaded from Ctrip

    • GPS data and English Name for the most popular 10K locations

  • 2500K images (automatically)

    • Flickr 950K (plenty of tags)

    • Picasa 300K (little tags)

    • *Google 1200K (includes snippets of the image)


Slide12 l.jpg

  • We add 1200K images (includes snippets of the image) from Google

  • Flickr images are retrieved based on location

  • Google images are retrieved by “context words+ location”, which makes candidate images sets more relevant to the travelogue


Slide13 l.jpg

http://202.113.2.198

  • Images are ranked based on the following three points:

  • image quality

  • log-tag similarity

  • Image diversity




Outline16 l.jpg
Outline

  • Motivation & Challenge

  • Our Solution

    • Framework Overview

    • Data Source

    • Demo

  • Conclusions and Future Work


Conclusions and future work l.jpg
Conclusions and Future Work

  • Travelogue visualization benefit common people

    • Travelogue is more easily to understand

    • People all over the world benefit from others’ experience to plan trips

  • Future work

    • Further narrow the semantic gap using visual features

    • Improve evaluation approaches


Thank you l.jpg

LBSN’ 2009

Nov.3, 2009, Seattle, WA, USA

Thank you!


ad