html5-img
1 / 18

Context for low-level saliency detection

Context for low-level saliency detection. Devi Parikh , Larry Zitnick and Tsuhan Chen. For what can context be used?. So far higher level tasks What about lower level tasks? Picking out salient (representative) patches in an image?. SVM. Sample image. Build histogram. Classify. ?.

eris
Download Presentation

Context for low-level saliency detection

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Context for low-level saliency detection Devi Parikh, Larry Zitnick and Tsuhan Chen

  2. For what can context be used? • So far higher level tasks • What about lower level tasks? • Picking out salient (representative) patches in an image?

  3. SVM Sample image Build histogram Classify ? Sample image Set up Bag-of-words paradigm

  4. Saliency • Interest point detectors • [Lowe 2004, Harris 1988, Kadir-Brady 2001, etc.] • Uniform • Discriminative • [Nowak et al., ECCV 06, Vidal-Naquet et al., ICCV 2003] • Contextual • Co-occurrence based • Relative location based

  5. Contextual saliency • Occurrence based Association of patch i to word a Association of patch j to word b Likelihood of word b given word a Normal distribution Normal distribution MLE from images • Similarly, relative location based

  6. coast forest highway inside-city mountain open-country street tall-building cars bicycles motorbikes people Datasets [Oliva Torralba IJCV 2001] Pascal-01

  7. Features Scene recognition Color information Some gradient information inherent Object recognition SIFT

  8. Results

  9. Results

  10. Saliency maps

  11. Saliency maps

  12. Sampling strategies • Sorting • Random sampling • Sequential sampling

  13. Sequential sampling

  14. Sequential sampling

  15. Sequential sampling

  16. Results

  17. Contributions • Context can be leveraged for low-level tasks • Outperform several existing saliency measures • Sparse representation was found to be more accurate

  18. Discussion • Discrminative vs. contextual saliency • Saliency is a subjective term: task and domain dependent • Representative (usual) • Interesting (unusual) • Generic defintion: Informative • Contextual saliency is unsupervised but is dataset dependent

More Related