Analysis of scores datasets and models in visual saliency modeling
This presentation is the property of its rightful owner.
Sponsored Links
1 / 19

Analysis of scores, datasets, and models in visual saliency modeling PowerPoint PPT Presentation


  • 107 Views
  • Uploaded on
  • Presentation posted in: General

Analysis of scores, datasets, and models in visual saliency modeling. Ali Borji, Hamed R. Tavakoli, Dicky N. Sihite, and Laurent Itti,. Toronto dataset. Toronto dataset. Toronto dataset. Toronto dataset. Toronto dataset. Visual Saliency. Why important? Current status

Download Presentation

Analysis of scores, datasets, and models in visual saliency modeling

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Analysis of scores datasets and models in visual saliency modeling

Analysis of scores, datasets, and models in visual saliency modeling

  • Ali Borji, Hamed R. Tavakoli, Dicky N. Sihite, and Laurent Itti,


Analysis of scores datasets and models in visual saliency modeling

Toronto dataset


Analysis of scores datasets and models in visual saliency modeling

Toronto dataset


Analysis of scores datasets and models in visual saliency modeling

Toronto dataset


Analysis of scores datasets and models in visual saliency modeling

Toronto dataset


Analysis of scores datasets and models in visual saliency modeling

Toronto dataset


Visual saliency

Visual Saliency

  • Why important?

  • Current status

  • Methods: numerous / 8 categories (Borji and Itti, PAMI, 2012)

  • Databases:

  • Measures:

    • scan-path analysis

    • correlation based measures

    • ROC analysis

How good my method works?


Benchmarks

Benchmarks

  • Judd et al. http://people.csail.mit.edu/tjudd/SaliencyBenchmark/

  • Borji and Itti https://sites.google.com/site/saliencyevaluation/

  • Yet another benchmark!!!?


Dataset challenge

Toronto

MIT

Le Meur

Dataset Challenge

  • Dataset bias :

  • Center-Bias (CB),

    • Border effect

  • Metrics are affected by these phenomena.


  • Tricking the metric

    Tricking the metric

    Solution ?

    • sAUC

    • Best smoothing factor

    • More than one metric


    The benchmark fixation prediction

    The Benchmark Fixation Prediction


    The feature crises

    Features

    Low level

    High level

    people

    car

    intensity

    color

    symmetry

    orientation

    signs

    depth

    text

    size

    The Feature Crises

    Does it capture any semantic scene property or affective stimuli?

    Challenge of performance on stimulus categories

    &

    affective stimuli


    The benchmark image categories and affective data

    The Benchmark Image categories and affective data


    The benchmark image categories and affective data1

    The Benchmark Image categories and affective data

    vs 0.64(non-emotional)


    The benchmark predicting scanpath

    aAdDbBcCaA

    aAcCaA

    aAcCbBcCaAaA

    ….

    The Benchmarkpredicting scanpath

    aAbBcCaA

    aA

    dD

    bB

    cC

    bBbBcC

    matching score


    The benchmark predicting scanpath scores

    The Benchmarkpredicting scanpath (scores)


    Category decoding

    Category Decoding


    Lessons learned

    Lessons learned

    • We recommend using shuffled AUC score for model evaluation.

    • Stimuli affects the performance .

    • Combination of saliency and eye movement statistics can be used in category recognition.

    • There seems the gap between models and IO is small (though statistically significant). It somehow alerts the need for new dataset.

    • The challenge of task decoding using eye statistics is open yet.

    • Saliency evaluation scores can still be introduced


    Analysis of scores datasets and models in visual saliency modeling

    Questions ??


  • Login