Inferring Semantic Concepts from Community- Contributed Images and Noisy Tags. Jinhui Tang † , Shuicheng Yan † , Richang Hong † , Guo -Jun Qi ‡ , Tat- Seng Chua † † National University of Singapore ‡ University of Illinois at Urbana-Champaign. Outline. Motivation
Jinhui Tang†, Shuicheng Yan †, Richang Hong †, Guo-Jun Qi ‡, Tat-Seng Chua †
† National University of Singapore
‡ University of Illinois at Urbana-Champaign
No manual annotation are required.
Normal Graph Construction.
Sparse Graph Construction.
minw||w||1 , s.t.x=Dw
w ∈ Rn : the vector of the reconstruction coefficients;
x∈ Rd : feature vector of the image to be reconstructed;
D∈ Rd*n (d < n) : a matrix formed by the feature vectors of the other images in the dataset.
* J. Wright, A. Yang, A. Ganesh, S. Sastry, and Y. Ma. Robust face recognition via sparse representation. IEEE Transaction on Pattern Analysis and Machine Intelligence, 31(2):210–227, Feb. 2009
√: correct; ?: ambiguous; m: missing
and we can obtain a refined fl.
Ex3: Inference with Tags vs. Inference with Ground-truth
We can achieve an MAP of 0.1598 by inference from tags in the concept space, which is comparable to the MAP obtained by inference from ground-truth of training labels.
Thanks! Questions? Images and Noisy Tags