250 likes | 254 Views
An Image Retrieval System with Automatic Query Modification. Source: IEEE Transactions on Multimedia 2002 Authors: Gaurav Aggarwal, Ashwin T. V. and Sugata Ghosal Speaker: Chih-Yang Lin. Problem. DB. Desired image. internet. Problem. Overhead in database search
E N D
An Image Retrieval System with Automatic Query Modification Source: IEEE Transactions on Multimedia 2002 Authors: Gaurav Aggarwal, Ashwin T. V. and Sugata Ghosal Speaker: Chih-Yang Lin
Problem DB Desired image internet
Problem • Overhead in database search • Communication over the WWW based on client-server environments
Color Region Segmentation • LUV (applied in TV system proposed by CIE)
Color clustering Test image RGB space HSV space LUV space
Color region segmentation Original image Over-segmented
Color region segmentation (cont.) Hopfield network Region merged Shape regularized
General image segmentation Over segmentation
Feature extraction • Average LUV color of the segment (color) • Seize (shape) • Orientation axis (position) • Three central moments (shape) • Invariant to translation, rotation and scale change • Texture information
Central moments • The first central moment is the distribution average • The second central moment is the variance • The third and fourth moments about the mean are used to define the stadardized moments used to define skewness and peakedness
Segment modification • Color modification • Flip colors values • Position modification • Size modification • Orientation modification
Experiments Without intra-query learning Color modification
Experiments (cont.) Choose multi-objects
Experiments (cont.) Without intra-query learning
Experiments (cont.) User feedback Reject rotated horse
Experiments (cont.) After the first iteration of learning
Experiments (cont.) After the second iteration of learning