slide1 n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
HISA: A Query System Bridging The Semantic Gap For Large Image Databases PowerPoint Presentation
Download Presentation
HISA: A Query System Bridging The Semantic Gap For Large Image Databases

Loading in 2 Seconds...

play fullscreen
1 / 1

HISA: A Query System Bridging The Semantic Gap For Large Image Databases - PowerPoint PPT Presentation


  • 64 Views
  • Uploaded on

HISA: A Query System Bridging The Semantic Gap For Large Image Databases Gang Chen Xiaoyan Li Lidan Shou Jinxiang Dong Chun Chen Department of Computer Science, Zhejiang University, P.R.China. INTRODUCTION. IMPLEMENTCOMPONENTS.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'HISA: A Query System Bridging The Semantic Gap For Large Image Databases' - tevin


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
slide1

HISA: A Query System Bridging The Semantic Gap For Large Image Databases

Gang Chen Xiaoyan Li Lidan Shou Jinxiang Dong Chun Chen

Department of Computer Science, Zhejiang University, P.R.China

INTRODUCTION

IMPLEMENTCOMPONENTS

We propose a novel system called HISA for organizing, browsing and searching in very large image databases. HISA implements the first known data structure to capture both the ontological knowledge and visual features for effective and efficient retrieval of images by either keywords, image examples, or both. HISA employs automatic image annotation technique, ontology analysis and statistical analysis of domain knowledge to pre-compute the data structure. Using these techniques, HISA is able to bridge the gap between the image semantics and the visual features, therefore providing more user-friendly and high-performance queries. We present a two-phase query algorithm based on the HISA structure.We demonstrate the novel data structure employed by HISA, the query process, and the pre-computation results.

HISA system is implemented mainly trough three self-governed as well as interrelated components: Annotator, Top-Ontology Constructor and Domain-Feature Selector.

THE ONTOLOGICAL TREE STRUCTURE

The ontological knowledge is captured in a tree structure, where each node represents a category of the images that it indexes. Additionally, each leaf node contains a point to an Atomic Semantic Domain (ASD), which is implemented as a VA-File containing the visual feature information. The following figure shows a simple sketch of the HISA-structure. Nodes in the high-levels of the ontology tree are more generic semantics, while nodes in the lower levels are much more domain-specific.

SYSTEM INTERFACE DISPLAY

Query By Keyword

The Main Query Interface

Query By Image Example

THE TWO-PHASE QUERY PROCESS

The first phase of a query uses the high-level ontology structure, which is stored in a tree structure, to search for relevant nodes which contain generic image semantics. The relevant nodes can be located efficiently. The second phase searches for images using data which we call ASDs (Atomic Semantic Domain) referenced by the leaf nodes of ontology tree. The second-phase search is based on similarity comparison of the pre-computed dominant visual features of the indexed images. For large image datasets, this two-phase query technique achieves high retrieval accuracy without compromising the query speed. The reason for comparing visual features in the second phase is that we observe visual comparison is effective only when the semantics of the images being compared are well correlated. We note that HISA implements the first known data structure to capture both keyword semantics and visual features in a hierarchy and to answer a query.

The Hierarchical Semantic Organization Browse Tree

One Example of The Extendable Mechanism for HISA Structure: Add One Specific Semantic Node