Human Computer Interaction Query by Sketch. Chi-Ren Shyu. Department of Computer Engineering and Computer Science University of Missouri-Columbia Columbia, MO 65211, U.S.A. Query by Sketch -- an HCI topic?.
Department of Computer Engineering and Computer Science
University of Missouri-Columbia
Columbia, MO 65211, U.S.A.
Spatial Query by sketch http://www.spatial.maine.edu/~max/RL.html
Query: “Retrieve database images that have similar lesion-landmark location with the sketched query (image)”
Anatomical landmarks in HRCT lung:
Lesions vs. landmarks:
Why these three lesions should be retrieved?
(0.00, 1.00)Spatial Modeling from Sketches - 3
What about multiple landmarks with multiple lesions?
Semantic or so-called ontology is very subjective and user-oriented. Not good for “general purposed” database retrieval. GREAT for Sketches!
The hope is: Sketches might be able to bring more desirable retrieval results from user’s aspects.
Sketch bronchial structures on an organ template and fill
gray scales to different part of the object, such as bronchial
Walls and lumens.
Users sketch on many training images
and form a semantic tree structure
for future retrieval.
For fuzzy gangs, this looks familiar. We can form
membership functions for the semantic
terms by using user’s Sketches.
Ranking database images by semantics
FROM LungImageDatabase I
WHERE SIM( SKETCH(Qid,GUI), I.FE(iid)) < threshold
ORDER BY SIM;
A possible SQL extension for QBS:
Query by sketch is not new, however, it has high potential for many applications, especially in the areas of diagnostic image database, GIS, criminal investigation, etc.
In the CECS department, we have many existing research projects that are highly correlated to the concept of QBS. We should have some sort of synergistic efforts to have some interesting projects in the near future.