ken hinckley shengdong zhao raman sarin patrick baudisch edward cutrell michael shilman desney tan n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
InkSeine: i n situ search for active note taking PowerPoint Presentation
Download Presentation
InkSeine: i n situ search for active note taking

Loading in 2 Seconds...

play fullscreen
1 / 37

InkSeine: i n situ search for active note taking - PowerPoint PPT Presentation


  • 98 Views
  • Uploaded on

Ken Hinckley, Shengdong Zhao, Raman Sarin, Patrick Baudisch, Edward Cutrell, Michael Shilman & Desney Tan. InkSeine: i n situ search for active note taking. r. oronto. In situ s earch for digital ink. InkSeine : Ink + Seine -n: a fishing net -v: to fish with a seine

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'InkSeine: i n situ search for active note taking' - cicily


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
in situ s earch for digital ink
In situ search for digital ink
  • InkSeine :
    • Ink +
    • Seine
      • -n: a fishing net
      • -v: to fish with a seine
    • = insanely cool ink search!
  • InkSeine lets the user fish for useful information directly from ink notes.

Fishermen catching salmon on the Columbia River using a seine.(courtesy Wikipedia)

active note taking
Active note taking
  • XLibris—pen-based system for active reading(reading + critical thinking + learning)
  • InkSeine combines pen-based note taking with searching, linking, collecting & sensemaking:

ActiveNote Taking

  • Sketch designs
  • Reflect on a topic
  • Capture & extend creative ideas
core interaction pattern ink search gather
Core interaction pattern: Ink-Search-Gather
  • Ink – excels at capturing user’s thoughts & ideas with minimum distraction from formatting issues

Ink

Search

Gather

ink search gather interaction pattern
Ink-Search-Gather interaction pattern
  • Search – digging through the file system on a tablet is really a pain
    • Active note taking benefits from low overhead access to supporting materials & related docs
    • Focus on personal search, but support Web as well

Ink

Search

Gather

ink search gather interaction pattern1
Ink-Search-Gather interaction pattern
  • Gather – Make it easy to use what you find by pulling content directly into unstructured notes
    • Thumbnail hyperlinks to documents
    • Clippings from documents
    • Queries that can be revisited later

Ink

Search

Gather

ink search gather interaction pattern2
Ink-Search-Gather interaction pattern
  • InkSeine unifies these three elements in a fluid user experience that is integrated directly with inking

Ink

Search

Gather

i n situ search
In situ search
  • Leverage preexisting ink to initiate search
    • No context switch to “search app” – stay in the flow
    • No tedious transcription of text to a “search box”
  • Queries as first class objects, commingled with ink notes
    • Flag some ink for search for later
    • Visible and salient search history as part of notes
    • Queries can be copied, pasted, moved, etc.
  • Interleave inking, searching & gathering
    • No barrier between inking / searching – note ideas while searching, side-by-side searching, span app boundaries for content gathering
  • Tightly couple queries with application content
    • Queries naturally persist in originating context
    • Easy re-visitation of prior queries
    • Results of queries become new content
rich tradeoffs in cost structure of sensemaking
Rich tradeoffs in cost structure of sensemaking
  • Continuum of time cost – can defer at any point:
    • 1 second: Capture thought “I should search on this”
    • 5 seconds: Trigger search & see initial results list
    • 10-20 s: Open a doc from result list or drag result into notes
    • 20 s-2 minutes:
      • Scroll through list and inspect details of results
      • Apply filters, revise query
      • Grab a snapshot from a short document
      • Correct occasional ink reco errors – Tablet’s reco is amazingly good!
    • Longer: sufficient depth for common info needs; not mired by last 10% of complex queries that require full featured search tools
      • Inspect result documents to see if they meet information needs
      • Sideways searches based on Title, Date, or Author of a result
findings
Findings
  • Existing desktop search tool difficult to use
    • Difficult text entry
      • Enter and correct text
findings1
Findings
  • Existing desktop search tool difficult to use
    • Difficult text entry
      • Enter and correct text
    • Annoying context switch and flow interruption
      • Switch among apps and context
findings2
Findings
  • Existing desktop search tool difficult to use
    • Difficult text entry
      • Enter and correct text
    • Annoying context switch and flow interruption
      • Switch among apps and context
    • Tedious information gathering
      • Difficult to link to documents and gather pieces of information
breadcrumb
Breadcrumb

Breadcrumb

query area
Query Area

QueryArea

(CueTIP)

result list
Result List

Result List

result list1
Result List

Result List

Focus Result

gestures for filters
Gestures for Filters

Cross – Multi-select

Tap - Select

Cross & Turn Right – Exclude

Disjunctive cross – Multi-select

directed work flow
Directed Work Flow

Selection

Correction

Search

design issue 1 discovery
Design Issue 1: Discovery
  • Gesture discovery problem
  • Highlighter hints
design issue 2 occlusion
Design Issue 2: Occlusion
  • Context preservation & occlusion problem
  • Smart positioning of search panel
design issue 3 poor reco
Design Issue 3: Poor Reco
  • Recognition problem for out-of-vocabulary words
  • Personalized vocabulary from desktop search index

UIST

?

List?, Dist?, Gist?, Mist?, Hist?

summary
Summary
  • In situ search experience
  • Tailored to pen input
  • Optimum workflow / maximum flexibility
  • Multiple ways to gather content
  • Minimize search screen real estate
  • Span application boundaries