Visualization and Interaction Research

1. Visualization and Interaction Research Mary Czerwinski VIBE Team

2. Overview • Large display ideas • Small displays and novel interaction techniques • Novel visualization techniques • Future directions

3. Overview—Large Displays • Large display ideas • VibeLogger • GroupBar • Scalable Fabric • Wincuts • Table Cloth • Small displays and novel interaction techniques • Novel visualization techniques • Future directions

4. VibeLogger: 2 research paths • 1st activity repository for studying windows usage in aggregate • Can profile users based on display size • Can be extended to visualize workflow and capture context • Drive design decisions • Single user: capture task contexts to surface pertinent UI or provide reminders

5. Multitask Visualization • Colored block for each time point and app • Amount of shading indicates percentage of visibility of the window • Tasks • Subtasks

6. Task Switching Visualization • Switching tasks (red to blue) • How are email windows arranged and used? • compare to...

7. Windows and Task Management Issues Emerge • Larger displays = more open windows • Multimon users arrange windows spatially • Taskbar does not scale: • Aggregation model not task-based • Users can’t operate on groups of related windows

8. Changes in Window Access

9. Task Management: GroupBar • Taskbar for lightweight grouping of windows • Allows for multiple bars, spatial placement of bars • ~400 internal downloads • Desktop snapshotting; task snapshots

10. Task Management: Scalable Fabric • Configurable central focus + peripheral context • Easy task switch from periphery to focus area • Leverages human spatial memory • Patented, 100s of downloads

11. Large Displays WinCuts: Initial Motivation • Problems: • Sharing live windows/information is hard • Screen space is scarce and laying out information optimally is hard

12. Large Displays Animated advertisement Region of interest Seldom used interface buttons Scrolling ticker Specify Region of Interest

13. Large Displays Rescale WinCut so graph scales are comparable Relevant content Organize Content

14. Large Displays Relevant interface elements Relevant content Reconfigure Interfaces

15. Large Displays Sharing WinCuts across Machines • Click on “Share” • Specify destination (also running WinCuts) • WinCut appears on destination machine • Remote WinCuts work just like local WinCuts • Except input redirection disabled

16. Large Displays Share Content when Collaborating

17. Large Displays Cell Phone Laptop or TabletPC PDA Now we’re Thinking… • With remote input redirection working: • Create ad hoc remote controls and interfaces • Work across displays and devices Desktop

18. Large Displays Table Cloth • Problem: • User wants to access content physically far away • Solution: • Pan the desktop to user • Compress content to the right of focus • Grab content you need and snap back

19. Overview—Small Displays • Large display ideas • Small displays • Patrick: Semantic Thumbnailsand Collapse-to-zoom • Novel interaction techniques • Mary and Francois Guimbretiere:Tactile Scrollbar • Patrick: Snap-and-go • Novel visualization techniques • Future directions

20. Small Displays readable unreadable semantic thumbnails Video of UX

21. Small Displays 10 8 6 4 2 + 0 14 12 10 8 # of zooming events 6 4 2 0 Thumbnail Semantic Thumbnail 30 20 Total vertical scroll 10 0 TN ST SC DT a # of participants Thumbnail Semantic Single Column Thumbnail User Study • submitted to CHI’05

22. Small Displays expand collapse Collapse-to-Zoom UIST’04

23. Small Displays …so you need to turn it off …can get in your way… snap-and-go works without deactivation snap location b enlarged in motor space only Snap-and-Go traditional snapping snap location a inaccessible inaccessible

24. Small Displays snap-and-go: user study • three studies • overall ~ 16,000 repetitions • submitted to CHI’05

25. Small Displays Tactile Scrollbar

26. Small Displays Tactile Scrollbar Submitted to CHI ‘05

27. Overview—Info Vis • Product impact: technology transfer • External impact: publication and other activities • Large display ideas • Small displays and novel interaction techniques • Novel visualization techniques • DateLens • FishNet • PaperLens • HIPS • Future directions

28. DateLens with Ben Bederson • Fisheye representation of dates • Compact overviews • User control over the view • Integrated search (keyword)  • Enables overviews, fluid navigation to discover patterns and outliers • Integrated with Outlook

29. “player” player ishnet • problem • does this page containthe search term “player”? • hard to say—long webpages are clipped • solution: fishnet • compresses off-focus content (fisheye view) • popouts preserve search terms in context • entire webpage & search terms in one view

30. Info Vis • Helps to understand: • Topic evolution • Frequently published authors • Frequently cited papers/authors • Relationship between authors • 1st place prize at Info Vis 2004 • Scaled up to 25 years of CHI proceedings • Submitted to CHI ‘05 PaperLens

31. Info Vis Human Interactive Proofs (HIPS)

32. HIPS—CHI ‘05 Example of Thick Arcs that don’t Intersect plus Baseline, levels 0 (ABCDEFGH), 18 (VCM9DNXS), and 36 (HPTX7YNX)

33. Future VIBE Directions • Basic research on visualization and interaction • Scale visualization to ACM DL • SW visualization to aid program comprehension w/Deline, Larus, Venolia • Memex project with Gemmel, Bell • Continued evaluation and iteration of designs • Interaction with multiple devices and displays • Brain-computer interaction • More information: http://msrweb/vibe

34. Thank you for your attention!