1 / 12

Dr. Amy Vanderbilt DrAmyVanderbilt DrV@DrAmyVanderbilt

Evaluation of Interactive Visualisation of Network Dynamics. Dr. Amy Vanderbilt www.DrAmyVanderbilt.com DrV@DrAmyVanderbilt.com. Evaluation of Interactive Visualisation of Network Dynamics. Amy K. C. S. Vanderbilt, Ph.D. TITLE. Outline Network Dynamics The Need for Evaluation

bounds
Download Presentation

Dr. Amy Vanderbilt DrAmyVanderbilt DrV@DrAmyVanderbilt

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Evaluation of Interactive Visualisation of Network Dynamics Dr. Amy Vanderbilt www.DrAmyVanderbilt.com DrV@DrAmyVanderbilt.com

  2. Evaluation of Interactive Visualisation of Network Dynamics Amy K. C. S. Vanderbilt, Ph.D. TITLE Outline Network Dynamics The Need for Evaluation Types of Evaluations Those Pesky Humans IST-085 / RTG -041 Outline QUESTION: what types of visualizations are most effective for discovering, simulating and predicting network dynamics; • Network Dynamics - What do we mean by Network Dynamics • The Need for Evaluation - Why and how the time has come to design portable and repeatable experiments to compare various types of visualizations for these tasks; • Types of Evaluations - What those experiments might entail • Those Pesky Humans – the human element and their effect on visualization research • IST-085 / RTG -041 - Interactive Visualization of Network Dynamics: mission and plans (shameless advertising) WE DO NOT HAVE THE ANSWERS…BUT WE INTEND TO FIND THEM 2 (USA) 571-723-5645 DrV@DrAmyVanderbilt.com

  3. Network Dynamics Amy K. C. S. Vanderbilt, Ph.D. TITLE Outline Network Dynamics The Need for Evaluation Types of Evaluations Those Pesky Humans IST-085 / RTG -041 Definition and Perspective • Changes in structure and topology • Changes in behavior [ network behavior!] • Growth and attrition [changes in the # of nodes] • Changes in density [changes in the # of links and/or links and nodes] • Changes in centrality and other per-node or per-link measures • And more! The changes taking place within a network and the trends within that change. netmorph.org/.../randalk/results/simple-demos/ CHANGE OVER TIME 3 (USA) 571-723-5645 DrV@DrAmyVanderbilt.com

  4. The Need for Evaluation Amy K. C. S. Vanderbilt, Ph.D. TITLE Outline Network Dynamics The Need for Evaluation Types of Evaluations Those Pesky Humans IST-085 / RTG -041 Why Now • Visual Complexity is indexing 623 projects (here are thumbnails of a few) & that is only the beginning • So many visualizations confuse users and prove that the penultimate visualization utility is not yet realized • Network analysis until now has focused on the study and visualization of static snapshot networks • But networks (of any kind) rarely stand still http://www.visualcomplexity.com/vc/ WE CANNOT VISUALIZE REALITY UNTIL WE CAN VISUALIZE DYNAMICS 4 (USA) 571-723-5645 DrV@DrAmyVanderbilt.com

  5. The Need for Evaluation Amy K. C. S. Vanderbilt, Ph.D. TITLE Outline Network Dynamics The Need for Evaluation Types of Evaluations Those Pesky Humans IST-085 / RTG -041 Why Now • Network dimensions and measures change continually over time • And networks interact with other networks which are also changing • Layered networks then take another dimension of inter-layer dynamics • The military and commercial community has not yet found the solution they seek for network analysis because they have not yet found the solution that visualizes the network environment [the dynamic reality of layered networks interacting and changing over time] • Network dynamics is the next step in visualization towards meeting this need • And hundreds of candidate visualizations are soon to arrive (just as they did for static visualization) • How are we to know what aspects of these visualizations are most effective A STRONG BASE OF RESEARCH IS IN PLACE TO TAKE THIS STEP 5 (USA) 571-723-5645 DrV@DrAmyVanderbilt.com

  6. The Need for Evaluation Amy K. C. S. Vanderbilt, Ph.D. TITLE Outline Network Dynamics The Need for Evaluation Types of Evaluations Those Pesky Humans IST-085 / RTG -041 Why Portable and Repeatable? • To test on only one population or culture, or on limited data sets is insufficient to determine the efficacy of visualizations of network dynamics • A truly effective visualization will work well on any domain and with any user • But how can we test on multiple domains, data sets and user types? • We need a portable, repeatable test that can be quickly and easily carried out anywhere in the world WE NEED TO TEST WORLDWIDE ON DIVERSE DATA SETS AND POPULATIONS 6 (USA) 571-723-5645 DrV@DrAmyVanderbilt.com

  7. Types of Evaluations Amy K. C. S. Vanderbilt, Ph.D. TITLE Outline Network Dynamics The Need for Evaluation Types of Evaluations Those Pesky Humans IST-085 / RTG -041 Ideas for Portable and Repeatable Evaluations Here are some starter ideas for what a portable, repeatable evaluation might require or entail: • For portability and repeatability we may have to sacrifice by not testing some forms of interaction: • KAVEs • Glove based interaction • Virtual Reality • etc EACH OPTION COMES WITH PROS AND CONS 7 (USA) 571-723-5645 DrV@DrAmyVanderbilt.com

  8. Those Pesky Humans Amy K. C. S. Vanderbilt, Ph.D. TITLE Outline Network Dynamics The Need for Evaluation Types of Evaluations Those Pesky Humans IST-085 / RTG -041 The User as a Critical System Element • But we cannot forget the USER! • For any visualization system to be useful and effective: • It must convey information to the user and • The user must then be able to do something with that information • Ideally, the user will do that something FASTER or BETTER in some way THE USER IS AN INTEGRAL PART OF THE VISUALIZATION SYSTEM 8 (USA) 571-723-5645 DrV@DrAmyVanderbilt.com

  9. Those Pesky Humans Amy K. C. S. Vanderbilt, Ph.D. TITLE Outline Network Dynamics The Need for Evaluation Types of Evaluations Those Pesky Humans IST-085 / RTG -041 The Undeniable Fact For all these years that we have studied information visualization and network analysis, there is one thing we just cannot get past: FOR THE HUMAN IN THE LOOP, VISUALIZATION OF INFORMATION IS A PERSONAL ARTFORM • Two analysis given the same data and the same question to ask will use two different visualizations and methods to reach the same conclusion • So that means there is more than one path to the answer…Yay! BUT that means that analysts have to be able to tailor their visualizations to suit their own tastes and styles • What this means for our experiment is: how can we conclude what is generally effective when everyone wants something different? VISULAIZATIONS MUST BE TAILORED TO THE USER BY THE USER 9 (USA) 571-723-5645 DrV@DrAmyVanderbilt.com

  10. IST-085 / RTG -041 Amy K. C. S. Vanderbilt, Ph.D. TITLE Outline Network Dynamics The Need for Evaluation Types of Evaluations Those Pesky Humans IST-085 / RTG -041 History This group emerged out of a long history of groups: VISUALIZATION OF INFORMATION REMAINS A TOP PRIORITY FOR NATO COUNTRIES 10 (USA) 571-723-5645 DrV@DrAmyVanderbilt.com

  11. IST-085 / RTG -041 Amy K. C. S. Vanderbilt, Ph.D. TITLE Outline Network Dynamics The Need for Evaluation Types of Evaluations Those Pesky Humans IST-085 / RTG -041 Plans IST-085 will take some new directions: • Develop the required experiments to provide insight into what characteristics of interactive visualizations are most likely to aid the military user in determining and predicting the types of change happening within a network, given various influence factors. • Produce a report detailing the results of these studies. • If feasible, the Group will mount a demonstration giving the opportunity for hands on exploration of interactive visualizations of network dynamics to show the experimental design and reported results. • Extend the network dynamics capability of the framework and survey of IST059/RTG025 • Continue to foster the activities of the visualization network of experts originally created by RTG-002. IST-085 IS EXPERIMENTAL & FOUNDED IN THE FRAMEWORK AND SURVEY OF IST-059 11 (USA) 571-723-5645 DrV@DrAmyVanderbilt.com

  12. IST-085 / RTG -041 Amy K. C. S. Vanderbilt, Ph.D. TITLE Outline Network Dynamics The Need for Evaluation Types of Evaluations Those Pesky Humans IST-085 / RTG -041 Shameless Advertising Upcoming Events • 2008 MEMBER SEARCH • 2009 MEETINGS • Spring – Paris – Group Meeting • Fall – State College PA – N/X Meeting • 2010 MEETINGS • Spring – TBD – Group Meeting • Fall – Las Vegas NV – NATO Sponsored Workshop • …JOIN US! INTERESTED??...CONTACT AMY VANDERBILT AT DRV@DRAMYVANDERBILT.COM 12 (USA) 571-723-5645 DrV@DrAmyVanderbilt.com

More Related