CARE-INO ANIMS: Animation and Sound in ATC Human Machine Interfaces

1. CARE-INO ANIMS:Animation and Sound in ATC Human Machine Interfaces December 6, 2005 • Céline Schlienger IntuiLab, celine@intuilab.com • Christophe Mertz IntuiLab, mertz@intuilab.com • Yves Rinato Intactile Design, rinato.y@intactile.com • Claire Ollagnon Intactile Design, ollagnon.c@intactile.com

2. Outline • The ANIMS project: why, who? • ANIMS Phase 1 • ANIMS Phase 2 • Available results • Remaining work

3. ANIMS: why? “Improving the efficiency and safety of ATM user interfaces with visual animations and sound” More efficient interfaces through better • communication from machine to user • communication between users

4. ANIMS: who? • Eurocontrol • Project steering • ATC & HMI experts • IntuiLab • HMI and Human-factor centre of expertise (R&D) • ATC background • Intactile Design • graphical and sound designers for HMIs • Domain experts • Human-factors experts (Eurocontrol, CENA)

5. ANIMS: Phase 1 • Year 2004 • State of the art • Animation: definitions, models, techniques, typical uses, human factors • Sound: definition, typical uses, human factors • Five ATC scenarios and five corresponding demonstrations

6. Notification of changes (flight sequence) More information (STCA) Alarms differentiation (STCA&TCAS) Reduce cognitive load (Watermarking) Reducing information overload (Line0)

7. ANIMS Phase1 conclusions • Animations and sound are powerful • Several applications to improve situation awareness • New design spaces: • Many possible animations types • ATC relevant sounds • Storyboards for prototyping and describing animation and sound

8. Open questions... • Benefits are intuitive, not proven • From storyboards to specifications? • Implementation, architecture, retrofit? • Better understanding of sound design needed • Design dimensions • Design elements and context • Reusable designs patterns for animations in ATC?

9. Stakes for Phase 2 • Formally assess human-factor benefits of animations and sounds • Be ready to develop such interfaces • From definition phases… • … to operational development

10. ANIMS: Phase 2 • Years 2005 and 2006 • Objective 1: Specification and tools • How to specify animations and inclusion of sound in animations (2005) • propose animation development tools (2006) • Objective 2: Experiments • assess the benefits of animations and sounds in user interfaces Obj1 Obj2

11. Obj1 Specification Method • Propose methods and techniques to share animations and sound specifications between designers and developers • Progression: • Method for animation only • Applied by motion designers • Integration of sounds in specification of animation

12. Obj1 Specification method for animation Visual aspects Technical aspects Temporal aspects

13. Obj1 Specification method Proof of concept • Applied on 3 examples: • specified by designers • implemented by programmers

14. Obj1 Specification Method Integration of sound • Sounds in animations: • Opening, sustaining, closing • Restricted to pre-recorded sound • Add-ons (objects, sequencing, storyboarding) Starts Plays Stops

15. Obj1 Available results • Specification method for animation and sound • Will be used to specify the conditions of the experiment • Animation only • Animation + sound • …may need wider validation

16. Obj2 Experiments • Assess human-factors benefits of animation and sound • Formally • In complex animated interfaces • In credible experimentation context

17. Obj2 Experiments 2005 2006 1 2 3 4 5 6 4 Applications development 1 Animation design and sound context 2 5 Experiments Choose the experiments Analysis of experiment results and conclusions 3 6 Define experimental protocol

18. Obj2 Animation Design 1 • Problem: • Code object type or group objects • using colors (flight status) • using animations (alerts) • Avoid “Christmas tree effect” • Solution:  Structure animated displays by giving a personality to graphical objects

19. Obj2 Set of isolated animations 1 • Entrance of a graphical object in the scene

20. Obj2 Set of isolated animations 1 • Expression of the state of the object

21. Obj2 Set of isolated animations 1 • Automatic movements of the objects

22. Obj2 Set of isolated animations 1 • Interaction with other objects

23. Obj2 Demonstrations of usein ATC context 1 En-Route Traffic Planner List of Ground Mobiles Clearances on ground

24. Obj2 Sound Context 1 • Realistic experimental conditions • Recreate realistic ATC room atmosphere • Design and test sounds in context  Recordings in ATC rooms

25. Obj2 Roissy IFR Bordeaux CRNA Recordings in ATC rooms 1 • Filtering and mixing • Sound scenarios • Low/High sound activity • EnRoute/Departure/Arrival

26. Obj2 Choice of the experiments 2 • State of the art • Expected benefits • Experimentation methods • Workshop on ‘how to assess’ • Situation Awareness • Single user performance • Group performance • 8 experiments proposed, 2 chosen

27. Obj2 Experiment 1 3 • Conditions: • nothing • blinking • animations • sound • + combinations

28. Obj2 Experiment 2 3 No animation With animation Nothing Blinking Animations Sound Averty ATM05 – CENA - NR05/534

29. Obj2 Available results • Experimental protocol for 2 experiments • Set of animations • Sound scenarios for demonstrations, training, sound design • 14 hours of recording

30. Remaining work: Specification and tools  Propose tools for animation development in accordance with specification method • Study on software architecture and models • Integration in software tools • Test in the development of the experiment prototypes

31. Remaining work: Experiments • Sound and animation specification • Development • Experiments • Result analysis and conclusions

32. Other perspectives • Sound: extract isolated typical ATC sounds • Recreate any ATC room atmosphere • Simulate unexpected situations • Animation: • Assess benefits of animation on single user and group performance • Role of animations in direct manipulation

33. For more • Come to the show room and • meet us for more details • see demos and posters • Connect to : http://www.eurocontrol.int/care-innov/public/standard_page/innov2_anims.html http://www.eurocontrol.int/care-innov/public/standard_page/care2_projects2005.html

34. Documents • Specification Method for Animation and Sound • Animated Themes or How to give a personality to graphical objects? • ATC Sound Samples Library • Assessing human-factors benefits of animation • Experimental protocol