A multimodal dialogue-driven interface for accessing the content of recorded meetings. Agnes Lisowska ISSCO/TIM/ETI University of Geneva IM2.MDM
A multimodal dialogue-driven interface for accessing the content of recorded meetings
ISSCO/TIM/ETI University of Geneva
Work done in collaboration with: Martin Rajman, Mirek Melichar, Trung H. Bui (LIA & CGC at the EPFL) and Marcin Bogobowicz (graphic artist)
The data content of recorded meetings
Audio and video
tracking project progress
tracking employee performance
catch up on a missed meeting
learn about a projectThe Problem
What type of interface?
“The bottom line is that the tool should be designed around the needs of the user to allow for effective and efficient use of the application.”(Scanlon and Percival, IBM)
Who will the users be?
What tasks will users be doing?
Which modalities? Which combinations?
Type of dialogue strategy?
Degree of user control?
Types of data
System driven (dialogue system)
Mixed initiative (dialogue system + user control)
Designed based on user requirements content of recorded meetings
Interaction metaphor: using a library or archive
library is the database of meetings
each book in the library is a single meeting
Preliminary version allows for
many different modalities
full range of interaction styles
speech via speech recognition
text via keyboard or pen
penThe Archivus System
System control buttons
Constant view of database (search space)
Natural language input feedback
Access to multimedia
Interactive search definition buttons
Problem: Denis told you that there was a discussion about red sofas for the ISSCO lounge and you want to know more about it.
User Requirements Studies
Meeting Domain: Preliminary Indications from a Query Analysis Study. Project Report IM2.MDM-11, November 2003, 30 pages.
The Archivus Interface
Related Machine Learning Algorithms, Martigny, Switzerland, 8 p.