1 / 39

Activity presentation

Activity presentation. Director: Jean Caelen (DR CNRS) Vice-Director : Catherine Berrut (Prof. UJF). Jean.Caelen@imag.fr www-clips.imag.fr . Institutions. UMR 5524. Research Topics. Man-Machine Interaction(s) Collaborative interactions with machines Speech, Image, Language Processing

cyrah
Download Presentation

Activity presentation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Activity presentation Director: Jean Caelen (DR CNRS) Vice-Director : Catherine Berrut (Prof. UJF) Jean.Caelen@imag.fr www-clips.imag.fr

  2. Institutions • UMR 5524

  3. Research Topics • Man-Machine Interaction(s) • Collaborative interactions with machines • Speech, Image, Language Processing • E-Learning • Perceptive Rooms and Augmented Reality • Multimedia Document Indexing • Man Machine Interaction Engineering • Speech Recognition and Natural Language Dialogue • Collaborative and Multimodal Interfaces • Information Retrieval • Machine Translation • Language Processing

  4. Structure Direction • Technical staff • Maintenance • Projects • Research • ARCADE • GEOD • GETA • IIHM • MRIM Direction council Laboratoty council • Administration • Secretariat • People Management • Financial • Subsistance • Communication • Valorisation • MultiCom People : 72 (staff + PhD students) UJF, CNRS, INPG, UPMF, US

  5. Research Teams ARCADE (J.P. Peyrin, prof. UJF) e-Learning (Ateliers de Réalisation et de Conception d’Applications Destinées à l’Education) GEOD (J.F. Serignat, MCF INPG) Speech Group (Groupe d’Etude sur l’Oral et le Dialogue) GETA (C. Boitet, prof. UJF) Machine Translation Group (Groupe d’Etude sur la Traduction Automatique) IIHM (J. Coutaz, prof. UJF) Man Machine Interaction Engineering (Ingénierie de l’Interaction Homme-Machine) MRIM (M.F. Bruandet, prof. UJF) Multimedia Information Retrieval (Modélisation et Recherche d’Informations Multimédia)

  6. People 1/1/2002 Regular Staff73 (a) Profs + Researchers 29 (b) Engineers + Admin. 11 (c) PhD + Post-docs 26 (d) Under contracts7 (e) Masters and others24 (g) Invited10 Total 107

  7. Technological transfert MultiCom : Usability platform for the design and the evaluation of interactive systems Start-up creations 1998 : NOVADIS, ergonomics, cognitive engineering 1999 : ARLYS (MENRT, CARMI, Microsoft, Axe et Cible), e-learning, education software development 2000 :DMAILER, e-mail indexing and processing

  8. MultiCom • Technological Platform : • To study human factors in situated tasks • To design and evaluate innovative and interactive services (or systems) • by, • Real usage experimentation • Simulation (Woz for instance) • Partnership • Linguists, Sociologists, Ergonomists User centered

  9. Relationship and contracts • MultiCom • 6 industrial : (Schneider, France-Télécom, Leti-CEA, STM), • 2 european : SIRLAN IST 5th PCRD, ADAMOS, Finlandia • 2regional : SHIVA RRA 99 et Thématique 2000 • Research • 6 industrial : (Thalès, France-Télécom, EDF, Alcatel) in RNRT, RNTL, CTI CNET, DGA • 2 international: C-STAR, UNL (17 countries) • 5 european : NESPOLE, TACIT, TIPS, ARIADNE, GLOSS, CAMELEON, FAME • 3research networks : CNRS (french networks) • 2 regional • 5local (C-STAR, RICOM, RESIDE-HIS, EPIC, e-Xpérience)

  10. Projects

  11. Multi-team projects C-STAR/NESPOLE! :Face to face speech translation (GEOD, GETA) RICOM :Multimodal interaction for Multimedia information retrieval (GEOD, IIHM, MRIM) Smart Rooms :disable people monitoring, home services… (GEOD, IIHM) FORMID :e-learning, virtual teaching (ARCADE, IIHM)

  12. Dialogue, multilinguism C-STAR & Nespole! C-STAR : Consortium for Speech Translation Advanced Research (Japan, Corea, USA, Germany, Italy, France) NESPOLE! (IST project) : NEgotiating through SPOken Language in E-commerce

  13. Projet C-STAR Speech translation Applications to : tourism, hot line, e-commerce

  14. 2 ways possible speaking Speech recognition source IF coding Translation texte IF Generation target listening Speech synthesis

  15. Interchange Format • Meaning representation • Based on • Speech acts • What to want or to do • Concepts • What to say • Arguments • Discourse predicates • give-information • +availability+room • room-type=(single ; double)

  16. The 22th july 1999 at Grenoble

  17. RICOM : Halpin & CoVitesse RICOM :Information Retrieval: Interactive, Collaborative and Multimodale HALPIN :Man-Machine Dialogue CoVitesse :Information Representation

  18. What have you on ... e, artificial intelligence ? I found 1206 documents on the topic  artificial intelligence. Do you want refine your research ? HALPIN Man-Machine Dialogue : speech recognition + dialogue management + information retrieval + speech synthesis

  19. History of dialogue Outputs Documents Input Speech Recognition Speech Buttons

  20. Collaborative surfing Trace of navigation Document annotation Session control Collected documents

  21. Perceptive room RESIDE-HIS :Smart Home for disable people COMEDI :Informal Communication

  22. RESIDE-HIS

  23. Réseau Téléphonique Public Modem H Telemonitoring Home bus Modem Physiological and biological sensors Microphones Monitoring on : Events Alarms Statistics

  24. Plan HIS

  25. CoMedi : Informal communication Awareness, Focus Feed-back control Feed-back, privacy control Acces control

  26. Curtain Example of filters EigenSpace Poster

  27. EigenSpace filter: Main Component Analysis Image base Eigen Space Eigen vector ArgMin(distance) Image captured Image to send

  28. e-Learning FORMID : FORmation Interactive à Distance Magic Board :Collaborative Space and augmented reality

  29. FORMID FORMID :Toolkit for teaching by example I learn what I do. GeneSimu Oasis

  30. Magic Board

  31. Platform for design and evaluation of interactive systems MultiCom

  32. Observations Task analysis Design Software design Development Lifecyle

  33. Objectives To anticipate the usage and to predict the usability To design and to evaluate interactive systems along the lifecycle using Participatory design method And simulation techniques (as Moz) for the experimentation and the test

  34. A good starting point : enrich the first idea Taking into account all the criteria about (a) sociological, (b) ergonomical, (c) economical, (d) technological points of view Functions Diagnostic Observation Idea Specifications Mockup Validation Evaluation Scenario

  35. Sociology… • Practice analysis • Usage meaning • By questionnaire • By interviews • By recording practices • Applying sociological criteria •  Recommendations for the design

  36. Ergonomics... • Simulation, Woz, Scenarios… • Test human perceptive • Test human behavior (after capture) under definite and limited scenarios • Task and activity analysis •  Recommendations for the design

  37. The first cycle ends… • Functionalities definition • Design constraints • Criteria Evaluation definition • Specifications • Then development can start along a second iterative cycle

  38. The hardware platform Devices for observation User Control video Multimedia recording Interactive devices Wizard 1 Wizard 2

  39. Conclusion… CLIPS-IMAG is… • A research lab on interactive systems • Open on the technological transfert • Focused on user centered design methods

More Related