1 / 13

MUMIS User Group Workshop

MUMIS User Group Workshop. P. Wittenburg Max-Planck-Institut für Psycholinguistik Nijmegen. Agenda. 11.00 Introduction Peter Wittenburg ASR Aspects Helmer Strik NLP/IE Aspects Thierry Declerck 11.45 Demo of Prototype Peter Wittenburg 12.30 Lunchbreak

dalmar
Download Presentation

MUMIS User Group Workshop

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. MUMISUser Group Workshop P. Wittenburg Max-Planck-Institut für Psycholinguistik Nijmegen

  2. Agenda • 11.00 Introduction Peter Wittenburg ASR Aspects Helmer Strik NLP/IE Aspects Thierry Declerck • 11.45 Demo of Prototype Peter Wittenburg • 12.30 Lunchbreak • 13.15 Potential of MUMIS Technology Discussion • 14.00 Typical Questions Discussion • 15.00 Other Points of Interest Discussion • 15.30 End

  3. Objectives • MUMIS is about • Technology development to automatically index lengthy multimedia recordings Find and mark interesting scenes • Technology development to exploit indexed multimedia archives Search for interesting scenes and play them via Internet • Test Domain: Soccer Games / UEFA Tournament 2000

  4. Off-line Tasks • Indexing by • Automatic Speech Recognition (Radio/TV Broadcasts) Transfer the speech signals into texts automatically • Natural Language Processing Take all texts (newspapers, speech transcript, tickers, ...) and determine interesting scenes • Create a database with formal annotations • Use video processing to adjust time marks

  5. Newspaper Text Newspaper Text Newspaper Text Newspaper Text Newspaper Text Newspaper Text Newspaper Texts 3 Languages Close Captions 3 Languages Radio Commenting 3 Languages Radio Commenting 3 Languages Radio Commenting 3 Languages Audio Commenting (TV, Radio) 3 Languages Off-line Tasks indexed video recording

  6. Event Table

  7. On-line Tasks • Searching and Displaying • Search for interesting events with formal questions Give me all goals from Overmars shot with his head in 1. Half. Event=Goal; Scorer=Overmars; Cause=Head; Time<=45 • Indicate hits by thumbnails & let user select scene • Play scene via the Internet & allow scrolling Of course: slow motion, fast play, start/stop, etc

  8. On-line Tasks Knowledge Guided User Interface & Search Engine München - Ajax 1998 München - Porto 1996 Deutschland - Brasilien 1998 Play Movie Fragment of that Game

  9. On-line SW Architecture • first interaction with Web-server • download of applet • contact between applet and distributed Java server via RMI • contact via media server via RMI and media streaming • annotations from DB or file server • JMF serves for merging of streams on client • Abstract Corpus Model • this kernel is operational • (distributed and local)

  10. Media Server RAID 100Mbps MM Stations Notebook 1Gbps FC Switch GB Switch Gb-Switch Tape Library 3.5 TB Internet Media Server 2nd location Mirror site Tape Library 25 TB On-line HW Architecture • efficient & reliable storage management • (near-line capacity, media change, 2. Location) • high storage capacity (n TB, 1 h MPEG1 = 1 GB) • powerful media servers / powerful network

  11. Gain • What gets lost? Is it necessary? • Potential: direct Internet Service, less dependencies

  12. Formal Aspects • Start: 1.7.2000 • Duration: 30 Months • EC-Funds: 2.4 Mio Euro • Consortium • CTIT University of Twente, Enschede, NL NLP/IE • TSI University of Nijmegen, Nijmegen, NL ASR • DFKI Saarbrücken, D NLP/IE • MPI Nijmegen, NL Online Part • DCS University of Sheffield, UK NLP/IE • ESTEAM Gothenburg, SE (location Athens, GR) Translation Software • VDA Hilversum, NL Dissemination

  13. Acknowledgements • UEFA • DFB, FA, KNVB • EBU, WDR, NOS

More Related