Multi-Model Digital Video Library

1. LYU9904 Presentation Multi-Model Digital Video Library Supervisor: Prof. Michael Lyu Jacky Ma Team members: Joan Chung

2. Presentation Outline • Project Aims • Introduction of Digital Video Library • Introduction of Our Work • Considerations and Approach • Design and Implementation • Future Plans

3. Project Aims • Learn different issues about DVL • existing such as Informedia(TM) done by CMU • Implement a small-scale model • Client interface for playback of media • Process data source/user queries in Chinese • Web Integration

4. Introduction of Digital Video Library • Functions of a DVL • Why Digital Video Library? • Issues about DVL • Techniques Addressing DVL Issues

5. Functions of a DVL • Storage and play back of video resources • Online access of video resources • Search of useful information through the vast data collections • Retrieval of the most relevant selections

6. Why Digital Video Library? • Digital data • easy to process in an automated way • takes advantage of the Internet • Multimedia content • more attractive • for education, training, sports and entertainment • Library management • An organized way of retrieval media contents

7. Issues about DVL • Building Video Databases • Indexing the Video Contents • Breaking the Video into Segments • Retrieving Video

8. Building Video Database • Extremely large space requirement • Choosing a video format • Online access of video resources

9. Indexing the Video Contents • Inaccessibility of information in video • Limitation of text-base descriptions • Tedious manual process • Cinematic information is complex to describe

10. Breaking the Video into Segments • Video paragraphing • Alternate representation of video • Text tile • Text abstract • Full-text transcript • Representative single image • “Skim” video

11. Retrieving Video • Three principle for searching • Let user to skim the video object quickly with their interest • Adjust the size of video • Identify of desired video among multiple returned results • Ways to achieve • Small size of video returned • Information visualization

13. Overview of Digital Video Library System

14. Techniques Addressing DVL Issues • Speech Analysis • Speech recognition technology generates transcript • Pauses and silence in audio help paragraphing • Image Analysis • Detect significant changes in weighted color histogram • Interpret camera motion • Natural Language Processing • Query processing • Retrieval

16. Our Work • Focus and Target • Programming Environment • Design and Implementation • System Consideration • System Design • System Implementation • Future Plans

17. Focus and Target • Divide the project into modules that can be implemented in stages • digital video preparation • video playback • user query • web-integration

18. Programming Environment • Platform • Java as programming language • JMF API to present time-base media

19. Why use Java? • Platform independence • Network ready • International appeal • Easy to build GUI • JMF API for video playback • Disadvantages?

20. Presenting Time-Base Media with JMF • What is JMF? • Java Media Framework Application Programming Interface • Incorporating media data into Java • The high level architecture • Similar to traditional VCR • Data Source • Pull data-source and Push data-source • Media Presentation • Programmed or Interactive controls

21. Design and Implementation • System Consideration • System Design • System Implementation

22. System Consideration • User Perspective • User friendly • Other system component are transparent • Server Program • Robust, reliable • Network Issue • Video Collections

23. System Design

24. System Implementation • Library Preparation • Server Program • Client Program

26. Future Plans • Java-applet Client Program • Semi-auto Timestamp Editing Tools • Searching and Indexing Capability • Other Possible Extensions • Automatically derived transcripts • Language processing of queries and transcripts • Content-based Image Manipulation