130 likes | 245 Views
This project explores a new system for managing lecture documents using Simple Multimedia Presentation Language (SMPL) to enhance multimedia presentation capabilities within browsers. Our approach addresses the limitations of current browsers in handling multimedia synchronization and annotations while remaining lightweight and secure. SMPL extends existing standards allowing for easy retrieval, navigation, and management of multimedia presentations, making them accessible across different platforms, including the integration of various content types. Our findings aim to inform broader strategies for multimedia repository management.
E N D
Annotation, Retrieval, Synchronization, and Presentation of Lecture Document Ronen Vaisenber, Zohrab Basmajian, Phong Pham, Keith Mogensen, Arjun Satish Mentors: Prof. Sharad Mehrotra, Prof. Ramesh Jain
Research Problem • The problem of browser capability to support multimedia content and synchronization • Browsers stay light weight, secure, and reliable. Hence, not many standards are implemented • Design and Implement a new system to support annotation, retrieval, synchronization, and presentation of lecture documents.
Broader Impact/Research Definition • Why lecture management system? • Unstructured data collected from sensors are much of interest to RESCUE project • There are lots of unstructured data available to us on large scale • What’s the overall broad impact? • Experience gained from this work will give other researchers insight on how multimedia repositories should be managed. For example • Recording of 911 calls • Communication between fire fighters between during big California fires
The Method • SMPL – “Simple Multimedia Presentation Language” • A declarative, script free, definition file that can be generated automatically, and defines multimedia presentation. • It extends SMIL standard, supports W3C standard, and compatible by all browsers. • What’s the benefit of SMPL? • It supports the definition of table of contents • It supports the usage of bookmarks • It supports the definition terms/Search-able keywords • It supports the easy authoring of presentation documents by editing XML file.
Alternative Solutions? • Plug-ins • Application that interacts with a browser to add a specific functionality • An alternative for SMPL • Disadvantage: • The browser is independent of the plug-ins • They have limited interactions with rest of the page’s content • Scripting • Hard to author and maintain • Adding features to the browser’s internal code • It will increase the size of the application and decrease reliability
SMPL – Core Functionalities • Fusion • Synchronization of videos with slides or any other contents such as text or html • Navigation • High level overview by means of table of contents and searchable index/terms • Manageable • Easy to manage by just editing XML file, which defines EVERYTHING in presentation • Accessible • Easy support for all browsers and implemented on top of SMIL standard and follows W3C standards a
Example: MIT Online Course Won’t it be nicer to have a structured document instead of this cluttered page? Information Fusion is Needed:
Conference <?xml version="1.0" encoding="UTF-8"?> <!ELEMENT rak (toc*)> <!ELEMENT toc (toc | smilObject+)> <!ELEMENT smilObject (smil, previewSlides*, bookmark*, keywordList?)> <!ELEMENT smil (#PCDATA)> <!ELEMENT previewSlides (time, (previewSlides | preview))> <!ELEMENT preview (time, comment?, image?)> <!ELEMENT bookmark (time, comment)> <!ELEMENT keywordList (term*)> <!ELEMENT term (time, comment)> <!ELEMENT space (#PCDATA)> <!ELEMENT image (#PCDATA)> <!ELEMENT comment (#PCDATA)> <!ELEMENT time (#PCDATA)> Session 1 Session 2 SMPL - The Lecture Document in XML SMIL – Talk 1 Session 3 Talk 1 Slide 1, t=0 Talk 2 Slide 2, t=5 Bookmark- t=76 SMIL – Talk 2 Introduction, t=0 Slide 1,t=0 Slide 2, t=10 Slide 17, t=114 Conclusions, t=114 Slide 18, t=118 Slide 19, t=120
SURF-IT Experience • Gain research experience, and solve real-world complex projects. • Learn new technologies/concepts such as working with DTD, design XML file, using google web tool kit, Programming in Java Enterprise Edition (J2EE), and etc. • Some of the tasks I have completed during this summer: • Design and Implement SMPL language • Design and Implement Oracle Database schema • Programming in JAVA and Google web tool kit to develop UI Interface and add additional features such as bookmark • Utilized the following technologies: DTD, XML, Google Web Tool Kit, JAVA EE, Oracle database, AJAX, JavaScript, HTML, and etc.
Additional Work? • Is there additional actions beyond this summer effort? • Of Course!!! It’s a research • Some of the actions are” • Utilize web application framework (Spring, Hibernate, Struts) to make the system more maintainable • Generate Web Traffic to truly test the system under heavy traffic by using tools such as JMeter • Add extra annotations and features such as comment area, private bookmarks, and much more. • The current system supports Power Point Presentations. It would be nice to support additional types such as PDF, Flashes, and so on. • List goes on and on……
Congratulations!! • Thanks for SURF-IT and all the coordinators • Special thanks to Ronen, Professor Sharad, Arjun, Keith, and Phong
Demo • Ready for Demo??