1 / 21

Multimedia Description based on MPEG-7: Extraction and Applications

Multimedia Description based on MPEG-7: Extraction and Applications. Authors: Frank Nack Adam T. Lindsay Presented By: Samrat Shah. Need for MPEG-7. Rapid increase in digital audio-visual information.

dayo
Download Presentation

Multimedia Description based on MPEG-7: Extraction and Applications

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Multimedia Description based on MPEG-7: Extraction and Applications Authors: Frank Nack Adam T. Lindsay Presented By: Samrat Shah

  2. Need for MPEG-7 • Rapid increase in digital audio-visual information. • Fundamental problems like how fast and easily can desirable information be made available.

  3. History of MPEG • Different MPEG Standards: - MPEG-1: Standard for storage and retrieval. Nominal data stream compression rate of about 1.2MBPS. Separate streams for data, audio and video. - MPEG-2: Extends MPEG-1 by adding five full bandwidth channels. It strives for a higher resolution of about 100MBPS. Also known as the digital television standard.

  4. MPEG Standards (Cont…) - MPEG-4: Standardized technological elements enabling the integration of the production, distribution and content access paradigms of digital TV, interactive multimedia and graphics applications. - MPEG-7: Addresses aspects such as facilitating interoperability and globalization of data resources and flexibility of data management.

  5. MPEG-7 Overview • Also known as Multimedia content description interface. • Aim – “Facilitate interoperability and globalization of data resources and easy data management”. • Includes more data types. • Standardizes a core set of quantitative measures of audio-visual features, called Descriptors (D).

  6. MPEG-7 Overview (Cont…) • Description Schemes(DS) describes structures of descriptors and their relationships. • Also standardizes Description Definition Language(DDL) to specify DS. • Can index and search for audio-video material that has MPEG-7. • Search can include still pictures, graphics, 3D models, audio, speech, etc. and how these elements combine in a MM presentation.

  7. MPEG-7 Content Description • What is Content Description? • Many different ways to describe an entity • Different possible aspects to describe an audio-visual content: - Medium-based - Physical - Perceptual - Transcription - Architectural - Annotative

  8. MPEG-7 Two major issues: 1) Extraction 2) Applications

  9. MPEG-7 Data Extraction Description Production Description Consumption

  10. MPEG-7 Data Extraction • Increased volume of audio-visual materials are created, digitized and archived. • Fast extraction, i.e. search and retrieval is necessary. • MPEG-7 focuses on the standardization of a common interface for describing multimedia materials.

  11. Text Index Text Query Search module Submitted Results MPEG-7 Data Extraction • Text Extraction: - Create an Index - Apply the Text Query - Search the data repository for the Index - Return the results

  12. MPEG-7 Data Extraction • Video Extraction involves: - Creating Index for Text and Image/Clip - Searching the data repository for the Text Index and Image/Clip Index - Aggregating the result produced - Return the aggregate result

  13. Text index Visual Feature index Search module Search module Text Query Video/Image example Ranked Results Ranked Results Aggregation module SubmittedResults MPEG-7 Data Extraction

  14. MPEG-7 Applications Some of the many applications of MPEG-7 are: History: - Radio, TV, and films provide detailed accounts of many contemporary events - Using MPEG-7, user can provide sufficient precise description of the events and characters - These events can be queried based on dates, places, personalities, etc…

  15. MPEG-7 Applications (Cont…) Arts (music, theater): • Fine-grained, standardized descriptions can bring a selection of relevant documents • Users can compare several productions of a theatrical scene or musical work using MPEG-7. • Because classic and contemporary theater are widely available I translation, this application can target worldwide audiences.

  16. MPEG-7 Applications (Cont…) Film music: - MPEG-7 provides enough material to improve the user’s ability understand the relationship between two medias. - The system provides guided or supported experiments such as editing film, mixing sound, or combining both, which requires that the system analyze and criticize the results. - Thus, the system automatically generate sound sequences and their synchronization.

  17. MPEG-7 Applications (Cont…) Surveillance: - Suppose a camera monitors sensitive areas, and the system triggers an action if some event occurs. - MPEG-7 is used to build the database from limited information and accumulate a video database or metadata as time elapses. - MPEG-7 helps in deciding on the current data using the accumulated database or prior known data.

  18. MPEG-7 Applications (Cont…) Other useful application areas of MPEG-7 are: - Education - Tourist information - entertainment (searching for games, karaoke, etc..) - Investigation services (human characteristics recognition, forensics, etc…) - Geographical information systems

  19. MPEG-7 Applications (Cont…) - Surveillance (traffic control, safety testing in hostile environments, etc…) - Biomedical applications - Shopping (searching for clothes you like) - architecture, real estate, and interior design - social applications (such as dating services) - and many more…

  20. Conclusion • MPEG-7 began a scheme for making audio-visual material as searchable as text. • It describes multimedia content • Manages and ensures data flexibility • Globalizes data resources

  21. Thank You Questions???

More Related