Lyu0302 pvcais personal video conference archive indexing system
Download
1 / 10

LYU0302: PVCAIS-Personal Video-Conference Archive Indexing System - PowerPoint PPT Presentation


  • 98 Views
  • Uploaded on

LYU0302: PVCAIS-Personal Video-Conference Archive Indexing System. Background Videoconference is becoming popular Participants wish to keep videoconference archives for the later reference Normal video and audio files are neither searchable nor helpful to recall their contents

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' LYU0302: PVCAIS-Personal Video-Conference Archive Indexing System' - junius


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Lyu0302 pvcais personal video conference archive indexing system
LYU0302: PVCAIS-Personal Video-Conference Archive Indexing System

  • Background

    • Videoconference is becoming popular

    • Participants wish to keep videoconference archives for the later reference

    • Normal video and audio files are neither searchable nor helpful to recall their contents

    • Indexing of videoconference archives has not been investigated till now


Lyu0302 pvcais

Phase I System

Phase II

Phase III

LYU0302: PVCAIS

  • Objective: develop an experimental system with the following architecture.


Lyu0302 pvcais1
LYU0302: PVCAIS System

  • Phase I: Media acquisition (3~4 months)

    - Study the mechanism and media format of a videoconferencing client to obtain media data.


Architecture of h 323 based videoconference system

MCU System

MC

MP0-n

Architecture of H.323-Based Videoconference System

PBN

Terminal

Terminal

A/V, Data, Control

Terminal

Terminal


Structure of h 323 terminal

UDP+RTP/IP System

Video CODEC

H.261, H.263

Video I/O

Audio CODEC

G.711, G.723

Audio I/O

PBN inter-face

GUI

Data application:

Text chat & whiteboard

User CODEC

T.120

System control CODEC

H.245, H.225

TCP/IP

Structure of H.323 Terminal

  • A terminal (videoconferencing client) interacts with users, encode/decode/render media streams, and communicates with MCU.


What we ll do to a terminal

UDP+RTP/IP System

Video CODEC

H.261, H.263

Video I/O

Audio CODEC

G.711, G.723

Audio I/O

PBN inter-face

GUI

Data application:

Text chat & whiteboard

User data CODEC

T.120

System control CODEC

H.245, H.225

TCP/IP

Text file

Whiteboard file

Video file

Audio file

What we’ll do to a terminal?

  • Intercept media streams and store them in files.

    • Video/Audio: intercept encoded streams

    • Text/Whiteboard: intercept decoded streams


Lyu0302 pvcais2
LYU0302: PVCAIS System

  • Phase II: Media info retrieval (3~4 months)

    • Select a group of algorithms to implement the multimedia-indexing functions.

      • Face detection & recognition

      • Speech recognition

      • OCR

      • Title generation

      • Keyword selection


Lyu0302 pvcais3
LYU0302: PVCAIS System

  • Phase II

    - Integrate these functions to generate an XML index file for each videoconference.

    - Create and manage the file system of indexed archives.


Lyu0302 pvcais4

Searching Playback

Figure 4. An example GUI of PVCAIS

LYU0302: PVCAIS

  • Phase III: GUI (2 months)

    • Implement a GUI of PVCAIS to:

      • Search in indexed videoconference archives.

      • Synchronized playback of a selected conference.


Required techniques for phase i
Required Techniques for Phase I Playback

  • Source code of H.323 videoconference system (outsourcing)

  • H.323 knowledge

    • Structure of terminal

    • H.263 video CODEC

  • Visual C++

    • Multithread

    • DirectSound

    • GUI programming


ad