Real time networking data voice and video
Download
1 / 53

Real-Time Networking: Data, Voice, and Video - PowerPoint PPT Presentation


  • 100 Views
  • Uploaded on

Real-Time Networking: Data, Voice, and Video. Dan Schonfeld Multimedia Communications Laboratory ECE Department University of Illinois Chicago, Illinois. Multimedia Communications Laboratory Rashid Ansari Ashfaq Khokhar Dan Schonfeld Oliver Yu.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Real-Time Networking: Data, Voice, and Video' - mabyn


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Real time networking data voice and video

Real-Time Networking:Data, Voice, and Video

Dan Schonfeld

Multimedia Communications Laboratory

ECE Department

University of Illinois

Chicago, Illinois


Multimedia communications laboratory rashid ansari ashfaq khokhar dan schonfeld oliver yu

Multimedia Communications LaboratoryRashid AnsariAshfaq KhokharDan SchonfeldOliver Yu

A Vision To The Future!Real-Time High-Quality Global Video Communications over High-Speed Networks


Research areas

Research Areas

Video NetworkingVideo TrackingVideo Retrieval


Video networking

Video Networking

Collaborators:Rashid Ansari (UIC)Bulent Cavusoglu (UIC)Tom DeFanti (UIC)Jason Leigh (UIC)Emir Mulabegovic (UIC)Oliver Yu (UIC)


Homeland security application testbed
Homeland Security Application Testbed

  • Chicago Video Surveillance

  • Monitoring of Biochemical Sensor Arrays

  • Helmet Mounted Cameras and Portable Sensors for Search/Rescue Operations

  • Dedicated Emergency Telephony Network

    • Public network lack of reliability during emergency


Real time surveillance monitoring

  • Search and rescue

Central Monitoring

  • Remote sharing with agencies in the field

  • Mobile and Portable Emergency Response Center

Real-Time Surveillance/Monitoring


Next generation internet architecture

Best Effort

Guaranteed & Controlled-Load

Non-Real-time

Real-time

Traffic Control

User Application

Topology Distribution

IP QoS Control

Real-time Multimedia

Path Selection

MPLS Forwarding

HTTP/SMTP/FTP/TELNET

IP Routing

Middleware

Signaling Protocol

Network & Layer Management

BGP

CR-LDP

IGP

RSVP

ICMP

Current Internet

Transport

Signaling Transport

TCP

Out-of-Band

UDP

Associated

NGI Extension

RTP

ATM/PPP/HDLC

IP / MPLS

SONET

Fiber/DWDM

Next Generation Internet Architecture


Viper fec udp over startap
VIPER: FEC/UDP Over STARTAP

(Chicago-Amsterdam)


Real time networking data voice and video

X

MBZ

E

f(0,0)

T

TR

f(0,1)

AN

f(1,0)

N

f(1,1)

S

DC

B

PS

E

T

P

P

C

FBV

Q

V

BFC

A

R

FFV

H

FFC

G

D

Picture Type

MPEG-1 Header extension

f_code

MPEG-2 Header extension

Real-Time Transport Protocol (RTP)



Real time networking data voice and video

FEC Simulations

(a) Static FEC

(b) Static IPB

(c) AFEC

(d) Original



Real time networking data voice and video

DiffServ Simulations

(a) Greedy

(b) IPB

(c) Motion

(d) Original


Rate controller

4

5

7

5

1

4

4

2

6

7

5

2

2

4

2

Rate-Controller


Real time networking data voice and video

Rate-Control Simulations

(a) Choke-Only

(b) Choke-ORCA



Real time networking data voice and video
LSP

PSNR = 18 dBms

PSNR = 33 dBms


Qos control over wireless core network

Wireless

QoS Control

Core

QoS Control

Internet

QoS Control

Backbone

BS

Gateway

MSC

AMDG-CAC

Router

Backbone

FDWFQ-MAC

AP-CAC

Backbone

Internet

CDMA-Based Admission & Scheduling

QoS Control Over Wireless & Core Network

(Oliver Yu)


Wireless mac protocols khokhar

Listen

Idle

Duty Cycle

9.30%

8.16%

Zzzz

Zzzz

Zzzz

Zzzz

5.13%

Zzzz

Zzzz

Zzzz

Call Admission

Controller

Zzzz

0.56%

X

Zzzz

Zzzz

X

Channel

Slot Level Scheduler

Wireless MAC Protocols(Khokhar)




Digital subscriber lines
Digital Subscriber Lines

A typical ADSL equipment configuration.


Low earth orbit satellites iridium
Low-Earth Orbit SatellitesIridium

(a) The Iridium satellites form six necklaces around the earth.

(b) 1628 moving cells cover the earth.


Globalstar
Globalstar

(a) Relaying in space.

(b) Relaying on the ground.


The 802 16 physical layer
The 802.16 Physical Layer

The 802.16 transmission environment.


Computer network infrastructure

Optical Networking

Transport Encoding

& Protocols

Wired and Wireless

Network Integration

Circuit and Packet Switched Network Deployment

NU

UIC

NCSA

UCSD

Computer Network Infrastructure


Wireless communications
Wireless Communications

  • Opportunistic Resource Allocation & Admission Control

  • Channel Estimation

  • Power-Efficient Wireless Protocols

  • High-Capacity Wireless Networks


Applications prototypes
Applications & Prototypes

  • Video Communications

  • Tele-Education

  • Natural Event Monitoring

  • Geosciences Monitoring

  • Environmental Assessment

  • Emergency Management

  • Elderly Care

  • Medical Diagnosis

  • Remote Robotic Surgery


Visualization devices

High-Resolution Scalable Displays

High-Resolution Capture

Interactive Tools

Visualization & Devices


Intelligence sharing
Intelligence Sharing

Real Time Monitoring and Real Time Multimedia Retrieval and Sharing across the continent


Video tracking

Video Tracking

Collaborators:Nidhal Bouaynaya (UIC)Karthik Hariharakrishnan (Motorola Research)Dan Lelescu (NTT DoCoMo Research)Josh Meir (NeoMagic)Magdi Mohamed (Motorola Research)Wei Qu (UIC)Philippe Raffy (R2 Technology)Fathy Yassa (NeoMagic)


Motivation
Motivation

  • Target Tracking

  • Surveillance

  • Retrieval

  • Video Coding

  • Video Communications

  • Videoconferencing

  • Virtual Reality

  • Human-Computer Interaction

  • Computer Animation


Vortex

Object cluster

Reference frame

VORTEX

VORTEX: Video Retrieval and Tracking from Compressed Multimedia Databases




Real time networking data voice and video

Motion-Based Particle Filters

Condensation filter

MBPF




Real time networking data voice and video

IDMOT

The Dynamic Graphic Model for Multiple Interactive Objects In Two Frames


Magnetic inertia model

Punish

Reward

Magnetic-Inertia Model


Video tracking and foveation ansari khokhar
Video Tracking and Foveation(Ansari & Khokhar)


Future research video tracking
Future Research:Video Tracking

  • Randomly Perturbed Active Surfaces

  • Video Stabilization

  • Auto-Focus Recovery

  • Pose Estimation and Feature Tracking

  • Video Animation

  • Stereography from a Single Camera

  • Multiple Camera Mosaics

  • Multiple Camera Tracking

  • Low-Power Particle Filters


Video retrieval

Video Retrieval

Collaborators:Faisal Bashir (UIC)Ashfaq Khokhar (UIC)Dan Lelescu (NTT DoCoMo Research)Fatih Porikli (Mitsubishi Research)


Motivation1
Motivation

  • Video Surveillance

  • Sign Language Recognition

  • Sports Video Analysis

  • Animal Mobility Experiments

  • Moving Object Databases

  • Video and Sensor Databases




Gaussian mixture models
Gaussian Mixture Models

Figure: 1-Sigma contours of GMM’s learnt from three classes.

(a) ‘Norway’. (b) ‘Alive’. (c) ‘Crazy’.


Classification

HMM for Class N

HMM for Class 1

Gaussian Mixtures

Classification:

Classification

Training Set Database


Accuracy
Accuracy

Accuracy values for various class sizes from ASL data set and the HJSL dataset (last column). Column headings are shown as (number of classes:number of trajectories) for the ASL dataset at different sizes.



Curvature scale space
Curvature Scale Space

Figure: An example high jump trajectory and its translated, rotated and non-uniformly scaled version, along with their CSS images.

CSS Images of a Trajectory and its 36-degree rotated version



Future research video retrieval
Future Research:Video Retrieval

  • Trajectory Occlusion

  • Camera Motion

  • Multiple Cameras

  • Multiple Trajectories

  • Video Mining

  • Joint Retrieval, Recognition, & Mining

  • Multi-Modality Feature Integration