Geoffrey Samuel
1 / 26

Comparison of complex background subtraction algorithms using a fixed camera - PowerPoint PPT Presentation

  • Uploaded on

Geoffrey Samuel PhD Researcher Intelligent Systems and Robotics Research Group (ISR) Creative Technologies University of Portsmouth. Comparison of complex background subtraction algorithms using a fixed camera. Intro.

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
Download Presentation

PowerPoint Slideshow about 'Comparison of complex background subtraction algorithms using a fixed camera' - herne

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript

Geoffrey Samuel

PhD Researcher

Intelligent Systems and Robotics Research Group (ISR)

Creative Technologies

University of Portsmouth

Comparison of complex background subtraction algorithms using a fixed camera


Background subtraction is a important and vital step for computers to understand and interpreter a real-world scene

It allows a computer to ignore a background so to concentrate on a foreground object


Each background subtraction algorithm will have its advantages and disadvantages, and that looking and comparing these with a real-world situation, it would be possible to pick one algorithm or a method of combining algorithms to produce a algorithm capable of balancing speed with quality.

The goal
The Goal

Test and evaluate the quality and speed of existing background subtraction algorithms on a complex background with different everyday motions, and to compare the results with those of the extracted “Ground Truth”

Complex background
Complex Background

Static Background:-

Background does not contain any secondary “unwanted” motion. Controlled environment.

Complex Background:-

Background contains secondary “unwanted” motion such as the winds effect on trees or blinds.

Real-world data.

Synthetic test data
Synthetic Test Data


  • Automatically got the “Ground Truth”.

  • More control over each test clip.


  • Manual frame by frame “Ground Truth” extraction.

  • Added artefacts from the Chroma keying and compositing.

The experiment
The Experiment

To Create a set of synthetic data with the “Ground Truth”

To test different motions with each background subtraction algorithm

To Compare the results of each algorithm with that of the “Ground Truth”

The motions
The Motions

  • 7 everyday motions were chosen:

    • Drinking

    • Jogging

    • Picking up wallet

    • Scratching head

    • Sitting down

    • Standing up

    • Walking

  • Each motion started on the left of the screen and concluded on the right.

Creating the test scenarios
Creating the test scenarios

Green Screen

Green Screen with actor

Back Ground

Final Composite

“Ground Truth”

The algorithms
The Algorithms


Back Plate Difference

│framei – backplate│>Ts

The algorithms1
The Algorithms


Frame Difference

│framei – framei-1│>Ts

The algorithms2
The Algorithms

Approximate median

(x = ( framei- framei-1 – framei-2 . . .framei-n ) > Ts )

→ {background += 1}

→ {background -= 1}

The algorithms3
The Algorithms


Mixture of Gaussians

frame(it = μ) = Σi=1ωi,t .ț(μ,o)

Measuring the quality
Measuring the Quality









Compare the Per-Pixel value of

each frame with the “Ground Truth”

Results quality
Results - Quality

Most correct pixels

Most incorrect pixels

Results speed
Results - Speed

“Fastest” Algorithm

“Slowest “Algorithm

Results speed2
Results - Speed ignoring the Mixture of Gaussian speed results


Backplate difference was the fastest and produce the highest results in 4 out of 7 tests.

Frame difference was the ONLY algorithm to correctly remove the complex background, but couldn't correctly identify the foreground element.


Frame Difference :-

Correctly Removed Complex Background

Incorrectly Removed inside of Subject

Backplate Difference :-

Correctly Identified Subject

Incorrectly kept Complex Background

Taking it further
Taking it further

Theory Framework idea:


Frame Difference

Backplate Difference

Complex background removed

A new method that incorporated both the

speed of updating to remove the

background and yet the knowledge of the

background to properly extract the wanted

foreground element.

Where can this lead
Where can this lead?

  • Application of this technology could be used in:

    • Games

    • Surveillance

    • Mesh reconstruction and silhouette extraction

    • Various computer vision tasks


UK Engineering and Physical Science Research Council

Seth Benton for his Matlab code