Change Detection by Probabilistic Segmentation from Monocular View

Francisco J. Hernandez-Lopez and Mariano Rivera

submitted to: Machine Vision and applications, S.I: Background Modeling & Foreground Detection in real-world dynamic scenes.

Abstract

We present a method for foreground/background video segmentation (change detection) in real-time that can be used, in applications such as Background Subtraction or Analysis of Surveillance Cameras. Our approach implements a probabilistic segmentation based on the Quadratic Markov Measure Fields model. This framework regularizes the likelihood of each pixel belonging to each one of the classes (background or foreground). We propose a new likelihood that takes into account two cases: the first one is when the background is static and the foreground might be static or moving [Static Background Subtraction (SBS)], the second one is when the background is unstable and the foreground is moving [Unstable Background Subtraction (UBS)]. Moreover, our likelihood is robust to illumination changes, cast
shadows and camouflage situations. We implement a parallel version of our algorithm in CUDA using a NVIDIA GPU in order to fulfill real-time execution requirement.


Experiments using Microsoft database  |  Experiments using Wallflower database | Experiments using VSSN06 database | Experiments using ChangeDetection database | Application


Experiments using Microsoft database


No.
Test Seq.
Original Video
Proposal using Graph Cut
Proposal using QMMF
1
GTTS41
GTTS41_Original.avi
GTTS41_Segmented_GraphCut.avi
GTTS41_Segmented_QMMF.avi
2
GTTS43
GTTS43_Original.avi
GTTS43_Segmented_GraphCut.avi
GTTS43_Segmented_QMMF.avi
3
GTTS50
GTTS50_Original.avi
GTTS50_Segmented_GraphCut.avi
GTTS50_Segmented_QMMF.avi
4
GTTS51 GTTS51_Original.avi
GTTS51_Segmented_GraphCut.avi
GTTS51_Segmented_QMMF.avi
5
GTTS54 GTTS54_Original.avi
GTTS54_Segmented_GraphCut.avi
GTTS54_Segmented_QMMF.avi
6
GTTS56 GTTS56_Original.avi
GTTS56_Segmented_GraphCut.avi
GTTS56_Segmented_QMMF.avi
7
GTTS58 GTTS58_Original.avi
GTTS58_Segmented_GraphCut.avi
GTTS58_Segmented_QMMF.avi
8
GTTS60 GTTS60_Original.avi
GTTS60_Segmented_GraphCut.avi
GTTS60_Segmented_QMMF.avi
9
IU
IU_Original.avi
IU_Segmented_GraphCut.avi
IU_Segmented_QMMF.avi
10
JM
JM_Original.avi
JM_Segmented_GraphCut.avi
JM_Segmented_QMMF.avi
11
IUJW
IUJW_Original.avi
IUJW_Segmented_GraphCut.avi
IUJW_Segmented_QMMF.avi
12
AC
AC_Original.avi AC_Segmented_GraphCut.avi AC_Segmented_QMMF.avi
13
A_vlad
A_vlad_Original.avi
A_vlad_Segmented_GraphCut.avi
A_vlad_Segmented_QMMF.avi
14
A_mart
A_mart_Original.avi
A_mart_Segmented_GraphCut.avi
A_mart_Segmented_QMMF.avi
Note: Original and Segmented videos start from 5th frame.

Original videos and Ground Truth are available on:
http://research.microsoft.com/vision/cambridge/i2i/DSWeb.htm




Experiments using Wallflower database

No.
Test Seq.
Original Video
Proposal using Graph Cut Proposal using QMMF
1
Moved Object
MO_Original.avi
MO_Segmented_GraphCut.avi
MO_Segmented_QMMF.avi
2
Time Of Day
TOD_Original.avi
TOD_Segmented_GraphCut.avi
TOD_Segmented_QMMF.avi
3
Light Switch
LS_Original.avi
LS_Segmented_GraphCut.avi
LS_Segmented_QMMF.avi
4
Waving Trees
WT_Original.avi
WT_Segmented_GraphCut.avi
WT_Segmented_QMMF.avi
5
Camouflage
C_Original.avi
C_Segmented_GraphCut.avi
C_Segmented_QMMF.avi
6
Bootstrapping
B_Original.avi
B_Segmented_GraphCut.avi
B_Segmented_QMMF.avi
7
Foreground Aperture
FA_Original.avi
FA_Segmented_GraphCut.avi
FA_Segmented_QMMF.avi
Note: Original and Segmented videos start from 6th frame.

Original videos and Ground Truth are available on:
http://research.microsoft.com/en-us/um/people/jckrumm/WallFlower/TestImages.htm




Experiments using VSSN06 database

No.
Test Seq.
Original Video
Proposal using Graph Cut Proposal using QMMF
1
Video2_long
V2_Original.avi
V2_Segmented_GraphCut.avi
V2_Segmented_QMMF.avi
2
Video3_long V3_Original.avi
V3_Segmented_GraphCut.avi
V3_Segmented_QMMF.avi
3
Video4_long V4_Original.avi
V4_Segmented_GraphCut.avi
V4_Segmented_QMMF.avi
4
Video5_long V5_Original.avi
V5_Segmented_GraphCut.avi
V5_Segmented_QMMF.avi
5
Video6_long V6_Original.avi
V6_Segmented_GraphCut.avi
V6_Segmented_QMMF.avi
6
Video7_long V7_Original.avi
V7_Segmented_GraphCut.avi
V7_Segmented_QMMF.avi
7
Video8_vlong V8_Original.avi
V8_Segmented_GraphCut.avi
V8_Segmented_QMMF.avi
Note: Original and Segmented videos start from 6th frame.

Original videos and Ground Truth are available on:
http://mmc36.informatik.uni-augsburg.de/VSSN06_OSAC/





Experiments using ChangeDetection database

Results are available in the changedetection.net
Our method is named: CDPS




This page was last modified on September 30, 2013 by Francisco J. Hernandez-Lopez.