A New Evaluation Approach for Video Processing Algorithms


LES AUTEURS A.T NGHIEM, F. BREMOND, M. THONNAT and R. MA

RESUME:

We present a new evaluation methodology to better evaluate video processing performance. Recent evaluation methods depend heavily on the benchmark dataset. The result may be different if we change the testing video sequences. The difference is mainly due to the video sequence content which usually includes many video processing problems (illumination changes, weak contrast etc.) at different difficulty levels. Hence it is difficult to extrapolate the evaluation result on new sequences.

In this paper, we propose an evaluation methodology that help to reuse the evaluation result. We try to isolate each video processing problem and define quantitative measures to compute the difficulty level of a video relatively to the given problem. The maximum difficulty level of the videos at which the algorithm is performing good enough is defined as the upper bound of the algorithm capacity for handling the problem. To illustrate this methodology, we present  metrics that evaluate the algorithm performance relatively to the problems of handling weakly contrasted objects and shadows.

Mots clé: "performance evaluation", "video processing"

Pour télécharger cet article,  cliquez ici


BibTeX reference:

@InProceedings{Zouba_SETIT_2007,
author =       {Nghiem Anh-Tuan and Francois Bremond and Monique Thonnat and Ruihua Ma},
title =        {A New Evaluation Approach for Video Processing Algorithm},
booktitle =    {Proceedings of WMVC 2007},
month =        {February}
year =         {2007}
address =      {Austin, Texas, USA}
}


Dernière mise à jour : 9/01/07
Catherine.Martin@sophia.inria.fr