D e m o n s t r a t i o n's   P a g e

R a c h i d   D e r i c h e






Overview

Demonstrations

Publications

European projects

Teaching activities

Graduate students

Editorial activities

Educational Background



Main page

VARIATIONAL METHODS and PDE's FOR VISION
A Variational Framework for Active and Adaptative Segmentation of Vector Valued Images

During the last few years, many efforts have been done in integrating different informations in a variational framework to segment images. Recent works on curve propagation were able to incorporate stochastic informations [14,10] and prior knowledge on shapes [3,11]. The information inserted in these studies is most of the time extracted offline. Meanwhile, other approaches have proposed to extract region information during the segmentation process itself [2,4,13]. Following these new approaches and extending the work in [10] to vector-valued images, we propose in this paper an entirely variational framework to approach the segmentation problem. Both, the image partition and the statistical parameters for each region are unkown. After a brief reminder on recent segmenting methods, we will present a variational formulation obtained from a bayesian model. After that, we will show two different differentiations driving to the same evolution equations. Detailed studies on gray and color images of the 2-phase case will follow. And we will finish on an application to tracking which shows benefits of our dynamical framework. WMVC'02 Article INRIA Research Report

Constrained Flows of Matrix-Valued Functions : Application to Diffusion Tensor Regularization

Nonlinear diffusion equations are now widely used to restore and enhance images. They allow to eliminate noise and artifacts while preserving large global features, such as object contours. In this context, we propose a differential-geometric framework to define regularizing PDEs acting on manifold constrained datasets. We consider the case of images taking value into matrix manifolds defined by orthogonal and spectral constraints. We directly incorporate the geometry and natural metric of the underlying configuration space (viewed as a Lie group or a homogeneous space) in the design of the corresponding flows. Our numerical implementation relies on structure-preserving integrators that respect intrinsically the constraints geometry. This approach was applied to the anisotropic smoothing of diffusion tensor volumes in medical imaging. ECCV'02 Article

Regularization of DT-MRI Diffusion Tensor Fields with Constraint Preservation

We address the problem of regularizing fields of diffusion tensors (i.e symmetric and positive-definite matrices) using PDE's and variational tools. We consider the minimization of a general regularizing functional under orthonormal constraints, introduced with Lagrange multipliers. Accurate numerical schemes are then provided and we compare this approach with a classical reprojection-step method. The application of interest considered here is the regularization of noisy DT-MRI images, in order to construct a coherent fiber network of the whitte matter. CVPR'01 Article

Regularization of orthonormal vector sets using coupled PDE's

This work proposes a variational based approach to regularize fields of orthonormal vector sets, using constraint-preserving anisotropic diffusion PDE's. Each point of these fields is defined by multiple orthogonal and unitary vectors and can indeed represent a lot of interesting orientation features such direction vectors or orthogonal matrices (among other examples). We first develop a general variational framework that solves this regularization problem, thanks to a constrained minimization of Phi-functionals. This leads to a set of coupled vector-valued PDE's preserving the orthonormal constraints. Then, we focus on particular applications of this general framework, including the restoration of noisy direction fields, noisy chromaticity color images, estimated camera motion and DT-MRI (Diffusion Tensor MRI) datasets. First, presented at VLSM'01 Workshop, Vancouver/Canada, July 13, 2001 VLSM'01 Article IJCV'02 Article RFIA'02 - In French

Constrained and Unconstrained PDEs for Vector Image Restoration

Here, we propose a new vector image restoration PDE which removes the noise and enhances blurred vector contours, thanks to a vector generalisation of scalar $\Phi$-function diffusions and shock filters. A local and geometric approach is proposed, which uses pertinent vector informations. Finally, we extend this equation to constrained norm evolutions, in order to restore direction fields and chromaticity noise on color images.- Presented at SCIA'01 Conference, Bergen/Norway, 11-14 Jun 2001 - SCIA'01 Article IEEE Signal Processing Magazine 2002

Geodesic Active Regions for Supervised Texture Segmentation

In this work, we propose a new model for supervised texture segmentation under a region/boundary-based curve propagation model. We pursue two main objectives; the first is to propose a complete framework for texture analysis and modeling that combines existing approaches in this domain and provides a reliable texture description model with a limited set of parameters. This model must be general to describe a wide variety of texture patterns. The second objective is to unify boundary-based and region-based segmentation using a variational approach. International Journal on Computer Vision, Volume 50, Number 3, pages 237-252, Dec. 2002 Article

Coupled Geodesic Active Regions for Image Segmentation

A novel variational method that unify boundary and region-based segmentation modules under the Geodesic Active Region framework is presented. A statistical analysis over the observed density function using a mixture of Gaussian elements, is first used to indicate the number of the different regions and their intensity properties. Then, the boundary information is determined using a probabilistic edge detector, while the region information is given directly from the observed image using the conditional probability density functions of the mixture model. The defined objective function is minimized using a gradient-descent method implemented through the use of the level-set method. The changes of topology of the curves during their evolution are naturally handled thanks to the level set implementation, while a coupled multi-phase propagation is adopted that increases the robustness and the convergence rate by introducing a coupled system of equations for the different level set functions. ECCV'2000 Article

Geodesic Active Contours/Regions for Detection and Tracking

In this work, we propose a new framework for tracking multiple non-rigid moving objects using a region/boundary-based curve propagation model.The objective of this work is to provide a complete tracking model that can deal successfully with the most difficult tracking cases, i.e non-rigid objects and non-rigid movements.

PDE's for Color Image Restoration

Coupled PDE's are introduced for vector image restoration and applyed to color images. Diffusion-reaction terms are developed to deal with both the debluring and denoising problems. Slides of the thesis presentation

Image and Sequence Enhanchement, Restoration and Deblurring via PDE

A In this work, we illustrate the results obtained using a variational approach devised for the purpose of image restoration with the constraint to preserve the edges within the original image.the restoration problem is set as a regularization and minimization of a non quadratic functional

Dense Disparity Map Estimation Respecting Image Discontinuities

We propose an energy based method to estimate a dense disparity map between 3 images while preserving its discontinuities accordingly to the image boundaries that may be present. We first derive a simplified expression for the disparity that allows us to easily estimate it from a stereo pair of images. Dicsontinuities are preserved using a regularization constraint term based on the Nagel and Enkelmann operator to better estimate and preserve the discontinuities. We assume that the epipolar geometry is known, and we include this information in the energy model. We derive the associated Euler-Lagrange equation and we approach the solution of the underlying partial differential equation using a gradient descent method. In order to reduce the risk to be trapped within some irrelevant local minima, we use a focusing strategy based on a linear Gaussian scale space.

Dense Depth Recovery from Stereo: A Minimization and Regularization Approach

We present a variational approach to dense stereo reconstruction which combines powerful tools such as regularization and multi-scale processing to estimate directly depth from a number of stereo images, while preserving depth discontinuities. The problem is set as a regularization and minimization of a non quadratic functional.

A PDE-based Level Set approach for Stereovision

In this work, we provide a totally new approach to deal with the important problem of matching 2D curves from a stereo pair of images We use the framework of energy minimization and express our problem as a geodesic active contour based approach.

3D Vision and Geometry
Autocalibration Using an SVD-Based Simplification of the Kruppa Equations

Autocalibration in the case of constant and varying intrinsic parameters. This paper deals with a fundamental problem in motion and stereo analysis, namely that of determining the camera intrinsic calibration parameters. Two methods are proposed that follows the autocalibration paradigm, according to which calibration is achieved not with the aid of a calibration pattern but by observing a number of image features in a set of successive images. The two proposed methods relie upon the Singular Value Decomposition of the fundamental matrix, which leads to a particularly simple form of the Kruppa equations. Autocalibration in the case of constant and varying intrinsic parameters are considered. Experimental results from extensive simulations and several image sequences, taking into account the uncertainty of the measurements, demonstrate the effectiveness of the proposed methods in accurately estimating the intrinsic calibration matrices. It is also shown that the computed intrinsic calibration matrices are sufficient for recovering 3D measurement, 3 motion and 3D Recosntruction from uncalibrated images.

Early Vision and Model Based Approaches
Recovering and Characterizing Image Features with a model-based approach

Edges, corners and vertices are strong and useful features in computer vision. The work illustreted here deals with the development of an efficient model based approach in order to detect and characterize precisely these important features. The key of our approach is first to propose some efficient models associated to each of these features and second to efficiently extract and characterize these features directly from the image.

A Model Based Method for Characterization and Location of Curved Image Features

This work deals with the development of a parametric model based method to locate and characterize precisely important curved features such as ellipses and B-splines based curves. The method uses all the grey level information of the pixels contained within a window around the feature of interest and produces the complete parametric model that best approximates in a mean-square sense the observed grey level image intensities within the working area.

On Parametric Deformable Models in Computer Vision: 2D Curve Tracking

Feature Extraction Using Parametric Snakes - Energy Based Methods for 2D Curve Tracking and Applications

On Parametric Deformable Models in Computer Vision: Refinement of 3D Curves

Stereo Matching, Reconstruction and Refinement of 3-{D} Curves Using Deformable Contours - Energy Based Methods for Ronstruction, and Refinement of 3{D} Curves and Applications

On Image Features Extraction

Using Canny's Criteria to Derive a Recursively Implemented Optimal Edge Detector - Fast Algorithms for Low-Level Vision. - An Efficient Method to Build an Early Image Description - - A Computational Approach For Corner And Vertex Detection etc..


Rachid Deriche
Last update: February 2005
You can mail your comments to: Rachid.Deriche@sophia.inria.fr