|
|
Publications about Object extraction
Result of the query in the list of publications :
Article |
1 - Object Extraction Using a Stochastic Birth-and-Death Dynamics in Continuum.
X. Descombes and R. Minlos and E. Zhizhina. Journal of Mathematical Imaging and Vision, 33(3): pages 347-359, 2009.
Keywords : birth and death process, Marked point process, Object extraction.
Copyright : Springer
@ARTICLE{DZM08,
|
| author |
= |
{Descombes, X. and Minlos, R. and Zhizhina, E.}, |
| title |
= |
{Object Extraction Using a Stochastic Birth-and-Death Dynamics in Continuum}, |
| year |
= |
{2009}, |
| journal |
= |
{Journal of Mathematical Imaging and Vision}, |
| volume |
= |
{33}, |
| number |
= |
{3}, |
| pages |
= |
{347-359}, |
| pdf |
= |
{http://dx.doi.org/10.1007/s10851-008-0117-y}, |
| keyword |
= |
{birth and death process, Marked point process, Object extraction} |
| } |
Abstract :
We define a new birth and death dynamics dealing with configurations of disks in the plane. We prove the convergence of the continuous process and propose a discrete scheme converging to the continuous case. This framework is developed to address image processing problems consisting in detecting a configuration of objects from a digital image. The derived algorithm is applied for tree crown extraction and bird detection from aerial images. The performance of this approach is shown on real data. |
|
 top of the page
3 PhD Thesis and Habilitations |
1 - Etude du couvert forestier par processus ponctuels marqués.
G. Perrin. PhD Thesis, Ecole Centrale Paris, October 2006.
Keywords : Tree Crown Extraction, Marked point process, Stochastic geometry, Object extraction, RJMCMC.
@PHDTHESIS{perrin_phd06,
|
| author |
= |
{Perrin, G.}, |
| title |
= |
{Etude du couvert forestier par processus ponctuels marqués}, |
| year |
= |
{2006}, |
| month |
= |
{October}, |
| school |
= |
{Ecole Centrale Paris}, |
| url |
= |
{http://www-sop.inria.fr/ariana/personnel/Guillaume.Perrin/resume.php}, |
| pdf |
= |
{http://www-sop.inria.fr/ariana/personnel/Guillaume.Perrin/DOWNLOADS/these_perrin_2006.pdf}, |
| keyword |
= |
{Tree Crown Extraction, Marked point process, Stochastic geometry, Object extraction, RJMCMC} |
| } |
Résumé :
Cette thèse aborde le problème de l'extraction d'arbres à partir d'images aériennes InfraRouge Couleur (IRC) de forêts. Nos modèles reposent sur l'utilisation de processus objets ou processus ponctuels marqués. Il s'agit de variables aléatoires dont les réalisations sont des configurations d'objets géométriques. Une fois l'objet géométrique de référence choisi, nous définissons l'énergie du processus par le biais d'un terme a priori, modélisant les contraintes sur les objets et leurs interactions, ainsi qu'un terme image. Nous échantillonnons le processus objet grâce à un algorithme de type Monte Carlo par Chaînes de Markov à sauts réversibles (RJMCMC), optimisé par un recuit simulé afin d'extraire la meilleure configuration d'objets, qui nous donne l'extraction recherchée.
Dans ce manuscrit, nous proposons différents modèles d'extraction de houppiers, qui extraient des informations à l'échelle de l'arbre selon la densité du peuplement. Dans les peuplements denses, nous présentons un processus d'ellipses, et dans les zones de plus faible densité, un processus d'ellipsoïdes. Nous obtenons ainsi le nombre d'arbres, leur localisation, le diamètre de la couronne et leur hauteur pour les zones non denses. Les algorithmes automatiques résultant de cette modélisation sont testés sur des images IRC très haute résolution fournies par l'Inventaire Forestier National (IFN). |
Abstract :
This thesis addresses the problem of tree crown extraction from Colour InfraRed (CIR) aerial images of forests. Our models are based on object processes, otherwise known as marked point processes. These mathematical objects are random variables whose realizations are configurations of geometrical shapes. This approach yields an energy minimization problem, where the energy is composed of a regularization term (prior density), which introduces some constraints on the objects and their interactions, and a data term, which links the objects to the features to be extracted. Once the reference object has been chosen, we sample the process and extract the best configuration of objects with respect to the energy, using a Reversible Jump Markov Chain Monte Carlo (RJMCMC) algorithm embedded in a Simulated Annealing scheme.
We propose different models for tree crown extraction depending on the density of the stand. In dense areas, we use an ellipse process, while in sparse vegetation an ellipsoïd process is used. As a result we obtain the number of stems, their position, the diameters of the crowns and the heights of the trees for sparse areas. The resulting algorithms are tested on high resolution CIR aerial images provided by the French National Forest Inventory (IFN). |
|
2 - Processus Ponctuels Marqués pour l'Extraction Automatique de Caricatures de Bâtiments à partir de Modèles Numériques d'Elévation.
M. Ortner. PhD Thesis, Universite de Nice Sophia Antipolis, October 2004.
Keywords : Marked point process, Object extraction, Buildings, Digital Elevation Model (DEM), RJMCMC, Stochastic geometry.
@PHDTHESIS{mortner_these,
|
| author |
= |
{Ortner, M.}, |
| title |
= |
{Processus Ponctuels Marqués pour l'Extraction Automatique de Caricatures de Bâtiments à partir de Modèles Numériques d'Elévation}, |
| year |
= |
{2004}, |
| month |
= |
{October}, |
| school |
= |
{Universite de Nice Sophia Antipolis}, |
| url |
= |
{https://hal.inria.fr/tel-00189803}, |
| pdf |
= |
{http://hal.inria.fr/docs/00/18/98/03/PDF/These_Ortner.pdf}, |
| keyword |
= |
{Marked point process, Object extraction, Buildings, Digital Elevation Model (DEM), RJMCMC, Stochastic geometry} |
| } |
Résumé :
Cette thèse se place dans un cadre de reconstruction urbaine et propose un corpus algorithmique pour extraire des formes simples sur les Modèles Numériques d'Elévation. Ce type de données décrit le relief d'une zone urbaine par une grille régulière de points à chacun desquels est associée une information de hauteur.
Les modèles utilisés reposent sur l'utilisation de processus ponctuels marqués. Il s'agit de variables aléatoires dont les réalisations sont des configurations d'objets géométriques. Ces modèles permettent d'introduire des contraintes sur la forme des objets recherchés dans une image ainsi qu'un terme de régularisation modélisé par des interactions entre les objets. Une énergie peut être associée aux configurations d'objets et la configuration minimisant cette énergie trouvée au moyen d'un recuit-simulé couplé à un échantillonneur de type Monte Carlo par Chaîne de Markov à sauts réversibles (RJMCMC).
Nous proposons quatre modèles pour extraire des caricatures de bâtiments à partir de descriptions altimétriques de zones urbaines denses. Chaque modèle est constitué par une forme d'objet, une énergie d'attache aux données et une énergie de régularisation. Les deux premiers modèles permettent d'extraire des formes simples (rectangles) en utilisant une contrainte d'homogénéité pour l'un et une détection des discontinuités pour l'autre. Le troisième modèle modélise les bâtiments par une forme polyhédrique. Le dernier modèle s'intéresse à l'apport d'une coopération entre des objets simples. Les algorithmes obtenus, automatiques, sont évalués sur des données réelles fournies par l'IGN (MNE Laser et optiques de différentes qualités). |
Abstract :
The context of this thesis is the reconstruction of urban areas from images. It proposes a set of algorithms for extracting simple shapes from Digital Elevation Models (DEM). DEMs describe the altimetry of an urban area by a grid of points, each of which has a height associated to it.
The proposed models are based on marked point processes. These mathematical objects are random variables whose realizations are configurations of geometrical shapes. Using these processes, we can introduce constraints on the shape of the objects to be detected in an image, and a regularizing term incorporating geometrical interactions between objects. An energy can be associated to each object configuration, and the global minima of this energy can then be found by applying simulated annealing to a Reversible Jump Monte Carlo Markov Chain sampler (RJMCMC).
We propose four different models for extracting the outlines of buildings from altimetric descriptions of dense urban areas. Each of these models is constructed from an object shape, a data energy, and a regularizing energy.
The first two models extract simple shapes (rectangles) using, respectively, a homogeneity constraint and discontinuity detection. The third model looks for three-dimensional polyhedral buildings. The last model uses cooperation between two types of objects, rectangles and segments.
The resulting algorithms are evaluated on real data provided by the French National Geographic Institute (a laser DEM and optical DEMs of differing quality). |
|
3 - Extraction de Réseaux Linéiques à partir d'Images Satellitaires et Aériennes par Processus Ponctuels Marqués.
C. Lacoste. PhD Thesis, Universite de Nice Sophia Antipolis, September 2004.
Keywords : Stochastic geometry, Object extraction, RJMCMC, Line networks, Simulated Annealing, Marked point process.
@PHDTHESIS{lacoste_these,
|
| author |
= |
{Lacoste, C.}, |
| title |
= |
{Extraction de Réseaux Linéiques à partir d'Images Satellitaires et Aériennes par Processus Ponctuels Marqués}, |
| year |
= |
{2004}, |
| month |
= |
{September}, |
| school |
= |
{Universite de Nice Sophia Antipolis}, |
| url |
= |
{https://hal.inria.fr/tel-00261397}, |
| pdf |
= |
{http://hal.inria.fr/docs/00/26/13/97/PDF/THESE_CAROLINE_LACOSTE.pdf}, |
| keyword |
= |
{Stochastic geometry, Object extraction, RJMCMC, Line networks, Simulated Annealing, Marked point process} |
| } |
Résumé :
Cette thèse aborde le problème de l'extraction non supervisée des réseaux linéiques (routes, rivières, etc.) à partir d'images satellitaires et aériennes. Nous utilisons des processus objet, ou processus ponctuels marqués, comme modèles a priori. Ces modèles permettent de bénéficier de l'apport d'un cadre stochastique (robustesse au bruit, corpus algorithmique, etc.) tout en manipulant des contraintes géométriques fortes. Un recuit simulé sur un algorithme de type Monte Carlo par Chaîne de Markov (MCMC) permet une optimisation globale sur l'espace des configurations d'objets, indépendamment de l'initialisation.
Nous proposons tout d'abord une modélisation du réseau linéique par un processus dont les objets sont des segments interagissant entre eux. Le modèle a priori est construit de façon à exploiter au mieux la topologie du réseau recherché au travers de potentiels fondés sur la qualité de chaque interaction. Les propriétés radiométriques sont prises en compte dans un terme d'attache aux données fondé sur des mesures statistiques.
Nous étendons ensuite cette modélisation à des objets plus complexes. La manipulation de lignes brisées permet une extraction plus précise du réseau et améliore la détection des bifurcations.
Enfin, nous proposons une modélisation hiérarchique des réseaux hydrographiques dans laquelle les affluents d'un fleuve sont modélisés par un processus de lignes brisées dans le voisinage de ce fleuve.
Pour chacun des modèles, nous accélérons la convergence de l'algorithme MCMC par l'ajout de perturbations adaptées.
La pertinence de cette modélisation par processus objet est vérifiée sur des images satellitaires et aériennes, optiques et radar. |
Abstract :
This thesis addresses the problem of the unsupervised extraction of line networks (roads, rivers, etc.) from remotely sensed images. We use object processes, or marked point processes, as prior models. These models benefit from a stochastic framework (robustness w.r.t. noise, algorithms, etc.) while incorporating strong geometric constraints. Optimization is done via simulated annealing using a Reversible Jump Markov Chain Monte Carlo (RJMCMC) algorithm, without any specific initialization.
We first propose to model line networks by a process whose objects are interacting line segments. The prior model is designed to exploit as fully as possible the topological properties of the network under consideration through potentials based on the quality of each interaction. The radiometric properties of the network are modeled using a data term based on statistical measures.
We then extend this model to more complex objects. The use of broken lines improves the detection of network junctions and increases the accuracy of the extracted network.
Finally, we propose a hierarchical model of hydrographic networks in which the tributaries of a given river are modeled by a process of broken lines in the neighborhood of this river. For each model, we accelerate convergence of the RJMCMC algorithm by using appropriate perturbations.
We show experimental results on aerial and satellite images (optical and radar data) to verify the relevance of the object process models. |
|
top of the page
10 Conference articles |
1 - Extraction of arbitrarily shaped objects using stochastic multiple birth-and-death dynamics and active contours.
M. S. Kulikova and I. H. Jermyn and X. Descombes and E. Zhizhina and J. Zerubia. In Proc. IS&T/SPIE Electronic Imaging, San Jose, USA, January 2010.
Keywords : Object extraction, Marked point process, Shape prior, Active contour, birth-and-death dynamics.
Copyright : Copyright 2010 by SPIE and IS&T. This paper was published in the proceedings of IS&T/SPIE Electronic Imaging 2010 Conference in San Jose, USA, and is made available as an electronic reprint with permission of SPIE and IS&T. One print or electronic copy may be made for personal use only. Systematic or multiple reproduction, distribution to multiple locations via electronic or other means, duplication of any material in this paper for a fee or for commercial purposes, or modification of the content of the paper are prohibited.
@INPROCEEDINGS{Kulikova10a,
|
| author |
= |
{Kulikova, M. S. and Jermyn, I. H. and Descombes, X. and Zhizhina, E. and Zerubia, J.}, |
| title |
= |
{Extraction of arbitrarily shaped objects using stochastic multiple birth-and-death dynamics and active contours}, |
| year |
= |
{2010}, |
| month |
= |
{January}, |
| booktitle |
= |
{Proc. IS&T/SPIE Electronic Imaging}, |
| address |
= |
{San Jose, USA}, |
| pdf |
= |
{http://hal.archives-ouvertes.fr/docs/00/46/54/72/PDF/Kulikova_SPIE2010.pdf}, |
| keyword |
= |
{Object extraction, Marked point process, Shape prior, Active contour, birth-and-death dynamics} |
| } |
Abstract :
We extend the marked point process models that have been used for object extraction from images to arbitrarily shaped objects, without greatly increasing the computational complexity of sampling and estimation. From an alternative point of view, the approach can be viewed as an extension of the active contour methodology to an a priori unknown number of
objects. Sampling and estimation are based on a stochastic birth-and-death process defined on the configuration space of an arbitrary number of objects, where the objects are defined by the image data and prior information. The performance of the approach is demonstrated via experimental results on synthetic and real data. |
|
2 - A marked point process model with strong prior shape information for extraction of multiple, arbitrarily-shaped objects.
M. S. Kulikova and I. H. Jermyn and X. Descombes and E. Zhizhina and J. Zerubia. In Proc. IEEE SITIS, Publ. IEEE Computer Society, Marrakech, Maroc, December 2009.
Keywords : Object extraction, Marked point process, Shape prior, Active contour, multiple birth-and-death dynamics.
@INPROCEEDINGS{Kulikova09a,
|
| author |
= |
{Kulikova, M. S. and Jermyn, I. H. and Descombes, X. and Zhizhina, E. and Zerubia, J.}, |
| title |
= |
{A marked point process model with strong prior shape information for extraction of multiple, arbitrarily-shaped objects}, |
| year |
= |
{2009}, |
| month |
= |
{December}, |
| booktitle |
= |
{Proc. IEEE SITIS}, |
| publisher |
= |
{IEEE Computer Society}, |
| address |
= |
{Marrakech, Maroc}, |
| pdf |
= |
{http://hal.inria.fr/docs/00/43/63/20/PDF/PID1054029.pdf}, |
| keyword |
= |
{Object extraction, Marked point process, Shape prior, Active contour, multiple birth-and-death dynamics} |
| } |
Abstract :
We define a method for incorporating strong prior shape information into a recently extended Markov point process model for the extraction of arbitrarily-shaped objects from images. To estimate the optimal configuration of objects, the process is sampled using a Markov chain based on a stochastic birth-and-death process defined in a space of multiple
objects. The single objects considered are defined by both the image data
and the prior information in a way that controls the computational
complexity of the estimation problem. The method is tested via experiments
on a very high resolution aerial image of a scene composed of tree crowns. |
|
3 - Object extraction from high resolution SAR images using a birth and death dynamics.
F. Arslan and X. Descombes and J. Zerubia. In Proc. IEEE International Conference on Image Processing (ICIP), Cairo, Egypt, November 2009.
Keywords : High resolution SAR images, Object extraction, Marked point process, birth and death process.
@INPROCEEDINGS{Fatih09,
|
| author |
= |
{Arslan, F. and Descombes, X. and Zerubia, J.}, |
| title |
= |
{Object extraction from high resolution SAR images using a birth and death dynamics}, |
| year |
= |
{2009}, |
| month |
= |
{November}, |
| booktitle |
= |
{Proc. IEEE International Conference on Image Processing (ICIP)}, |
| address |
= |
{Cairo, Egypt}, |
| url |
= |
{http://dx.doi.org/10.1109/ICIP.2009.5413907}, |
| keyword |
= |
{High resolution SAR images, Object extraction, Marked point process, birth and death process} |
| } |
Abstract :
We present a new approach to extract predefined objects, such as trees and oil tanks for instance, from high resolution SAR images. We consider a stochastic approach based on an object process also called marked point process. The objects represent trees or oil tanks which are modeled by disks in the image. We first define a Gibbs density that takes into account both prior information and the data. The energy we define is composed of two terms, one is a prior, penalizing overlaps between objects, and the other is a data term, which measures the suitability of an object in the SAR image. The problem is then reduced to an energy minimization problem. We sample the process to extract the configuration of objects minimizing the energy by a fast birth-and-death dynamics, leading to the total number of objects (trees or oil tanks in our case). This approach is much faster than manual counts and does not need any preprocessing or supervision of a user. |
|
4 - 2D and 3D Vegetation Resource Parameters Assessment using Marked Point Processes.
G. Perrin and X. Descombes and J. Zerubia. In Proc. International Conference on Pattern Recognition (ICPR), Hong-Kong, August 2006.
Keywords : Data energy, Object extraction, Tree Crown Extraction, Stochastic geometry, Marked point process.
@INPROCEEDINGS{perrin_06_c,
|
| author |
= |
{Perrin, G. and Descombes, X. and Zerubia, J.}, |
| title |
= |
{2D and 3D Vegetation Resource Parameters Assessment using Marked Point Processes}, |
| year |
= |
{2006}, |
| month |
= |
{August}, |
| booktitle |
= |
{Proc. International Conference on Pattern Recognition (ICPR)}, |
| address |
= |
{Hong-Kong}, |
| pdf |
= |
{ftp://ftp-sop.inria.fr/ariana/Articles/2006_perrin_06_c.pdf}, |
| keyword |
= |
{Data energy, Object extraction, Tree Crown Extraction, Stochastic geometry, Marked point process} |
| } |
Abstract :
High resolution aerial and satellite images of forests have a key role to play in natural resource management. As they enable to study forests at the scale of trees, it is now possible to get a more accurate evaluation of the forest resources, from which can be deduced information of biodiversity and ecological sustainability. In that prospect, automatic algorithms are needed to give a further exploitation of the data and to assist human operators. In this paper, we present a stochastic geometry approach to extract 2D and 3D parameters of the trees, by modelling the stands as some realizations of a marked point process of ellipses or ellipsoids, whose points are the positions of the trees and marks their geometric features. This approach gives also the number of stems, their position, and their size. It is an energy minimization problem, where the energy embeds a regularization term (prior density), which introduces some interactions between the objects, and a data term, which links the objects to the features to be extracted. Results are shown on aerial images provided by the French National Forest Inventory (IFN). |
|
5 - A comparative study of three methods for identifying individual tree crowns in aerial images covering different types of forests.
M. Eriksson and G. Perrin and X. Descombes and J. Zerubia. In Proc. International Society for Photogrammetry and Remote Sensing (ISPRS), Marne La Vallee, France, July 2006.
Keywords : Region Growing, Marked point process, Markov Fields, Object extraction, Tree Crown Extraction.
@INPROCEEDINGS{eriksson06a,
|
| author |
= |
{Eriksson, M. and Perrin, G. and Descombes, X. and Zerubia, J.}, |
| title |
= |
{A comparative study of three methods for identifying individual tree crowns in aerial images covering different types of forests}, |
| year |
= |
{2006}, |
| month |
= |
{July}, |
| booktitle |
= |
{Proc. International Society for Photogrammetry and Remote Sensing (ISPRS)}, |
| address |
= |
{Marne La Vallee, France}, |
| pdf |
= |
{ftp://ftp-sop.inria.fr/ariana/Articles/2006_eriksson06a.pdf}, |
| keyword |
= |
{Region Growing, Marked point process, Markov Fields, Object extraction, Tree Crown Extraction} |
| } |
Abstract :
Most of today's silviculture methods has the goal to optimise the outcome of the forest in stem volume when it is cut. It might also be relevant to save parts of the forest, for instance, to protect a habitat. In order to get a good survey of the forest, remote sensed images are often used. These images are most often manually interpreted in combination with field measurements in order to estimate the forest parameters that are of importance in the decision how to optimally maintain the forest. Among these parameters the most common are stem number, stem volume, and tree species. Interpretation of images are often labour and time consuming. Thus, automatically developed methods for interpretation can lower the work load and speed up the interpretation time.
The interpretation is often done using images captured from a far distance from the ground in order to capture as large area as possible. However, this lower the accuracy of the estimates since it must be done stand wise. Knowledge of where each individual trees in the forest is located together with its size will increase accuracy. It makes it also possible to plan the cutting in detail. With this knowledge in mind, research about finding automatically methods for finding individual tree crowns in aerial images has been a subject for researchers the last decades.
Today's methods are not capable to alone handle all kind of forests. Therefore, comparative studies of different segmentation methods with different types of forests are of importance in order to clarify how much a method is reliable at a certain type of forest. This knowledge can, for instance, be used to build up an expert system which are supposed to be able to find individual tree crowns in any kind of forests. The comparison is done using images covering different types of forests. The types of forests that are included in the study ranges from isolated tree crown where the ground is clearly visible between the crowns to dense forest which is naturally regenerated via planted forest.
In this study we compare three existing segmentation methods for extracting individual tree crowns from aerial images. The first two methods are probabilistic methods which minimises some energy function while the third is a region growing algorithm. The first probabilistic method is based on a Markov Random Field modelling. We define a prior Markov model to segment the image into three classes (background, vegetation and tree centres). The prior model embed a circular shape model of the tree crown with a random radius. The data term allows to well position the tree centres onto the image and to describe the tree shape as fluctuations around the circular template. Besides, some long range interactions models the relations between the trees locations, such as some periodicity in case of plantations.
The second probabilistic method consists in modeling the trees in the forestry images as random configurations of ellipses or ellipsoids, whose points are the positions of the stems and marks their geometric features. The density of this process embeds a regularization term (prior density), which introduces some interactions between the objects, and a data term, which links the objects to the features to be extracted. We estimate the best configuration of an unknown number of objects, from which 2D and 3D vegetation resource parameters can be extracted. To sample this marked point process, we use Monte Carlo dynamics, while the optimization is performed via a Simulated Annealing algorithm, which results in a fully automatic approach. This approach works well on plantations, where there are high spatial relations between the trees, and on isolated trees where 3D parameters can be extracted, but some difficulties remain in dense areas.
The third method, the region growing algorithm, relies as all region growing methods on good seed points, i.e. in this case approximate locations of the tree crowns. From the seed points the segments are grown according to a grey level value of the neighbouring pixels. The larger the value is the sooner it is connected to the neighbouring segment. The segments stops to grow when all pixels belongs to a segment. This method, contrary the others, will have as a result, segments that have captured the actual shape of the tree crown if the forest is not too sparse. If the forest is too sparse such that the ground is visible, there are problems of finding the seed points. In the cases when the forest is sparse, there are difficulties to separate the tree crowns from the ground. Even if the seed points would be located only at the tree crowns the result will contain a lot of errors since all pixels most belong to a segment, i.e. even the ground pixels must be connected to a segment in this case. |
|
6 - Forest Resource Assessment using Stochastic Geometry.
G. Perrin and X. Descombes and J. Zerubia and J.G. Boureau. In Proc. International Precision Forestry Symposium, March 2006.
Keywords : Tree Crown Extraction, Object extraction, Stochastic geometry, RJMCMC, Data energy.
@INPROCEEDINGS{perrin_06_b,
|
| author |
= |
{Perrin, G. and Descombes, X. and Zerubia, J. and Boureau, J.G.}, |
| title |
= |
{Forest Resource Assessment using Stochastic Geometry}, |
| year |
= |
{2006}, |
| month |
= |
{March}, |
| booktitle |
= |
{Proc. International Precision Forestry Symposium}, |
| pdf |
= |
{ftp://ftp-sop.inria.fr/ariana/Articles/perrin_ipfs06.pdf}, |
| keyword |
= |
{Tree Crown Extraction, Object extraction, Stochastic geometry, RJMCMC, Data energy} |
| } |
Abstract :
Aerial and satellite imagery has a key role to play in natural resource management, especially in forestry application. The submetric resolution of the data enables to study forests at the scale of trees, and to get a more accurate assessment of the resources such as the number of stems or the forest cover. To develop automatic tools in order to help the inventories in their work and to bring more knowledge about the stands is also nowadays of important economical and environmental concerns.
In this paper, we aim at extracting tree crowns from high resolution aerial Color Infrared images (CIR) of forests using marked point processes. Our approach consists in modelling the trees in the forestry images as random configurations of ellipses, whose points are the positions of the stems and marks their geometric features. The density of this process embeds a regularization term (prior density), which introduces some interactions between the objects, and a data term, which links the objects to the features to be extracted. Our goal is to find the best configuration of an unknown number of objects, i.e. the configuration that maximizes this density. To sample this marked point process, we use Monte Carlo dynamics while the optimization is performed via a Simulated Annealing algorithm, which results in a fully automatic approach.
We present different models for the data term in order to cope with different kinds of stands : plantations, isolated trees and mixed stands. Results are shown on aerial CIR images provided by the French Forest Inventory (IFN) |
|
7 - Evaluation des Ressources Forestières à l'aide de Processus Ponctuels Marqués.
G. Perrin and X. Descombes and J. Zerubia. In Proc. Reconnaissance des Formes et Intelligence Artificielle (RFIA), Tours, France, January 2006.
Keywords : Tree Crown Extraction, Stochastic geometry, Marked point process, Object extraction.
@INPROCEEDINGS{perrin_06_a,
|
| author |
= |
{Perrin, G. and Descombes, X. and Zerubia, J.}, |
| title |
= |
{Evaluation des Ressources Forestières à l'aide de Processus Ponctuels Marqués}, |
| year |
= |
{2006}, |
| month |
= |
{January}, |
| booktitle |
= |
{Proc. Reconnaissance des Formes et Intelligence Artificielle (RFIA)}, |
| address |
= |
{Tours, France}, |
| pdf |
= |
{ftp://ftp-sop.inria.fr/ariana/Articles/perrin_rfia06.pdf}, |
| keyword |
= |
{Tree Crown Extraction, Stochastic geometry, Marked point process, Object extraction} |
| } |
Résumé :
Les images aériennes et satellitaires jouent un role de plus en plus important dans le domaine de la gestion des ressources naturelles, et en particulier des forêts. Les organismes chargés d'en faire l'inventaire, comme l'Inventaire Forestier National (IFN) en France, s'appuient en effet sur ces images pour observer les différentes espèces d'arbres d'une zone boisée, avant de se rendre sur le terrain pour une étude plus poussée. La résolution submétrique des données permet, en outre, d'entrevoir une étude plus fine, à savoir un comptage à l'arbre près et une classification automatique des houppiers (ensemble des branches et du feuillage d'un arbre). Cette évaluation précise des ressources forestières n'est actuellement pas disponible. Aussi, le développement d'outils automatiques, chargés d'aider les gestionnaires du paysage dans leur travail en leur apportant une connaissance des ressources à l'échelle de l'arbre, se révèle-t-il être d'un intérêt grandissant.L'objectif de notre travail est donc d'extraire des houppiers à partir d'images aériennes de forêts à très haute résolution. Notre approche consiste à modéliser les peuplements forestiers par un processus ponctuel marqué d'ellipses, dont les points représentent les positions des arbres et les marques leurs caractéristiques géométriques. La densité de ce processus comporte une composante de régularisation, dite a priori, qui introduit des interactions entre les objets du processus, ainsi qu'une composante d'attache aux données, afin que les objets du processus se positionnent sur les houppiers que l'on souhaite extraire. Il s'agit de trouver la configuration d'objets, en nombre inconnu a priori, qui maximise cette densité. La simulation de tels processus fait appel aux algorithmes de type Monte Carlo par Chaîne de Markov (MCMC) à sauts réversibles, l'optimisation étant réalisée à l'aide d'un recuit simulé.Nous présentons ici un nouveau modèle d'attache aux données. Contrairement à nos précédents modèles testés sur des plantations, ce modèle n'est plus bayésien puisque le terme d'attache aux données est désormais calculé au niveau des objets et non de l'image. Ceci nous permet de travailler sur des images plus générales, avec des densités d'arbres plus variables. Des résultats obtenus sur des images fournies par l'IFN valident ce modèle. |
Abstract :
Aerial and satellite imagery has a key role to play in natural resources management, especially in forestry application. Indeed, forest inventories, such as the French National Inventory (IFN), refer to these images to analyse the different tree species in a stand, before sending a team on the ground to obtain some more advanced knowledge. Moreover, the submetric resolution of the data enables to study forests at the scale of trees, and also to get a more accurate evaluation of the resources such as the number of stems. It would be also of important economical and environmental concerns to develop automatic tools to analyze and monitor forests.We aim at extracting tree crowns from high resolution aerial images of forests. Our approach consists in modelling the forestry images as realizations of a marked point process of ellipses, whose points are the positions of the trees and marks their geometric features. The density of this process embeds a regularization term (prior density), which introduces some interactions between the objects, and a data term, which links the objects to the features to be extracted. Our goal is to find the best configuration of an unknown number of objects, i.e. the configuration that maximizes this density. To sample the marked point process, we use Monte Carlo dynamics (Reversible Jump Markov Chain Monte Carlo), while the optimization is performed via a simulated annealing algorithm.We present here a new model for the data term. Contrary to our previous models tested on plantations images, this model is not Bayesian anymore : the data term is calculated for each object and not for the whole image. This enables us to work on more general images, with variable tree crown densities. Example results are shown on aerial images provided by the French Forest Inventory (IFN). |
|
8 - A Marked Point Process Model for Tree Crown Extraction in Plantations.
G. Perrin and X. Descombes and J. Zerubia. In Proc. IEEE International Conference on Image Processing (ICIP), Genoa, Italy, September 2005.
Keywords : Stochastic geometry, RJMCMC, Tree Crown Extraction, Object extraction, Marked point process.
@INPROCEEDINGS{perrin_icip05,
|
| author |
= |
{Perrin, G. and Descombes, X. and Zerubia, J.}, |
| title |
= |
{A Marked Point Process Model for Tree Crown Extraction in Plantations}, |
| year |
= |
{2005}, |
| month |
= |
{September}, |
| booktitle |
= |
{Proc. IEEE International Conference on Image Processing (ICIP)}, |
| address |
= |
{Genoa, Italy}, |
| pdf |
= |
{ftp://ftp-sop.inria.fr/ariana/Articles/perrin_icip05.pdf}, |
| ps |
= |
{ftp://ftp-sop.inria.fr/ariana/Articles/perrin_icip05.ps.gz}, |
| keyword |
= |
{Stochastic geometry, RJMCMC, Tree Crown Extraction, Object extraction, Marked point process} |
| } |
Abstract :
This work presents a framework to extract tree crowns from remotely sensed data, especially in plantation images, using stochastic geometry. We aim at finding the tree top positions, and the tree crown diameter distribution. Our approach consists in considering that these images are some realizations of a marked point process. First we model the tree plantation as a configuration of an unknown number of ellipses. Then, a Bayesian energy is defined, containing both a prior energy which incorporates the prior knowledge of the plantation geometric properties, and a likelihood which fits the objects to the data. Eventually, we estimate the global minimum of this energy using Reversible Jump Markov Chain Monte Carlo dynamics and a simulated annealing scheme. We present results on optical aerial images of poplars provided by IFN. |
|
9 - Tree Crown Extraction using Marked Point Processes.
G. Perrin and X. Descombes and J. Zerubia. In Proc. European Signal Processing Conference (EUSIPCO), University of Technology, Vienna, Austria, September 2004.
Keywords : RJMCMC, Marked point process, Simulated Annealing, Tree Crown Extraction, Object extraction, Stochastic geometry.
@INPROCEEDINGS{perrin04a,
|
| author |
= |
{Perrin, G. and Descombes, X. and Zerubia, J.}, |
| title |
= |
{Tree Crown Extraction using Marked Point Processes}, |
| year |
= |
{2004}, |
| month |
= |
{September}, |
| booktitle |
= |
{Proc. European Signal Processing Conference (EUSIPCO)}, |
| address |
= |
{University of Technology, Vienna, Austria}, |
| pdf |
= |
{ftp://ftp-sop.inria.fr/ariana/Articles/perrin_eusipco2004.pdf}, |
| ps |
= |
{ftp://ftp-sop.inria.fr/ariana/Articles/perrin_eusipco2004.ps.gz}, |
| keyword |
= |
{RJMCMC, Marked point process, Simulated Annealing, Tree Crown Extraction, Object extraction, Stochastic geometry} |
| } |
Abstract :
In this paper we aim at extracting tree crowns from remotely sensed images. Our approach is to consider that these images are some realizations of a marked point process. The first step is to define the geometrical objects that design the trees, and the density of the process.
Then, we use a Reversible Jump Markov Chain Monte Carlo dynamics and a simulated annealing to get the maximum a posteriori estimator of the tree crown distribution on the image. Transitions of the Markov chain are managed by some specific proposition kernels.
Results are shown on aerial images of poplars provided by IFN. |
|
10 - Marked Point Process in Image Analysis : from Context to Geometry.
X. Descombes and F. Kruggel and C. Lacoste and M. Ortner and G. Perrin and J. Zerubia. In International Conference on Spatial Point Process Modelling and its Application (SPPA), Castellon, Spain, 2004.
Keywords : RJMCMC, Object extraction, Marked point process, Stochastic geometry.
@INPROCEEDINGS{geostoch04a,
|
| author |
= |
{Descombes, X. and Kruggel, F. and Lacoste, C. and Ortner, M. and Perrin, G. and Zerubia, J.}, |
| title |
= |
{Marked Point Process in Image Analysis : from Context to Geometry}, |
| year |
= |
{2004}, |
| booktitle |
= |
{International Conference on Spatial Point Process Modelling and its Application (SPPA)}, |
| address |
= |
{Castellon, Spain}, |
| pdf |
= |
{ftp://ftp-sop.inria.fr/ariana/Articles/SPPA_2004.pdf}, |
| ps |
= |
{ftp://ftp-sop.inria.fr/ariana/Articles/SPPA_2004.ps.gz}, |
| keyword |
= |
{RJMCMC, Object extraction, Marked point process, Stochastic geometry} |
| } |
Abstract :
We consider the marked point process framework as a natural extension of the Markov random field approach in image analysis. We consider a general model defined by its density allowing us to consider some geometrical constraints on objects and between objects in feature extraction problems. Some examples are derived for small brain lesions detection from MR Images, road network, tree crown and building extraction from remotely sensed images. The results obtained on real data show the relevance of the proposal approach. |
|
top of the page
9 Technical and Research Reports |
1 - Estimation des paramètres de modèles de processus ponctuels marqués pour l'extraction d'objets en imagerie spatiale et aérienne haute résolution .
S. Ben Hadj and F. Chatelain and X. Descombes and J. Zerubia. Rapport de recherche 7350, INRIA, July 2010.
Keywords : Marked point process, RJMCMC, Simulated Annealing, Stochastic EM (SEM), pseudo-vraisemblance, Object extraction.
@TECHREPORT{RR-7350,
|
| author |
= |
{Ben Hadj, S. and Chatelain, F. and Descombes, X. and Zerubia, J.}, |
| title |
= |
{Estimation des paramètres de modèles de processus ponctuels marqués pour l'extraction d'objets en imagerie spatiale et aérienne haute résolution }, |
| year |
= |
{2010}, |
| month |
= |
{July}, |
| institution |
= |
{INRIA}, |
| type |
= |
{Rapport de recherche}, |
| number |
= |
{7350}, |
| url |
= |
{http://hal.archives-ouvertes.fr/inria-00508431/fr/}, |
| keyword |
= |
{Marked point process, RJMCMC, Simulated Annealing, Stochastic EM (SEM), pseudo-vraisemblance, Object extraction} |
| } |
|
2 - Détection de flamants roses par processus ponctuels marqués pour l'estimation de la taille des populations.
S. Descamps and X. Descombes and A. Béchet and J. Zerubia. Research Report 6328, INRIA, October 2007.
Keywords : Object extraction, modélisation stochastique , Marked point process, dynamique de naissance/mort, environnement, flamants roses.
@TECHREPORT{Descamps-Descombes,
|
| author |
= |
{Descamps, S. and Descombes, X. and Béchet, A. and Zerubia, J.}, |
| title |
= |
{Détection de flamants roses par processus ponctuels marqués pour l'estimation de la taille des populations}, |
| year |
= |
{2007}, |
| month |
= |
{October}, |
| institution |
= |
{INRIA}, |
| type |
= |
{Research Report}, |
| number |
= |
{6328}, |
| url |
= |
{http://hal.inria.fr/inria-00180811}, |
| pdf |
= |
{http://hal.inria.fr/docs/00/18/08/93/PDF/RR-Desc-Desc-Bech-Zeru.pdf}, |
| keyword |
= |
{Object extraction, modélisation stochastique , Marked point process, dynamique de naissance/mort, environnement, flamants roses} |
| } |
|
3 - An automatic building extraction method : Application to the 3D-city modeling.
F. Lafarge and P. Trontin and X. Descombes and J. Zerubia and M. Pierrot-Deseilligny. Research Report 5925, INRIA, France, May 2006.
Keywords : Object extraction, Marked point process, 3D reconstruction, Urban areas, Satellite images, Digital Elevation Model (DEM).
@TECHREPORT{lafarge_rr_may06,
|
| author |
= |
{Lafarge, F. and Trontin, P. and Descombes, X. and Zerubia, J. and Pierrot-Deseilligny, M.}, |
| title |
= |
{An automatic building extraction method : Application to the 3D-city modeling}, |
| year |
= |
{2006}, |
| month |
= |
{May}, |
| institution |
= |
{INRIA}, |
| type |
= |
{Research Report}, |
| number |
= |
{5925}, |
| address |
= |
{France}, |
| pdf |
= |
{ftp://ftp-sop.inria.fr/ariana/Articles/2006_lafarge_rr_may06.pdf}, |
| keyword |
= |
{Object extraction, Marked point process, 3D reconstruction, Urban areas, Satellite images, Digital Elevation Model (DEM)} |
| } |
|
4 - A Non-Bayesian Model for Tree Crown Extraction using Marked Point Processes.
G. Perrin and X. Descombes and J. Zerubia. Research Report 5846, INRIA, France, February 2006.
Keywords : Data energy, Object extraction, Tree Crown Extraction, Marked point process, Stochastic geometry, 3D reconstruction.
@TECHREPORT{rr_perrin_nonbay_05,
|
| author |
= |
{Perrin, G. and Descombes, X. and Zerubia, J.}, |
| title |
= |
{A Non-Bayesian Model for Tree Crown Extraction using Marked Point Processes}, |
| year |
= |
{2006}, |
| month |
= |
{February}, |
| institution |
= |
{INRIA}, |
| type |
= |
{Research Report}, |
| number |
= |
{5846}, |
| address |
= |
{France}, |
| url |
= |
{http://hal.inria.fr/inria-00070180/fr/}, |
| pdf |
= |
{http://hal.inria.fr/inria-00070180/fr/}, |
| keyword |
= |
{Data energy, Object extraction, Tree Crown Extraction, Marked point process, Stochastic geometry, 3D reconstruction} |
| } |
Résumé :
Dans ce rapport de recherche, notre but est d'extraire les houppiers à partir d'images aériennes de forêts à l'aide de processus ponctuels marqués d'ellipses ou d'ellipsoïdes. Notre approche consiste, en effet, à modéliser les données comme des réalisations de tels processus. Une fois l'objet géométrique de référence choisi, nous échantillonnons le processus objet défini par une densité grâce à un algorithme MCMC à sauts réversibles, optimisé par un recuit simulé afin d'extraire la meilleure configuration d'objets, qui nous donne l'extraction recherchée.
Nous obtenons ainsi le nombre des arbres, leur localisation et leur taille. Nous présentons, dans ce rapport, un modèle 2D et un modèle 3D pour extraire des statistiques forestières. Ceux-ci sont testés sur des images aériennes infrarouge couleur très haute résolution fournies par l'Inventaire Forestier National (IFN). |
Abstract :
High resolution aerial and satellite images of forests have a key role to play in natural resource management. As they enable forestry managers to study forests at the scale of trees, it is now possible to get a more accurate evaluation of the resources. Automatic algorithms are needed in that prospect to assist human operators in the exploitation of these data. In this paper, we present a stochastic geometry approach to extract 2D and 3D parameters of the trees, by modelling the stands as some realizations of a marked point process of ellipses or ellipsoids, whose points are the locations of the trees and marks their geometric features. As a result we obtain the number of stems, their position, and their size. This approach yields an energy minimization problem, where the energy embeds a regularization term (prior density), which introduces some interactions between the objects, and a data term, which links the objects to the features to be extracted, in 2D and 3D. Results are shown on Colour Infrared aerial images provided by the French National Forest Inventory (IFN) |
|
5 - Point Processes in Forestry : an Application to Tree Crown Detection.
G. Perrin and X. Descombes and J. Zerubia. Research Report 5544, INRIA, France, April 2005.
Keywords : Marked point process, Object extraction, RJMCMC, Tree Crown Extraction, Stochastic geometry.
@TECHREPORT{5544,
|
| author |
= |
{Perrin, G. and Descombes, X. and Zerubia, J.}, |
| title |
= |
{Point Processes in Forestry : an Application to Tree Crown Detection}, |
| year |
= |
{2005}, |
| month |
= |
{April}, |
| institution |
= |
{INRIA}, |
| type |
= |
{Research Report}, |
| number |
= |
{5544}, |
| address |
= |
{France}, |
| url |
= |
{https://hal.inria.fr/inria-00070463}, |
| pdf |
= |
{https://hal.inria.fr/file/index/docid/70463/filename/RR-5544.pdf}, |
| ps |
= |
{https://hal.inria.fr/docs/00/07/04/63/PS/RR-5544.ps}, |
| keyword |
= |
{Marked point process, Object extraction, RJMCMC, Tree Crown Extraction, Stochastic geometry} |
| } |
Résumé :
Dans ce rapport de recherche, notre but est d'extraire des houppiers à partir d'images aériennes de forêts à l'aide de processus ponctuels marqués de disques et d'ellipses. Notre approche consiste, en effet, à modéliser les données comme des réalisations de tels processus. Une fois l'objet géométrique de référence choisi, nous échantillonnons le processus objet défini par une densité grâce à un algorithme MCMC à sauts réversibles, optimisé par un recuit simulé afin d'extraire le maximum a posteriori de cette densité. Cette configuration optimale nous donnera l'extraction recherchée.
Dans une première partie, nous proposons de revenir quelque peu sur les processus ponctuels marqués et leur application dans la foresterie. Puis, nous présentons deux nouveaux modèles d'extraction de houppiers à base de disques et d'ellipses, et discutons de quelques améliorations au niveau de la simulation et de l'optimisation de notre algorithme.
Nous présentons des résultats obtenus sur des images aériennes très haute résolution fournies par l'Inventaire Forestier National (IFN), ainsi que sur des images synthétiques simulées avec le logiciel AMAP (Bionatics, projet Digiplante). |
Abstract :
In this research report, we aim at extracting tree crowns from remotely sensed images using marked point processes of discs and ellipses. Our approach is indeed to consider that the data are some realizations of a marked point process. Once a geometrical object is defined, we sample a marked point process defined by a density with a Reversible Jump Markov Chain Monte Carlo dynamics and simulated annealing to get the maximum a posteriori estimator of the tree crown distribution on the image.
In a first part, we propose to review the basis of marked point processes and some of their examples used in forestry statistic inference. Then, we present two new models, with discs and ellipses, and discuss some improvements made in the optimization or in the simulation.
Results are shown on high resolution aerial images of poplars provided by the French Forest Inventory (IFN), and synthetic images simulated with AMAP software (Bionatics, Digiplante project). |
|
6 - Contours Actifs d'Ordre Supérieur Appliqués à la Détection de Linéiques dans des Images de Télédétection.
M. Rochery and I. H. Jermyn and J. Zerubia. Research Report 5063, INRIA, France, December 2003.
Keywords : Line networks, Active contour, Deformable models, Object extraction.
@TECHREPORT{RRRochery03,
|
| author |
= |
{Rochery, M. and Jermyn, I. H. and Zerubia, J.}, |
| title |
= |
{Contours Actifs d'Ordre Supérieur Appliqués à la Détection de Linéiques dans des Images de Télédétection}, |
| year |
= |
{2003}, |
| month |
= |
{December}, |
| institution |
= |
{INRIA}, |
| type |
= |
{Research Report}, |
| number |
= |
{5063}, |
| address |
= |
{France}, |
| url |
= |
{https://hal.inria.fr/inria-00071521}, |
| pdf |
= |
{https://hal.inria.fr/file/index/docid/71521/filename/RR-5063.pdf}, |
| ps |
= |
{https://hal.inria.fr/docs/00/07/15/21/PS/RR-5063.ps}, |
| keyword |
= |
{Line networks, Active contour, Deformable models, Object extraction} |
| } |
Résumé :
Dans ce rapport, nous présentons une nouvelle méthode pour l'incorporation d'une information sur la géométrie a priori dans le cadre des contours actifs. Nous introduisons une nouvelle classe de contours actifs d'ordre supérieur, qui sont des énergies quadratiques sur l'espace des 1-chaînes, contrairement aux énergies classiquement utilisées qui sont linéaires. Ces énergies permettent de définir des interactions non triviales entre les différents points du contour. Elles donnent naissance à des forces non locales, permettant ainsi d'introduire une information géométrique forte dans le modèle. D'un point de vue algorithmique, nous utilisons la méthodologie par courbes de niveau afin de trouver le minimum de l'énergie, la présence de forces non locales nécessitant une extension des méthodes standard utilisées pour l'évolution que nous décrivons. Nous utilisons ce nouveau modèle pour la détection de linéiques (routes, rivières, ...) dans les images de télédétection et nous montrons des résultats d'extraction sur des images réelles. |
Abstract :
In this report, we introduce a new class of active contour energies, quadratic on the space of 1-chains, as opposed to classical energies, which are linear. These energies define non trivial interactions between different points of the contour, and thus allow the incorporation of a priori shape information through the generation of non-local forces that carry geometric information. They also allow the definition of complex data terms linking the data at different points of the contour. To solve the models, we use the level set methodology, in the process extending the standard evolution methods to deal with the non-locality of the forces involved. We use this new approach in order to define models for the extraction of line networks (roads, rivers, ...) in satellite imagery. We show some results on real-world images. |
|
top of the page
These pages were generated by 
|
New demo webpage
get the bibtex
