Avik Bhattacharya

Ancien Doctorant, CNES / INRIA / ENST

Contact :

Résumé :

Mini CV :

Dernières publications dans le projet Ariana :

Indexing of mid-resolution satellite images with structural attributes. A. Bhattacharya et M. Roux et H. Maitre et I. H. Jermyn et X. Descombes et J. Zerubia. Dans The International Society for Photogrammetry and Remote Sensing, Beijing, China, juillet 2008. Mots-clés : Landscape, Segmentation, Features, Extraction, Classification, Modelling. @INPROCEEDINGS{Bhattacharya08, author = {Bhattacharya, A. and Roux, M. and Maitre, H. and Jermyn, I. H. and Descombes, X. and Zerubia, J.}, title = {Indexing of mid-resolution satellite images with structural attributes}, year = {2008}, month = {juillet}, booktitle = {The International Society for Photogrammetry and Remote Sensing}, address = {Beijing, China}, pdf = {http://www-sop.inria.fr/members/Ian.Jermyn/publications/Bhattacharya08isprs.pdf}, keyword = {Landscape, Segmentation, Features, Extraction, Classification, Modelling} } Abstract : Indexing and retrieval of satellite images relies on the extraction of appropriate information from the data about the entity of interest (e.g. land cover type) and on the robustness of this extraction to nuisance variables. Entities in an image may be strongly correlated with each other and can therefore be used to characterize geographical environments on the Earth’s surface. The properties of road networks vary considerably from one geographical environment to another. The networks pertaining in a satellite image can therefore be used to classify and retrieve such environments. In the work presented in this paper we have defined 7 such classes. These classes can be categorized as follows: 2 urban classes consisting of “Urban USA” and “Urban Europe”; 3 rural classes consisting of “Villages”, “Mountains” and “Fields”; an “Airports” class and a “Common” class (this can be considered as a rejection class). These classes were then classified with the aid of geometrical and topological features computed from the road networks occurring in them. In our work we have used two extraction methods simultaneously on an image to extract the road networks pertaining in it. A set of 16 network features were computed from one extraction method and were categorized into 6 groups as follows: 6 measures of ‘density’, 4 measures of ‘curviness’, 2 measures of ‘homogeneity’, 1 measure of ‘length’, 2 measures of ‘distribution’ and 1 measure of ‘entropy’. Due to certain limitations of these extraction methods there was a relative failure of network extraction in certain urban regions con- taining narrow and dense road structures. This loss of information was circumvented by segmenting the urban regions and computing a second set of geometrical and topological features from them. A set of 4 urban region features were computed and were categorized into 3 groups as follows: 2 measures of ‘density’, 1 measure of ‘labels’ and 1 measure of ‘compactness’. The 500 images (each of size 512x512 pixels) forming our database were selected from SPOT5 scenes with 5m resolution. From each image a set of geometrical and topological features were computed from the road networks and urban regions. These features were then used to classify the pre-defined geographical classes. Feature selection was done to avoid the burden of feature dimensionality and increase the classification performance. A set of 20 features was selected from 36 features by Fisher Linear Discriminant (FLD) analysis which gave the least classification error with an one-vs-rest linear Support Vector Machine (SVM). The impact of spatial resolution and size of images on the feature set have been explored in this work. We took a closer look at the effect of spatial resolution and size of images on the discriminative power of the feature set to classify the images belonging to the pre-defined geographical classes. Tests were performed with feature selection by FLD and one-vs-rest linear SVM classification on a database with images of 10m resolution. Another test was performed with feature selection by FLD and one-vs-rest linear SVM classification on a database with 5m resolution images (each of size 256x256 pixels). With the above mentioned approaches, we developed a novel method to classify large satellite images acquired by SPOT5 satellite (5m resolution) with patches of images each of size 512x512 pixels extracted from them. There has been a large amount of work dedicated to the classification of large satellite images at pixel level rather than considering image patches of different sizes. Classification of image patches of different sizes from a large satellite image is a novel idea in the sense that the patches considered contain significant coverage of a particular type of geographical environment. Road networks and urban region features were computed from these image patches extracted from the large image. A one-vs-rest Gaussian kernel SVM classification method was used to classify this large image. The classification results show that the image patches were labeled with the class having the maximum geographical coverage of the area associated in the large image. The large image was mapped into a “region matrix”, where each element of the matrix corresponds to a geographical class. This is a ‘hard’ classification and no inference can be drawn about the classification confidence. In certain cases, this produces some anomalies, as a single patch may contain two or more different geographical coverages. In order to have an estimate of these partial coverages, the output of the SVM was mapped into probabilities. These probability measures were then studied to have a closer look at the classification accuracies. The results confirm that our method is able to classify a large image into various geographical classes with a mean error of less than 10%. Future studies can use operators to detect not only man-made structures like roads and urban areas, but also natural entities like rivers, forests, etc. In this work we have restricted ourselves to a single resolution, but our methodology can be adapted to consider images of higher resolutions from QuickBird and the future Pleiade satellite. At a better resolution it may be possible to extract different structures like buildings, gardens, cross-roads, etc. This in turn will allow us to incorporate more classes to appropriately classify any geographical environment. At an image resolution of 1m, we may imagine to have sub-classes of an existing class, e.g., classes like urban Europe and urban USA can de divided into downtown, residential and industrial classes. Indexing Satellite Images with Features Computed from Man-Made Structures on the Earth’s Surface. A. Bhattacharya et M. Roux et H. Maitre et I. H. Jermyn et X. Descombes et J. Zerubia. Dans Proc. International Workshop on Content-Based Multimedia Indexing, Bordeaux, France, juin 2007. Mots-clés : Indexation, Reseaux routiers, Semantique, Retrieval, Feature statistics. @INPROCEEDINGS{Bhattacharya07a, author = {Bhattacharya, A. and Roux, M. and Maitre, H. and Jermyn, I. H. and Descombes, X. and Zerubia, J.}, title = {Indexing Satellite Images with Features Computed from Man-Made Structures on the Earth’s Surface}, year = {2007}, month = {juin}, booktitle = {Proc. International Workshop on Content-Based Multimedia Indexing}, address = {Bordeaux, France}, pdf = {ftp://ftp-sop.inria.fr/ariana/Articles/2007_Bhattacharya07a.pdf}, keyword = {Indexation, Reseaux routiers, Semantique, Retrieval, Feature statistics} } Abstract : Indexing and retrieval from remote sensing image databases relies on the extraction of appropriate information from the data about the entity of interest (e.g. land cover type) and on the robustness of this extraction to nuisance variables. Other entities in an image may be strongly correlated with the entity of interest and their properties can therefore be used to characterize this entity. The road network contained in an image is one example. The properties of road networks vary considerably from one geographical environment to another, and they can therefore be used to classify and retrieve such environments. In this paper, we define several such environments, and classify them with the aid of geometrical and topological features computed from the road networks occurring in them. The relative failure of network extraction methods in certain types of urban area obliges us to segment such areas and to add a second set of geometrical and topological features computed from the segmentations. To validate the approach, feature selection and SVM linear kernel classification are performed on the feature set arising from a diverse image database. Indexing of satellite images using structural information. A. Bhattacharya. Thèse de Doctorat, Ecole Nationale Supérieure des Télécommunications, 2007. Mots-clés : Landscape, Segmentation, Features, Extraction, Classification, Data mining. @PHDTHESIS{bhattacharya_these, author = {Bhattacharya, A.}, title = {Indexing of satellite images using structural information}, year = {2007}, school = {Ecole Nationale Supérieure des Télécommunications}, pdf = {ftp://ftp-sop.inria.fr/ariana/Articles/2007_bhattacharya_these.pdf}, keyword = {Landscape, Segmentation, Features, Extraction, Classification, Data mining} }

Liste complète des publications dans le projet Ariana