GMMs and Texture


Up
Adaptive Models of Textured Regions
Wold Decomposition
GMMs and Texture
HMTs and Texture and Colour

Collaborators:

Haim Permuter (Ben-Gurion University, Israel), Joseph Francos (Ben-Gurion University, Israel).

Key words:

texture, colour, classification, Gaussian mixture models, expectation maximization (EM), wavelets.

Resume:

This work uses Gaussian mixture models of image features to characterize texture and colour properties, and hence to classify image blocks. The basic quantity in which we are interested is the likelihood of an image block given its class. Texture models and colour models are developed separately, and then combined using a decision-theoretic criterion.

The texture GMMs were tested using a variety of "structure" features: the distribution of energy in the subbands of various wavelet decompositions of the block; the energy in subbands of the DCT of the block; and the parameters of AR models of the block of different orders. Wavelets were found to perform best, although in practice little difference was observed on using different mother wavelets or the DCT with dyadic subbands. The colour GMMs used the RGB mean and covariance on the block.

The parameters of these models were learned using the EM algorithm, whose update step can be given in closed form for GMMs.

The ability of the models to retrieve textures from the VisTex database has been compared to other classic methods on the same database, and a net improvement observed. Current work is focused on the retrieval of images from a database of aerial images kindly provided by the IGN (French National Geographic Institute).

Results:

Iteration CART LVQ1 HMM MHMM GMM
1 22.6 21.6 19.0 17.3 16.4
2 18.0 19.1 17.6 16.3 14.0
3 28.9 28.4 20.3 17.8 19.6
4 25.2 24.9 24.0 20.5 19.1
5 14.2 18.7 18.3 12.5 4.2
6 20.2 18.1 13.3 11.5 15.4
Mean 21.5 21.8 18.8 16.0 14.8
 

Publications:

  • "Gaussian Mixture Models of Texture and Colour for Image Database Retrieval", H. Permuter, J. Francos and Ian H. Jermyn. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, Hong Kong, April 2003. (PDF)
 
Ariana (joint research group CNRS/INRIA/UNSA), INRIA Sophia Antipolis
2004 route des Lucioles, B.P. 93, 06902 Sophia Antipolis Cedex, France.
E: Ian.Jermyn@sophia.inria.fr
T: +33 (0)4 92 38 76 83
F: +33 (0)4 92 38 76 43