Pierre Kornprobst

Inria Researcher
in Vision Science

Biovision team

Associate Editor for the CVIU

Member of the Academic Council of the Université Côte d'Azur

The scientific study of vision encompasses many disciplines such as computer vision, neuroscience or ophtalmology. Indeed, vision is a key sense in both artificial and biological systems and this is what motivated all my research. My research is characterized by a rich interaction between theoretical models, applications and experimental data analysis.

My initial research was on applying techniques from PDEs and variational approaches to computer vision problems. In 2002, I made a major change in my research to develop neurally and psychophysically motivated models of the visual system and then revisit computer vision problems with bio-inspired approaches. This work made me want to start new collaborations with biologists to be closer to experiments, in order to push the limits of models through design and analysis of experimental data. Finally, given my expertise in vision science, and with the recent creation of the new Biovision team, I started to investigate how models of the visual system and methods from computer vision could be combined to help low vision people.

NEWS     BOOKS     PAPERS     SUPERVISION     SOFTWARE     COURSES     CONTACT

NEWS

(05/2017: workshop organized) Workshop UCAGATE: Pour une Plateforme d'Intelligence Territoriale de la Recherche @UCA, organized by Pierre Kornprobst and Mylène Leitzelman (Mnemotix), on May 16 at Inria Sophia Antipolis - Méditerranée (Amphi Kahn).

(03/2017: new conference) Real-time image enhancement in virtual reality applications for low vision people, M. Chessa, A. Patino-Saucedo, H. Rostro, E. Castet, F. Solari, P. Kornprobst, will be presented at Vision 2017, the 12th International Conference by the International Society for Low Vision Research and Rehabilitation (ISLRR).

(03/2017: submitted) Recurrent network dynamics reconciles visual motion segmentation and integration, N.V.K. Medathati, J. Rankin, A.I. Meso, P. Kornprobst and G.S. Masson, Inria Research Report 9041, March 2017.

(02/2017: submitted) A bio-inspired synergistic Virtual Retina model for tone mapping, M. Benzi, M.J. Escobar, A. Bousseau and P. Kornprobst, Inria Research Report 9033, February 2017.

(01/2017: new paper) Pan-retinal characterization of Light Responses from Ganglion Cells in the Developing Mouse Retina, by G. Hilgen, S. Pirmoradian, D. Pamplona, P. Kornprobst, B. Cessac, M. H Hennig, E. Sernagor, Scientific Reports, 2017 (to appear).

(12/2016: new paper) The relative contribution of noise and adaptation to competition during tri-stable motion perception, A. Meso, J. Rankin, O. Faugeras, P. Kornprobst G. Masson, Journal of Vision, 16(15):6. doi: 10.1167/16.15.6. 2016

(10/2016: new report) ENAS: A new software for spike train analysis and simulation, B. Cessac, P. Kornprobst, S. Kraria, H. Nasser, D. Pamplona, G. Portelli and T. Viéville, Inria Research Report 8958, Submitted and under revision. A free access user-end software for the analysis of collective spike trains statistics oriented toward retina data analysis and simulation, devoted to the neuroscience community. (learn more)

(08/2016: new report) A new nonconvex variational approach for sensory neurons receptive field estimation, A. Drogoul, G. Aubert, B. Cessac and P. Kornprobst, Inria Research Report 8837, submitted and under revision.

On going projects with Eric Castet (LPC, Marseille, France), Bruno Cessac (Inria, France), Maria-Jose Escobar (Universidad Técnica Federico Santa María, Chile), Matthias Henning (University of Edimburg, UK), Guillaume S. Masson (Insitut des Neurosciences de la Timone, France), James Rankin (New York University, USA), Evelyne Sernagor (University of Newcastle, UK), Fabio Solari (University of Genova, Italy), Timothée Masquelier (Institut de la Vision, France).


BOOKS

Modeling in Computational Biology and Biomedicine: A Multidisciplinary Endeavor, F. Cazals and P. Kornprobst, Eds, Springer, 2013

Mathematical problems in image processing: Partial Differential Equations and the Calculus of Variations, G. Aubert and P. Kornprobst, Springer, Applied Mathematical Sciences, Vol 147, 2006 (second edition).
SIAM Review: "Mathematical Problems in Image Processing is a major, elegant, and unique contribution to the applied mathematics literature, oriented toward applications in image processing and computer vision .../... Researchers and practitioners working in the field will benefit by adding this book to their personal collection. Students and instructors will benefit by using this book as a graduate course textbook."


PAPERS

Full list of publications

Pan-retinal characterization of Light Responses from Ganglion Cells in the Developing Mouse Retina, by G. Hilgen, S. Pirmoradian, D. Pamplona, P. Kornprobst, B. Cessac, M. H Hennig, E. Sernagor, Scientific Reports, 2017 (to appear).

The relative contribution of noise and adaptation to competition during tri-stable motion perception, A. Meso, J. Rankin, O. Faugeras, P. Kornprobst G. Masson, Journal of Vision, 16(15):6. doi: 10.1167/16.15.6. 2016

The wave of first spikes: a retinal information coding strategy revealed by large-scale multielectrode array recordings, G. Portelli, J.M. Barrett, G. Hilgen, T. Masquelier, A. Maccione, S. Di Marco, L. Berdondini, P. Kornprobst, E. Sernagor, eNeuro, 2016.

Bio-Inspired Computer Vision: Towards a Synergistic Approach of Artificial and Biological Vision, N.V.K. Medathati, H. Neumann, G.S. Masson and P. Kornprobst, Computer Vision and Image Understanding, Volume 150, September 2016, Pages 1-30, 2016.

Microsaccades enable efficient synchrony-based coding in the retina: a simulation study, T. Masquelier, G. Portelli and P. Kornprobst. Scientific Reports 6, Article number: 24086, 2016.

What can we expect from a V1-MT feedforward architecture for optical flow estimation? F. Solari, M. Chessa, N.V.K. Medathati, and P. Kornprobst. Volume 39, Part B, Pages 342–354, November 2015, Note: Our code is available on ModelDB.

Bifurcation Study of a Neural Fields Competition Model with an Application to Perceptual Switching in Motion Integration, J. Rankin, A. I. Meso, G. S. Masson, O. Faugeras, and P. Kornprobst. Journal of Computational Neuroscience, Vol. 36, No. 2, pp. 193--213, 2014.

Bifurcation analysis applied to a model of motion integration with a multistable stimulus, J. Rankin, E. Tlapale, R. Veltz, O. Faugeras, and P. Kornprobst. Journal of Computational Neuroscience, Vol. 34, No. 1, pp. 103--124, 2013. Try the stimulus (fix the center)!

Streaming an image through the eye: The retina seen as a dithered scalable image coder, K. Masmoudi, M. Antonini, and P. Kornprobst. Signal Processing: Image Communication 28 (8), pp. 856--869, 2013.

Frames for Exact Inversion of the Rank Order Coder, K. Masmoudi and M. Antonini, and P. Kornprobst. IEEE Transactions on Neural Networks and Learning Systems, 23(2):353-359, 2012.

Action recognition via bio–inspired features: The richness of center-surround interaction, M.J. Escobar and P. Kornprobst. Computer Vision and Image Understanding, 116(5):593-605, 2012. You can watch our Audioslide presentation available in CVIU website

Variational multi-valued velocity field estimation for transparent sequences, A. Ramirez, M. Rivera, Pierre Kornprobst, and F. Lauze. Journal of Mathematical Imaging and Vision, 40(3):285–304, 2011.

Neural mechanisms of motion detection, integration, and segregation: From biology to artificial image processing systems. J.D. Bouecke, E. Tlapale, P. Kornprobst, and H. Neumann. EURASIP Journal on Advances in Signal Processing, vol 2011, Special issue on Biologically inspired signal processing: Analysis, algorithms, and applications, 2011.

Modelling the dynamics of motion integration with a new luminance-gated diffusion mechanism. E. Tlapale, G. S. Masson, and P. Kornprobst. Vision Research, 50(17):1676-1692, 2010.

Virtual Retina: A biological retina model and simulator, with contrast gain control. A. Wohrer and P. Kornprobst. Journal of Computational Neuroscience, 26(2):219, 2009. This simulator is open-source (see Virtual Retina simulator website)

Bilateral Filtering: Theory and Applications. S. Paris, P. Kornprobst, J. Tumblin, and F. Durand. Foundations and Trends in Computer Graphics and Vision, 4(1):1-73, 2009. This paper is a summary of tutorials given at SIGGRAPH and CVPR (see TALKS/COURSES section)

Action Recognition Using a Bio-Inspired Feedforward Spiking Network. M.-J. Escobar, G. S. Masson, T. Vieville, and P. Kornprobst. International Journal of Computer Vision, 82(3):284, 2009.

Can the Nonlocal Characterization of Sobolev Spaces by Bourgain et al. Be Useful for Solving Variational Problems? G. Aubert and P. Kornprobst. SIAM J. Numer. Anal. 47(2):844-860, 2009.

How do high-level specifications of the brain relate to variational approaches? T. Vieville, S. Chemla, and P. Kornprobst. Journal of Physiology Paris, 101(1-3):118-135, 2007.

The use of superresolution techniques to reduce slice thickness in functional MRI. R.R. Peeters, P. Kornprobst, M. Nikolova, S. Sunaert, T. Vieville, G. Malandain, R. Deriche, O. Faugeras, M. Ng, and P. Van Hecke. International Journal of Imaging Systems and Technology (IJIST), Special issue on High Resolution Image Reconstruction, 14:131–138, 2004.

Image sequence analysis via partial differential equations. P. Kornprobst, R. Deriche, and G. Aubert. Journal of Mathematical Imaging and Vision, 11(1):5-26, 1999.

A mathematical study of the relaxed optical flow problem in the space BV. G. Aubert and P. Kornprobst. SIAM Journal on Mathematical Analysis, 30(6):1282-1308, 1999.

Computing optical flow via variational techniques. G. Aubert, R. Deriche, and P. Kornprobst. SIAM Journal of Applied Mathematics, 60(1):156-182, 1999.


SUPERVISION

Current

Alberto Patiño Saucedo (internship)
Image transforms for low-vision
co-supervised with Fabio Solari (University of Genova)

Marco Benzi Tobar (internship)
Retina-inspired tone mapping
co-supervised with Maria-Jose Escobar (UTFSM)

Past

PHDs...

N. V. Kartheek Medathati (2013-2016)
Motion perception and attention: from visual neuroscience to artificial vision systems
co-supervised with Guillaume Masson (INT)
Defence: Dec. 13, 2016

Khaled Masmoudi (2008-2012)
Conception of Novel Bio-Inspired Coding Systems
co-supervised with Marc Antonini (CNRS, I3S)
Now: C++/C# developer at AVM-Informatique

Emilien Tlapale (2009-2011)
Modelling the dynamics of contextual motion integration in the primate
co-supervised with Guillaume Masson (INT)
Now: R&D 3D Engineer at Airbus DS Geo

Maria-Jose Escobar (2006-2009)
Bio-Inspired Models for Motion Estimation and Analysis: Human action recognition and motion integration
co-supervised with Guillaume Masson (INT)
Now: Researcher at UTFSM (Chile)

Adrien Wohrer (2004-2008)
Model and large-scale simulator of a biological retina, with contrast gain control
Now: Assistant professor at Université d'Auvergne in Clermont-Ferrand (France)

Postdocs...

Daniela Pamplona (2014-2016)
Retina modeling & new approaches for receptive field estimation.
Now: Postdoc at ENSTA-ParisTech

Audric Drogoul (2014-2016)
Variational approaches for receptive field estimation
Now: Research Engineer at Thales Alenia Space

Geoffrey Portelli (2012-2015)
Understanding the wave of first spike (from MEA recordings) & the role of micromovements (from simulations)
Now: Postdoctoral researcher at I3S, CNRS - Université de Nice Sophia Antipolis, MinD team

James Rankin (2010-2013)
Perceptual switching in motion integration
Now: Lecturer in Mathematical Biology at Exeter University, UK

Vivien Robinet (2010-2011)
Neural network functional connectivity from spike train analysis
Now: Assistant professor, Université des Antilles et de la Guyane (UAG)

Neil Bruce (2008-2010)
Models of saliency for video-surveillance systems
Now: Assistant professor, University of Manitoba, Canada


SOFTWARE

VIRTUAL RETINA: A bio-inspired retina simulator for large-scale spiking simulations. It transforms your videos into spike trains. You can install it or run it through ENAS.

ENAS: A free access user-end software for the analysis of collective spike trains statistics oriented toward retina data analysis and simulation, devoted to the neuroscience community. (learn more)

AB filter: this library implements the physiological plausible filters proposed by Adelson and Bergen in 1985.

PDE library: A CImg plugin with classical image restoration and segmentation approaches (a new version is in preparation)


COURSES

Founder and coordinator of the Master of Science in Computational Biology and Biomedicine, Université Nice Sophia Antipolis, from Nov. 2008 until Sept. 2011.

A Gentle Introduction to Bilateral Filtering and its Applications: A class at ACM SIGGRAPH 2008, CVPR 2008 and ACM SIGGRAPH 2007 with S. Paris, J. Tumblin, and F. Durand

Introduction to PDEs and variational approaches in image processing (in french)

Traitement des images numériques, G. Aubert and P. Kornprobst. In J. Akoka and I. Comyn-Wattiau, editors, Encyclopédie de l’informatique et des systèmes d’information, number 6, chapter 18, pages 861—879. Vuibert, November 2006.

Introduction to image processing (in french)


CONTACT

Inria Sophia Antipolis - Méditerranée
Biovision team
2004 Route des Lucioles - BP 93
06902 Sophia Antipolis Cedex
France

Email: pierre.kornprobst (AT) inria.fr
Phone: +33(0)4-92-38-79-79


Inria Sophia Antipolis - Méditerranée is a member of Université Côte d'Azur (UCA). In 2016, UCA has won, with its UCAJEDI project, a "IDEX" (Initiatives d’excellence) award of the French Investments for the Future Program. This project aims at profoundly impacting and transforming research activity in the area, fostering the emergence of new transdisciplinary research projects.