Collaborators


Keywords

Neuronal Networks dynamics, synaptic plasticity, spikes train statistics.



Dynamical analysis of neural networks. The mathematical study of neuronal networks dynamics is faced to several problems. 

(i) To propose "good" models, namely biologically relevant and mathematically well posed ; 

(ii) To make the analysis of these model-dynamics, with rigorous and analytical results if possible, and with a good control on numerical simulations ; 

(iii) To interpret and extrapolate these results and compare them to real neuronal networks behaviour.

This constitutes a real challenge since neuronal networks are dynamical systems with a huge number of degree of freedom and parameters, multi-scales organisation with complex interactions. For example neurons dynamics depend on synaptic connexions while synapses evolve according to the neurons activity. Analysing this interwoven activity requires the development of new methods. Methods coming from theoretical physics and applied mathematics can be adapted to produce efficient analysis tools while providing useful concepts. I am developing such methods based on statistical physics (mean-field theory, Gibbs distribution analysis), dynamical systems theory (global stability, bifurcation analysis, characterisation of chaotic dynamics) and ergodic theory (symbolic coding, thermodynamic formalism). I believe that such an analysis is an important step towards the characterisation of in vitro or in vivo neuronal neworks, from space scales corresponding to a few neurons to scales characterising e.g. cortical columns. With my colleagues, we have characterized the dynamics of several firing rate and spiking neurons models and studied neural mass models with several populations that mimics cortical columns architecture.

Spike train analysis. Neurons activity results from complex and nonlinear mechanisms leading to a wide variety of dynamical behaviours. This activity is revealed by the  emission of action potentials or ``spikes''. While the shape of an action potential is essentially always the same for a given neuron,the succession of spikes emitted by this neuron can have a wide variety of patterns (isolated spikes, periodic spiking, bursting, tonic spiking, tonic bursting, ...), depending on physiological parameters, but also on excitations coming either from other neurons or from external inputs. Thus, it seems natural to consider spikes as ``information  quanta'' or ``bits'' and to seek the information exchanged by neurons in the structure of spike trains. Doing this, one switches from the description of neurons in terms of membrane potential dynamics, to a description in terms of spikes trains. This point of view is used, in experiments, by the analysis of raster plots, i.e. the activity of a neuron is represented by a mere vertical bar each time this neuron emits a spike. Though this change of description raises many questions, it is commonly admitted in the computational neuroscience community that spike trains constitute a ``neural code''. This raises however other questions. How is ``information'' encoded in a spike train ? How to measure the information content of a spike train ? As a matter of fact, a prior to handle ``information'' in a spike train is the definition of a suitable probability distribution that matches the empirical averages obtained from measures and there is currently a wide debate on the canonical form of these probabilities. We are developing methods for the characterisation of spike trains from empirical data. On one hand, we have recently shown how Gibbs distribution are natural candidate for spike train statistics in Integrate and Fire models subjected to synaptic plasticity mechanisms. On the other hand, we are developing numerical methods for the characterization of Gibbs distribution from experimental data (see our MACACC projects for details).


Mean-field analysis to neuronal networks.  This method, well known in the field of statistical physics and quantum field theory, is used in the field of neural networks dynamics with the aim of modeling neural activity at scales integrating the effect of thousands of neurons. This is of central importance for several reasons. First, most imaging techniques are not able to measure individual neuron activity (``microscopic'' scale), but are instead measuring mesoscopic effects resulting from the activity of several hundreds to several hundreds of thousands of neurons. Second, anatomical data recorded in the cortex reveal the existence of structures, such as cortical columns with a diameter of about 50 micrometers to 1 millimeter, containing of the order of one hundred to one thousand neuronsbelonging to a few different species. In this case, information processing does not occur at the  scale of individual neurons but rather corresponds to an  activity integrating the collective dynamics of many interacting neurons and resulting in a mesoscopic signal. Dynamic mean-field theory allows to obtain the equations of evolution of the effective mean-field from microscopic dynamics in several model-examples. We have obtained them in several examples of discrete time neural networks with firing rates, and more recently, derived rigourous results on the mean-field dynamics of models with several populations allowing the rederivation of classical phenomenological equations for cortical columns such as Jensen-Ritt's 
(see our MACACCprojects for details).


Dynamical effects induced by synaptic and intrinsic plasticity
. This collaboration aims to understand how structure of biological neural networks is conditioning their functional capacities, in particular learning. On one hand we are analysing the dynamics of neural network models submitted to Hebbian learning and investigating how the capacity to recognize objects emerges. What are the effect on dynamics and topology ? For this we are using concepts coming from random networks, and non linear analysis (see next item). On the other hand, we are using the informations obtained via this analysis to construct artificial neural network architecture able to learn basic objects and then to perform generalization by emergent dynamics. A typical example is the architecture of the V1 cortex (vision) that we are using as a guideline. In the long term, the goal would be to produce new computer architectures inspired from biological networks.


Interplay between synaptic graph structure and topology. Neuronal networks can be regarded as graphs where each neuron is a vertex and each synaptic connection is an edge. The models have usually simple topologies (e.g. feed forward or recurrent neural networks) but recent research on nervous and brain systems suggests that the actual topology of a real-world neuronal system is much more complex : small-world and scale-free properties are for example observed in human brain networks. There is also a complex interplay between the topological structure of the synaptic graph and the non linear evolution of the neurons. Thus, the existence of synapses between a neuron (A) and another one (B) is implicitly attached to a notion of ``influence’’ or causal and directed action from A to B. However, the neuron B receives usually synapses from many other neurons, each of them being ``influenced’’ by many other neurons, possibly acting on A, etc... Thus, the actual ``influence’’ or action of A on B has to be considered dynamically and in a global sense, by considering A and B not as isolated objects, but, instead, as entities embedded in a system with a complex interwoven dynamical evolution. It is thus necessary to develop tools allowing to handle this interplay. In this spirit we are using the linear response approach (see here for details ). These results could lead to new directions in neural network analysis and more generally in the analysis of non linear dynamical systems on graphs. However the results quoted above were obtained in a specific model example and further investigations must be done, in a more general setting. In this spirit, the present project aims to explore two directions. Recurrent model with spiking neurons (see item 1 above) and Complex architecture and learning (item 2 above).

Publications 

  1. J.C. Vasquez, B. Cessac, T. Viéville, "Entropy-based parametric estimation of spike train statistics", submitted.
  2. B. Cessac, A discrete time neural network model with spiking neurons. II. Dynamics with noise. submitted to J. Math. Biol.
  3. J. Touboul, B. Ermentrout, O. Faugeras, B. Cessac, "Stochastic firing rate models", submitted to "Methods"
  4. H. Rostro, B. Cessac, J.C. Vasquez, T. Viéville , “Back-engineering of spiking neural networks parameters.” , submitted to Journal of Computational Neuroscience.
  5. B. Cessac, H. Paugam-Moisy, T. Viéville, "Indisputable facts when implementing spiking neuron networks", J. Physiol., Paris, in press.
  6. "Du chaos dans les neurones", Pour la Science, Novembre 2009.
  7. T. Viéville, B. Cessac, "Parametric Estimation of spike train statistics", CNS 09 Berlin.
  8. H. ROSTRO-GONZALEZ, T. Viéville, B. Cessac, J. C. VASQUEZ , "Back- engineering of spiking neural networks parameters", CNS 09, Berlin.
  9. J. C. VASQUEZ, B. Cessac, H. Rostro-Gonzalez, T. VIEVILLE, "How Gibbs Distributions may naturally arise from synaptic adaptation mechanism", CNS 09, Berlin.
  10. B. Cessac, H. Rostro, J.C. Vasquez, T. Viéville , “How Gibbs distributions may naturally arise from synaptic adaptation mechanisms", J. Stat. Phys,136, (3), 565-602 (2009).
  11. B. Cessac, ``Neural Networks as dynamical systems'', International Journal of Bifurcations and Chaos, in press.
  12. Faugeras O., Touboul J., Cessac B., “A constructive mean-field analysis of multi population neural networks with random synaptic weights”, COSYNE 09.
  13. O. Faugeras, J. Touboul, B. Cessac, “A constructive mean field analysis of multi population neural networks with random synaptic weights and stochastic inputs”,  Front. Comput. Neurosci. (2009) 3:1.
  14. B. Cessac, H. Rostro, J.C. Vasquez, T. Viéville, "Statistics of spikes trains, synaptic plasticity and Gibbs distributions", proceedings of the conference NeuroComp 2008 (Marseille).
  15. B. Cessac, Viéville T., ``On Dynamics of Integrate-and-Fire Neural Networks with Adaptive Conductances.'', Front. Comput. Neurosci. (2008) 2:2.
  16. Cessac B.,. "A discrete time neural network model with spiking neurons. Rigorous results on the spontaneous dynamics. , Journal of Mathematical Biology, Volume 56, Number 3, 311-345 (2008).
  17. Siri B., Berry H., Cessac B., Delord B., Quoy M., « A mathematical analysis of the effects of Hebbian learning rules on the dynamics and structure of discrete-time random recurrent neural networks », Neural Comp., vol 20, num 12, (2008), pp 2937-2966.
  18. Siri, B., Quoy, M., Cessac, B., Delord, B. and Berry, H., ``Effects of Hebbian learning on the dynamics and structure of random networks with inhibitory and excitatory neurons''. Journal of Physiology (Paris),101(1-3):138-150 (2007).
  19. Siri, B., Berry, H., Cessac, B., Delord, B. and Quoy, M., ``Local learning rules and bifurcations in the global dynamics of random recurrent neural networks''. European Conference on Complex Systems (ECCS'07), October, Dresden, Germany, (2007).
  20. Siri B., Berry H., Cessac B., Delord B., Quoy M., "Local learning rules and bifurcations in the global dynamics of random recurrent neural networks", ECSS conference (2007).
  21. B. Cessac, Thierry Viéville, ``Revisiting time discretisation of spiking network models'', from Sixteenth Annual Computational Neuroscience Meeting : CNS*2007 Toronto, Canada. 7-12 July 2007.-BMC Neuroscience 2007, 8(Suppl 2) :P76 doi:10.1186/1471-2202-8-S2-P76.
  22. Cessac B., Dauce E., Perrinet L., Samuelides M., (2007), ``Topics in dynamical neural networks - From large scale neural networks to motor control and vision - Introduction’’ EPJ Special Topics, Vol. 142, Num 1,1-5 .
  23. B. Cessac, T. Viéville, C. Leininger, "Le cerveau est-il un bon modèle de réseau de neurones ?" , "Interstices", 11-07, (2007).
  24. Samuelides M., Cessac B., (2007) "Mean-field Approaches of Large Networks Dynamics.", EPJ Special Topics "Topics in Dynamical Neural Networks : From Large Scale Neural Networks to Motor Control and Vision", Vol. 142, Num. 1, 89-122..
  25. Cessac B., Samuelides M., (2007) "From Neuron to Neural Networks dynamics", EPJ Special Topics "Topics in Dynamical Neural Networks : From Large Scale Neural Networks to Motor Control and Vision", Vol. 142, Num. 1, 7-88..
  26. Siri, B., Berry, H., Cessac, B., Delord, B. and Quoy, M. ``Topological and dynamical structures induced by Hebbian learning in random neural networks''. In International Conference on Complex Systems, ICCS 2006, Boston, MA, USA, June 2006.
  27. Siri B., Berry H., Cessac B., Delord B., Quoy M., Temam O., "Learning-induced topological effects on dynamics in neural networks", Neurocomp (2006).
  28. B. Siri, H. Berry, B. Cessac, B. Delord, M. Quoy, "Topological and dynamical structures induced by Hebbian learning in random neural networks", 2006 International Conference on Complex Systems, june 2006, Boston
  29. B. Cessac, O. Mazet, M. Samuelides, H. Soula, "Mean field theory for random recurrent spiking neural networks", NOLTA’05 (Non Linear Theory and its Applications) October 18-21, 2005, Brugge, Belgium.
  30. Dauce E., Quoy M., Cessac B., Doyon B. and Samuelides M. "Self- Organization and Dynamics reduction in recurrent networks : stimulus presentation and learning", Neural Networks, (11) (1998), 521-533.
  31. Samuelides M., Doyon B., Cessac B., Quoy M. "Spontaneous dynamics and associative learning in an asymmetric recurrent neural network", Math. of Neural Networks, (1996), 312-317.
  32. Cessac B., "Increase in complexity in random neural networks", J. de Physique I (France), 5, (1995), 409-432.
  33. Cessac B., "Absolute Stability criteria for random asymmetric neural networks", J. of Physics A, 27, (1994), L927-L930.
  34. Cessac B., "Occurence of chaos and AT line in random neural networks", Europhys. Let., 26 (8), (1994), 577-582.
  35. Cessac B., "Propriétés statistiques des dynamiques de réseaux neuromimétiques", Thèse de Doctorat, Toulouse (1994).
  36. Cessac B., Doyon B., Quoy M., Samuelides M., "Mean-field equations, bifurcation map, and route to chaos in discrete time neural networks", Physica 74 D, (1994), 24-44.
  37. Doyon B., Cessac B., Quoy M., Samuelides M., "Control of the transition to chaos in neural networks with random connectivity", Int. Jour. Bif. Chaos, Vol 3, No 2, (1993), 279-291.
  38. Doyon B., Cessac B., Quoy M., Samuelides M., "On bifurcations and chaos in random neural networks", Acta Biotheoretica, 42, (1994), 215-225.
  39. Doyon B., Cessac B., Quoy M., Samuelides M., "Control of the transition to chaos in neural networks with random connectivity", Int. Jour. Bif. Chaos, Vol 3, No 2, (1993), 279-291.
  40. Quoy M., Cessac B., Doyon B., Samuelides M., "Dynamical behaviour of neural networks with discrete time dynamics", Neural Network World, Vol 3, Num 6, (1993), 845-848.
  41. Doyon B., Cessac B., Quoy M., Samuelides M., "Destabilization and route to chaos in neural networks with random connectivity", Neural Information and Processing Systems : Natural and Synthetics. (1992).