34 Research Projects

12 European Projects

13 National Projects

7 Industrial Projects

3 International Projects

PANORAMA is an ENIAC European Project which has started on the 1st of April 2012 and will last 36 months. INRIA Grant is 398.5 Keuros (369KE). This project concerns advanced image-video processing algorithms that are typically acquired with multiple cameras and processed on high performance computing hardware.

PANORAMA aims to research, develop and demonstrate generic breakthrough technologies and hardware architectures for a broad range of imaging applications. For example, object segmentation is a basic building block of many intermediate and low level image analysis methods. In broadcast applications, segmentation can find people's faces and optimize exposure, noise reduction and color processing for those faces; even more importantly, in a multi-camera setup these imaging parameters can then be optimized to provide a consistent display of faces (e.g., matching colors) or other regions of interest.

PANORAMA will deliver solutions for applications in medical imaging, broadcasting systems and security & surveillance, all of which face similar challenging issues in the real time handling and processing of large volumes of image data. These solutions require the development of imaging sensors with higher resolutions and new pixel architectures. Furthermore, integrated high performance computing hardware will be needed to allow for the real time image processing and system control. The related ENIAC work program domains and Grand Challenges are Health and Ageing Society - Hospital Healthcare, Communication & Digital Lifestyles - Evolution to a digital lifestyle and Safety & Security - GC Consumers and Citizens security

The project is executed by a strong international consortium, containing large high-tech companies (e.g. Philips Healthcare, Medisys, Grass Valley, Bosch Security Systems, STMicroelectronics, Thales Angenieux, Capna, CMOSIS,...), smaller innovative SMEs (CycloMedia, Q-Free) and is complemented with relevant research groups and departments from well-known universities (TU Eindhoven, University of Leeds, University of Catania) and research institutes (INRIA, ARMINES, IBBT). Participating countries are France, Italie, U.K., Belgium, Netherlands.

This French project aims at providing evidences concerning the interest of serious games to design non pharmacological approaches to prevent dementia patients from behavioral disturbances, most particularly for the stimulation of apathy.

Az@GAME est un projet DGCIS - Investissements d'Avenir - dans le cadre de l'appel: Santé et autonomie sur lieu de vie grâce au Numérique dans le programme: Développement de l'Economie Numérique volet Usages, Services et contenus innovants. C'est un projet de 3 ans commencant le 1er janvier 2012. Les principaux partenaires sont : Groupe Genious, IDATE, INRIA, CMMR du CHU nice et équipe CobTek. INRIA recoit un financement de 203 872 euros.

Az@GAME est un dispositif ergonomique, innovant et ludique qui s'adresse aux patients souffrant de la maladie d'Alzheimer, aux aidants familiaux et professionnels. Az@GAME évalue et favorise le maintien de l'autonomie dans la maladie d'Alzheimer et les pathologies associées. Les entrainements cognitifs, fonctionnels et physiques du patient lui permettent de conserver un maximum d'autonomie mais aussi de remonter des informations de suivi auprès des aidants. Les signes de la maladie apparaissent progressivement, l'état du patient évolue, les besoins en formation de l'aidant familial aussi. En fonction des résultats des entrainements du patient et de l'état de ses connaissances, l'aidant se voit proposer un parcours de formation personnalisé et adapté à ses besoins. En EHPAD, les équipes soignantes peuvent suivre grâce à Az@GAME l'état de l'évolution de la maladie de leurs patients et une formation interactive avec mises en situation virtuelles qui permettent un entraînement auto-évaluatif par feedbacks clinique virtuel.

For more information, see the Az@GAME Web-Page , the Serious Game Web-Page and see the video.

Keeneo is a spin off of the Orion team which aims at commercializing video surveillance solutions, such as intrusion detection. This company has been created in July 2005 with six co-founders from the Orion team and one external partner. Keeneo was bought by Digital Barrier in August 2011.

For more information, see The Keeneo Web-Site : Intelligent Video Surveillance (IVS) software solutions.

Dem@Care is a FP7-ICT-2011.5.1 IP European project (Personal Health Systems) which has started on November 1st 2011 and will end in 2015 (48 months). This project addresses Challenge 5: Digital ICT for Health, Ageing Well, Inclusion and Governance.

The objective of Dem@Care is the development of a complete system providing personal health services to persons with dementia, as well as medical professionals, by using a multitude of sensors, for context-aware, multiparametric monitoring of lifestyle, ambient enivronment, and health parameters. Multisensor data analysis, combined with intelligent decision making mechanisms, will allow an accurate representation of the person's current status and will provide the appropriate feedback, both to the person and the associated medical professionals. Multi-parametric monitoring of daily activities, lifestyle, behaviour, in combination with medical data, can provide clinicians with a comprehensive image of the person's condition and its progression, without their being physically present, allowing remote care of their condition. There will be several pilots in France, Ireland and Sweden. The prime partner is the Centre for Research and Technology Hellas (G) and other partners are: INRIA Sophia-Antipolis, University de Bordeaux 1, Cassidian, Nice Hospital, LinkCareServices (FR), Lulea Tekniska Universitet (SE), Dublin City University (IE), IBM Israel (IL), Philips (NL) and Vistek ISRA Vision (TR).

For more information, see the Dem@Care Project Web-Page.

EIT ICT Labs is one of the first three Knowledge and Innovation Communities (KICs) selected by the European Institute of Innovation & Technology (EIT) to accelerate innovation in Europe. EIT is a new independent community body set up to address Europe's innovation gap. It aims to rapidly emerge as a key driver of EU's sustainable growth and competitiveness through the stimulation of world-leading innovation. Among the partners, there are strong technical universities ( U Berlin, 3TU / NIRICT, Aalto University, UPMC - Université Pierre et Marie Curie, Université Paris-Sud 11, Institut Telecom, The Royal Institute of Technology); excellent research centres (DFKI, INRIA, Novay , VTT, SICS) and leading companies ( Deutsche Telekom Laboratories, SAP, Siemens, Philips, Nokia, Alcatel-Lucent, France Telecom, Ericsson). This project is largely described at http://eit.ictlabs.eu.

We are involved in the EIT ICT Labs - Health and Wellbeing - 2011 : for sharing ressources - 2012 : for monitoring Indoor Physical Activities.

For more information, see the EIT ICT Labs - Health and Wellbeing - Project Web-Page.

PAL is an INRIA internal large scale initiative action which has started in 2010. The teams: AROBAS, COPRIN, DEMAR, E-MOTION, STARS, PRIMA, MAIA, TRIO, and LAGADIC are involved in this action. The objective of this project is to create a research infrastructure that will enable experiments with technologies for improving the quality of life for persons who have suffered a loss of autonomy through age, illness or accident. In particular, the project seeks to enable development of technologies that can provide services for elderly and fragile persons, as well as their immediate family, caregivers and social groups.

For more information, see the PAL Project Web-Page.

SUPPORT (Security UPgrade for PORTs) is a FP7-SEC-2009-1 IP European project which will start in July 2010 and will end in 2014 (48 months). The aim of this proposal is to study innovative surveillance components for Autonomous Monitoring Of Multi-Sensory And Networked Infrastructure Such As Underground Transportation Environment. INRIA Grant is 367.2 Keuros out of 9,920 Keuros for the whole project. The prime partner is BMT Group (UK) and other partners are: INRIA Sophia-Antipolis (France), Swedish Defence Research Agency (SE), Securitas (SE), Technical Research Centre of Finland (FI), MARLO (NO), INLECOM Systems (UK)...

SUPPORT is addressing potential threats on passenger life and the potential for crippling economic damage arising from intentional unlawful attacks on port facilities, by engaging representative stakeholders to guide the development of next generation solutions for upgraded preventive and remedial security capabilities in European ports. The overall benefit will be the secure and efficient operation of European ports enabling uninterrupted flows of cargo and passengers while suppressing attacks on high value port facilities, illegal immigration and trafficking of drugs, weapons and illicit substances all in line with the efforts of FRONTEX and EU member states.

INRIA goal is to study the benefit of a Video-Surveillance system integrated in a global security infrastructure to address potential threats in European ports.

For more information, see the SUPPORT leaflet.

Quasper R&D is a FUI project with national funding, from June 2010 to may 2012. It gathers 3 objectives to serve companies and laboratories: (1) to encourage R&D and the design of new perception systems; (2) to develop and support the definition of European standards to evaluate the functional results of perception systems; (3) to support the qualification and certification of sensors, software and integrated perception systems. Target domains are Security, Transportation and Automotive. INRIA participates to the development of the evaluation platform. The coordinator is THALES SERVICES SAS and other partners are AFNOR, AKKA, DURAN, INRETS, SAGEM SECURITE, ST MICROELECT., THALES RT, VALEO VISION SAS, CEA, CITILOG, INSTITUT d'OPTIQUE, CIVITEC, SOPEMEA, ERTE, HGH.

Quasper R&D est un projet FUI avec co-financements territoriaux, de juin 2010 à mai 2012. Il y a 3 objectifs opérationnels au service des entreprises et des laboratoires : 1) Encourager la R&D et la mise au point de nouveaux systèmes de perceptions Identifier, 2) développer et fournir un support pour l'élaboration de standards européens de performances fonctionnelles des systèmes de perception 3) Soutenir la qualification et la certification de capteurs, de logiciels et de systèmes de perception intégrés.

Les secteurs concernés sont la Sécurité, les Transports, l'Automobile. Le budget INRIA est de 124 403 euros pour aider au développement de la plateforme d'évaluation. Le coordinateur est THALES SERVICES SAS et les autres partenaires sont AFNOR, AKKA, DURAN, INRETS, SAGEM SECURITE, ST MICROELECT., THALES RT, VALEO VISION SAS, CEA, CITILOG, INSTITUT d'OPTIQUE, CIVITEC, SOPEMEA, ERTE, HGH.

VANAHEIM (Video/Audio Networked surveillance system enhAncement through Human-cEntered adaptIve Monitoring) is a FP7-ICT-2009-4 Cognitive Systems and Robotics IP European project which has started on February 1st 2010 and will end in 2013 (42 months). The aim of this proposal is to study innovative surveillance components for Autonomous Monitoring Of Multi-Sensory And Networked Infrastructure Such As Underground Transportation Environment. The prime partner is Multitel (Belgium) and others partners are: INRIA Sophia-Antipolis (France), Thales Communications (France), IDIAP (Switzerland), Torino GTT (Italy) and Rantégie Autonome des Transports Parisiens RATP (France), Ludwig Boltzmann Institute for Urban Ethology (Austria) and Thales Communications (Italy). INRIA Grant is 700 Keuros out of 3 718 Keuros for the whole project. First, we propose to investigate unsupervised modelling techniques for audio/video streams content characterization. Second, moving one step beyond localization-based event recognition, we will investigate human-centered vision techniques for behavior monitoring applications. Conducted studies will be focused on monitoring how human beings act in a given infrastructure, and how they interact with it and with each other.

For more information, see the VANAHEIM Project Web-Page.

ViCoMo is a ITEA 2 European Project which has started on the 1st of October 2009 and will last 36 months. INRIA Grant is 354.6 Keuros. This project concerns advanced video-interpretation algorithms on video data that are typically acquired with multiple cameras. ViCoMo is focusing on the construction of realistic context models to improve the decision making of complex vision systems and to produce a faithful and meaningful behaviour. The context of an event (a crime, group activity, or computer-aided diagnosis) can be found with multiple sensors, like a multi-camera set-up in a surveillance system. The general goal of the ViCoMo project is thus to find the context of events that were captured by the cameras or image sensors, and model the context such that reliable reasoning about an event can be established. Hence, modelling of events and the 3D surroundings helps to recognize the behaviour of persons, objects and events in a 3D view.

The project is executed by a strong international consortium, containing large high-tech companies (e.g. Philips, Acciona, Thales), smaller innovative SMEs (CycloMedia, VDG Security) and is complemented with relevant research groups and departments from well-known universities (TU Eindhoven, University of Catalonia, Free University of Brussels) and research institutes (INRIA, CEA List, Multitel). Participating countries are France, Spain, Finland, Turkey, Belgium, Netherlands.

For more information, see the ViCoMo Project Web-Page.

SWEET-HOME is a ANR TECSAN French project from Nov 1st 2009 to 2012 (3 years) on long-term monitoring of elderly people at Hospital with Nice City Hospital, Actis Ingenierie, MICA Center (CNRS unit - UMI 2954) in Hanoi, Vietnam, SMILE Lab at National Cheng Kung University, Taiwan and National Cheng Kung University Hospital. INRIA Grant is 240 Keuros out of 689 Keuros for the whole project. SWEET-HOME project aims at building an innovative framework for modelling activities of daily living (ADLs) at home. These activities can help assessing elderly disease (e.g. Alzheimer, depression, apathy) evolution or detecting pre-cursors such as unbalanced walking, speed, walked distance, psychomotor slowness, frequent sighing and frowning, social withdrawal with a result of increasing indoor hours. The SWEET-HOME project focuses on two aspects related to Alzheimer disease: (1) to assess the initiative ability of patient and whether the patient is involved in goal directed behaviours (2) to assess walking disorders and potential risk of falls. In this focus, the goal is to collect and combine multi-sensor (audio-video) information to detect activities and assess behavioural trends to provide user services at different levels. In this project experimental rooms are used in Nice-Cimiez Hospital for monitoring Alzheimer patients.

For more information, see the SWEET-HOME Project Web-Page.

CIU-Santé (Centre d'Innovation et d'Usages en Santé) is a DGCIS French project from November 2008 to 30 April 2012 (42 months) on long-term monitoring of elderly people at Hospital with CSTB, the Nice City Hospital, Pole SCS, Thales Aliena Space, Actis Ingenierie, Movea, CEA and UNSA. In this project two experimental rooms have been built in Nice-Cimiez Hospital for monitoring Alzheimer patients.

For more information, see the CIU-Santé Project Web-Page.

Using video surveillance, the VIDEO-ID project aims to achieve real time human activity detection including the prediction of suspect or abnormal activities. This project also aims to be capable to perform identification using face and iris recognition. Thanks to such identification, a detected person will be tracked throughout a network of distant cameras, allowing to draw a person's route and his destination. Without being systematic, a logic set of identification procedures is established: event's situation and abnormal behaviour and people face recognition.

Partners are Thales TSS, INRIA, EURECOM, TELECOM and Management Sud Paris, CREDOF, UIC, RATP,STSI/CTSI, DGA.

For more information, see the VIDEO-ID Project Web-Page.

European project Cofriend aims at conceiving cognitive vision system for automatic monitoring of human activities. Cofriend project will start in February 2008 and end in February 2011 and follows up the Avitrack project. The project studies all activities occurring around aircraft parked on aprons at Toulouse airport. Most specifically the system have to adapt itself to lighting condition changes, weather changes, to new airport configurations, to the arrival of new servicing vehicles and new aircraft types. The performance of the system to recognise correctly the actions of interest and its capability to adapt itself to unexpected situations is a keypoint of this project. Six teams are involved in Cofriend: INRIA Sophia-Antipolis, Akka Toulouse airport (France), University of Reading and of Leeds (UK), University of Hamburg (Germany).

For more information, see the Cofriend Project Web-Page.

I am participating in the SIC project from the SYSTEM@TIC competitivity cluster (``pole de competivite'') which is a strategic initiative in security from the Paris region. More precisely the SIC project has been founded for 42 months from October 2006 to April 2010 in perimeter security for sensitive buildings. The partners include Thales, EADS, Alcatel, BULL, SAGEM, Bertin, Trusted Logic, CEA, Sodern, Axalto, GET/INT, Paris Sud and RATP. The solutions proposed by SIC project will be validated through two demonstrators, RATP subway station and Bobigny administrative building.

MONITORE is an INRIA Exploratory Action from May 2008 to 2009 for the real-time monitoring of imaging diagnostics to detect thermal events in tore plasma. This work is a preparation for the design of the future ITER nuclear reactor and is done in partnership with the Imaging and Diagnostics Group of the CEA Cadarache, France.

For more information, see the MONITORE Project Web-Page.

CARETAKER is an IST-FP6 STREP European project which started in March 2006 and will end in August 2008. The main objective of this project is to discover pertinent information in large multimedia database. The prime partner is Thales Communications (France) and others partners are: Multitel (Belgium), Kingston University (UK), IDIAP (Switzerland), Torino GTT and Roma ATAC Transport Agency (Italy), SOLID software editor for multimedia data basis (Finland) and Brno University of Technology (Czechia). We are clustering people trajectories and recognizing and learning scenarios for frequent or unexpected human activities from both video and audio events. We have managed to discover knowledge such as "travelers are 40% quicker to buy ticket during rush hours". Two demonstrators have been done in Torino and Rome subways.

For more information, see the CARETAKER Project Web-Page.

SERKET is a European ITEA project in collaboration with THALES R&T FR, THALES Security Syst, CEA, EADS and Bull (France); Atos Origin, INDRA and Universidad de Murcia (Spanish); XT-I, Capvidia, Multitel ABSL, FPMs, ACIC, BARCO, VUB-STRO and VUB-ETRO (Belgium). The project was at the end of November 2005 and it will end in July 2008. The main objective of this project is to develop techniques to analyze crowd behaviors and to help in terrorist prevention.

We have been in cooperated with STmicroelectronics and Ecole des Mines de Paris at Fontainebleau in the framework of PACA Lab from March 2003 till March 2008. We have designed intelligent cameras integrating image analysis and interpretation capabilities. In particular a PhD doctorate (Bernard Boulay) has developed a new algorithm for 3D human posture recognition in real-time from video cameras. This work has been applied to the long-term monitoring of elderly people living at home.

For more information, see the STmicroelectronics Project Web-Page.

In 2006, we started the GERHOME project in collaboration with CSTB (Centre Scientifique et Technique du Batiment) and the Nice City Hospital (Groupe de Recherche sur la Tophicite et le Viellissement). The GER'HOME project was funded by the PACA region. GER'HOME project is devoted to experiment and develop techniques that allow long-term monitoring of elderly people at home. In this project an experimental home has been built in Sophia Antipolis instrumented with environmental sensors such as pressure contract, water and electric consumption sensors. We have developed unsupervised event learning and recognition techniques to be integrated in a platform to provide services and to perform experiments.

For more information, see the GERHOME Project Web-Page.

In the framework of collaboration with RATP from February 2001 till 2008, we have designed a real-time system for lateral shape recognition. We have developed an operational system which is able to detect and classify people and objects when they access the subway network (validate their ticket). The system is combining information from several sensors (one top camera, five lateral cameras, leds and optical cells) to obtain a very high recognition rate with real-time constraint.

For more information, see the RATP Project Web-Page.

We have led the ETISEO project on performance evaluation of video understanding algorithms. This project began in 2005 and ended in January 2007. It has provided both dataset and evaluation tools which constitute a reference in "vehicles and pedestrians scene understanding". Project ETISEO has focused on the treatment and interpretation of videos involving pedestrians and (or) vehicles, indoor or outdoor, obtained from fixed cameras. This project was part of the Techno-Vision evaluation network funded by the French ministry of defense and the French ministry of research. The main partners were Silogic (coordinator, evaluator and data-provider), INRIA (scientific leader), INRETS-LEOST (data-provider) and CEA-List (data-provider). Moreover, this project had brought together governmental agencies (from UK, US and France) and about 20 international teams that have developed algorithms and wanted to evaluate and compare their technology with each other. ETISEO project had been provided them with free videos, metrics and an automatic tool to run evaluations.

For more information, see the ETISEO project for Video Surveillance Performance Evaluation.

The CASSIOPEE project is a French collaboration among Le Credit Agricole, Ciel and Securitas Systemes - Eurotelis which started in January 2002 and ended in March 2006. We have developed and tested an automatic visual-surveillance platform for detection of predefined scenarios such as bank attack in a bank agency environment. The system has been validated in four bank agencies by the bank security operators located in a distant control security center.

For more information, see the CASSIOPEE Project Web-Page.

SAMSIT was a project in collaboration among ALSTOM, CEA, SNCF, INRETS. It started in January 2004 and ended in March 2006. We have developed techniques to automatically detect human behaviors in trains. Such detection of human behaviors are challenging ones, due to train motion, cluttered environment and fast illumination changes. Thanks to the combination of audio and video signals, we were able to detect scenarios such as scratching the window, cell-phone theft, violence and beggars.

For more information, see the SAMSIT Project Web-Page.

In 2006 we had a project done on trichogramma monitoring in collaboration with INRA that lasted for 6 months. A trichogramma is a millimeter wasp which is brought to fight a corn parasite. Biologists asked us to monitor its behavior to understand more about its life.

For more information, see the Trichogramma Project Web-Page.

AVITRACK was a IST-FP6 European project in collaboration with Silogic S.A. Toulouse (FR), University of Reading (UK), CCI Aeroport Toulouse Blagnac (France), Fedespace (France), Tekever LDA, Lisbon (Portugal), ARC Seibersdorf research GMBH, Wien (Austria), Technique Universities, Vienna (Austria), IKT (Norway) and Euro Inter (Toulouse France). This 2-year project was started in February 2004 and ended in March 2006. During this project, we have developed algorithms to recognize the servicing activities around parked aircrafts in an apron area monitored by eight cameras in Toulouse airport (France). Activities may be simple events involving one mobile object like the arrival or the departure of ground vehicles or complex scenarios like refueling or luggage loading.

For more information, see the AVITRACK Project Web-Page.

TELESCOPE was a project in collaboration with Bull from March 1998 till March 2006. During this project we have developed a toolkit in the domain of cognitive video interpretation for video intelligent surveillance applications (VIS). This toolkit contained components to facilitate the usage and installation of surveillance systems, to ensure more robustness and to extend video surveillance functionalities.

We had participated in the specific Inter-media Semantics Extraction and Reasoning (ISERE) STIC-Asie action from 2004 until December 2006. ISERE project had brought together four research centers one from Asia and three from France. It promoted the development of research on semantics analysis, reasoning and multimedia data, and the application of these results in the domains of e-learning, automatic surveillance and medical databases. Besides allowing sharing scientific results, this cooperation has increased the exchange of researchers between Asia and France. The Asia partners of the ISERE action were IPAL-CNRS, I2R A-STAR and NUS for Singapor, MICA for Vietnam, the National Institute of Informatics NII for Japan and the National Cheng Kung University and the National Taiwan University for Taiwan. The French partners were INRIA-Orion, CLIPS-IMAG CNRS-INPG-UJF and IRIT.

The VIDEA project was in collaboration with Vigitec (Brussels) which began in November 2003 and lasted for 2 years. We have transferred a part of the video surveillance technology of the ORION team into industrial products. During this project, we have developed two applications enabling the recognition of specific human behaviors: control access for buildings and street violence in cities.

The ALSTOM project was began in April 2003 and finished in July 2003. In this project we had realized a feasibility study on an industrial application allowing detecting human behaviors in trains using video understanding techniques.

The RASV project was collaboration with SNCF which began in September 2003 for duration of 18 months. We have applied techniques to automatically detect human behaviors in trains specified by SNCF and security operators.

The KINOMAI project started in December 2003 for duration of four months in collaboration with Kinomai company. We have developed an object recognition platform for image and video indexing and retrieval purposes.

The ADVISOR project - Annotated Digital Video for Intelligent Surveillance and Optimised Retrieval - was an IST European project on multi camera video surveillance systems in subways which lasted 3 years and finished in March 2003. THALES TRT UK, BULL, VIGITEC, Univ. Kingston, Univ. Reading, KCL London has participated in the project. The aim of this work was to automatically analyze, to recognize scenarios of interest, archive and annotate subway video sequences. We were able to recognize six types of behaviors: fighting, over-crowding, fraud (jumping over barrier), graffiti, blocking exit and vandalism (breaking ticket machine). This work has been validated with Brussels and Barcelona subways. A demonstrator was installed in Barcelona subway for 10 days fed continuously by four cameras and observed by real security operators during the operational time.

For more information, see the European Project ADVISOR on Subway Monitoring

The MediaSpace was a national project on smart video conferencing which lasted from January to December 2000 in collaboration with GRAVIR team. The goal was to analyze people behaviors in office in order to improve relationships of employees from team located in different sites. Thanks to this system we were able to detect meeting (with guests) and turn of automatically the video conferencing system to protect employee privacy. We were also able to focus automatically the camera (as an intelligent camera man) on points of interest in the scene when people for instance were writing on the white board.

I have been involved in the V.S.A.M. (Video Surveillance and Activity Monitoring) from DARPA agency through the University of Southern California from October 1997 to January 2000. We have developed techniques to analyze check points depicted by videos taken by drones during the Yugoslavian war. We were able to detect whether cars were passing normally the check points or not.

The PASSWORDS was an IST European project on super market, parking and subways monitoring. It has been done in collaboration with VIGITEC, SEPA, DIBE, AUCHAN from 1994 to 1997. The goal was to show that at the time an automatic process could recognise human behavior such as loitering in the parking lot.

For more information, see the PASSWORDS Project Web-Page.