The results of previous work in this area will be used to identify the "technology gaps" where current systems cannot meet user expectations and indicate how the latest technologies can be integrated to address these gaps. Functional specifications for ADVISOR will be developed, implemented and evaluated through two test-beds and one demonstrator to provide:
- Real-time computer analysis of multiple video sequences to detect, track and locate individuals in the 3D environment. It will be based on techniques for motion detection, calibration of cameras, scene modelling and object tracking. In addition, crowd-monitoring algorithms developed by CROMATICA will be integrated.
- Real time interpretation of the behaviour of individuals and of crowds to recognise anomalous or dangerous situations (such as overcrowding or vandalism) which would require a prompt response from metro staff to maintain smooth running of the transport network. This will be achieved by techniques for event detection and scenario recognition. Moreover, learning techniques will be developed to set thresholds for detecting anomalous situations and prioritising alarms to minimise operator workload.
- Tools for the creation, maintenance and searching of a digital video database, using appropriate image coding standards for storing compressed video with automatic annotation according to content, and to assist both the extraction of statistical information on passenger behaviour and also analysis of serious incidents after they have occurred.
- An ergonomic human computer interface for the display of annotated live video and diagnostics relating to analysis of activities and events that have been detected. The interface will also provide means for the operator to define alarm conditions, verify alarms that are generated and to access the video database. The implementation will use standard commercial hardware configured in an open and scalable architecture.