Skip to main content
Go to the home page of the European Commission (opens in new window)
English English
CORDIS - EU research results
CORDIS
Content archived on 2024-06-16

Human-expressive representations of motion and their evaluation in sequences

Objective

HERMES concentrates on how to extract descriptions of human behaviour from videos in a circumscribable discourse domain, such as:
(i) pedestrians crossing inner-city roads and pedestrians approaching or waiting at stops of busses or trams, and
(ii) humans in indoor worlds like an airport hall, or a train station.

These discourse domains allow exploring a coherent evaluation of human movements and facial expressions across a wide variation of scale. This general approach lends itself to various cognitive surveillance scenarios at varying degrees of resolution: from wide-field-of-view multiple-agent scenes, through to more specific inferences of emotional state that could be elicited from high-resolution imagery of faces. The true challenge will consist in the development of a system facility, which starts with basic knowledge about pedestrian behaviour in the chosen discourse domain, but could cluster evaluation results into semantically meaningful subsets of behaviours.

The envisaged system will comprise an internal logic-based representation, which enables it to comment each individual subset, giving natural language explanations of why the system has created the subset in question. Inference and causal reasoning will be based on finding sequences of agent states that are consistent with the observation data and the agent models. Moreover, the sensing process will be tightly integrated with the reasoning process as part of a perception-action cycle: we aim to consider how cooperating pan-tilt-zoom sensors can enhance the process of cognition via controlled responses to uncertain or ambiguous interpretations.

The system will be exposed to video recordings from different parts of Europe in order to prevent over-adaptation to local habits and, in addition, to learn systematically occurring differences between pedestrian habits in different countries. The system's explanatory and arguing capabilities are expected to ease an assessment of its strengths and weaknesses.

Fields of science (EuroSciVoc)

CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: https://op.europa.eu/en/web/eu-vocabularies/euroscivoc.

You need to log in or register to use this function

Topic(s)

Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.

Call for proposal

Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.

Data not available

Funding Scheme

Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.

STREP - Specific Targeted Research Project

Coordinator

CENTRO DE VISION POR COMPUTADOR
EU contribution
No data
Address
EDIFICIO CAMPUS UAB
08193 BELLATERRA (CERDANYOLA DEL VALLES)
Spain

See on map

Total cost

The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.

No data

Participants (5)

My booklet 0 0