Skip to main content
Go to the home page of the European Commission (opens in new window)
English en
CORDIS - EU research results
CORDIS
Content archived on 2024-05-27

Artificial vision systems based on early cognitive cortical processing

Objective

Visual scene analysis in higher vertebrates reaches a level of performance, in terms of accuracy and efficiency, unsurpassed by man-made artefacts. The goal of the ECOVISION project is to use knowledge of biological systems to build a hybrid hardware-software visual scene analysis system with early-cognitive properties. Early-cognitive systems utilize implicit knowledge of the world. The main innovative aspect of this research is the creation of a distributed processing architecture that emulates self-adaptive early cognitive analysis at the level of psychological "Gestalts" (systems which embody statistical regularities of the world) utilizing dynamic recurrent feedback and predictive mechanisms to generate a self-emergent level of analysis. Visual scene analysis in higher vertebrates reaches a level of performance, in terms of accuracy and efficiency, unsurpassed by man-made artefacts. The goal of the ECOVISION project is to use knowledge of biological systems to build a hybrid hardware-software visual scene analysis system with early-cognitive properties. Early-cognitive systems utilize implicit knowledge of the world. The main innovative aspect of this research is the creation of a distributed processing architecture which emulates self-adaptive early cognitive analysis at the level of psychological "Gestalts" (systems which embody statistical regularities of the world) utilizing dynamic recurrent feedback and predictive mechanisms to generate a self-emergent level of analysis.

OBJECTIVES
ECOVISION will build a visual scene analysis system with neuronal architecture guided by cognitive context, which operates in video-real time, thereby providing the first entry point to a new generation of artefacts with a more human-like pattern of intention driven behaviour. ECOVISION:
1)contains dynamic feedback loops leading to self-organization of neuronal activity;
2)embeds early cognitive analysis at the level of context adaptive visual receptive fields ("visual cortical RFs");
3) defines a dynamically changing "map-like" representational structure of these RFs weighted by their momentarily existing task-relevance;
4) implements predictive mechanism to generate a self-organizing level of analysis;
5) front-end pre-processing steps are studied, evaluated and adapted to suit in FPGA technology in order to operate in video real-time.

DESCRIPTION OF WORK
ECOVISION consists of three main project parts and focuses on a self-navigating system (like a car).
Project Parts: A) Design of an FPGA-based front end for the computation of the motion structure in the visual scenes in video real-time. (The consortium possesses already such a device for the extraction of stereo-depth information);
Project Part B) Design of a high level processing software device with neuronal structure, which analyses the front-end information with respect to its intrinsically existing visual context.
"Visual context" is the embedding of Gestalt-laws, established by psychology and also in cortical neuronal processing, in a computer vision system. "Gestalts", thereby, represent pixel groups, which have shared statistical properties in space and time. Thus, they define segments in space and time and can, therefore, be captured by highly-adaptive receptive fields (RFs) of ECOVISION's processing units. *Control is intention driven* in that every scene will be analysed with respect to an intentional context within which the momentarily existing Center of Interest (CoI) is determined by the dynamic structure of the visual scene. To this end, the RFs of the units shall be arranged on a map-structure that has an enhanced resolution at the CoI. This map, thus, represents, the momentarily existing visual relevance and the CoI can be regarded as a flexible mental fovea. To get a deeper insight, these concepts will also be ascertained by biophysically realistic models of visual cortical function;
Project Part C) Design of the complete ECOVISION system by joining the components from A and B.

Fields of science (EuroSciVoc)

CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.

You need to log in or register to use this function

Programme(s)

Multi-annual funding programmes that define the EU’s priorities for research and innovation.

Topic(s)

Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.

Call for proposal

Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.

Data not available

Funding Scheme

Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.

CSC - Cost-sharing contracts

Coordinator

THE UNIVERSITY OF STIRLING
EU contribution
No data
Address

FK9 4LA STIRLING
United Kingdom

See on map

Total cost

The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.

No data

Participants (7)

My booklet 0 0