Skip to main content

MULTISPECTRAL INTELLIGENT VISION SYSTEM WITH EMBEDDED LOW-POWER NEURAL COMPUTING

Objective

"MISEL aims at bringing artificial intelligence to the edge computing (decisions made on-device) through a low-power bio-inspired vision system with multi-spectral sensing and in sensor spatio-temporal neuromorphic processing based on complex events. The science-to-technology breakthrough is the heterogeneous integration of a neuromorphic computing scheme featuring three different abstraction levels (cellular, cerebellar and cortex processors) with high-density memory arrays and adaptive photodetector technology for fast operation and energy efficiency. The context-aware, low power and distributed computation paradigm supported by MISEL is promising alternative to the current approach relying on massive-data transfers and large computational resources, e.g., workstations or cloud servers. This answers to the challenges and related scope presented in the Work Programme towards ""more complex, brain mimicking low power systems"" ""exploiting a wider range of biological principles from the hardware level up"" by introducing the human eye like adaptivity with cellular processor and the data fusion, learning, reasoning, and “conscious” decisions performed by the cortex.

The stand-alone system fabricated in MISEL will be tested on timely and challenging applications such as distinguishing birds from drones through their spatio-temporal flying signature, and scene anomaly detection from a mobile platform. From the technology development and industrialization point of view, MISEL includes the whole value chain: materials research for back-end of line (BEOL) processing-compatible densely-packed ferroelectric non-volatile memories (FeRAMs) and intensity adaptive photodetectors, novel neuromorphic computing algorithms and circuit implementations, and system level benchmarking. This is all in line with the challenge and scope of ""outperforming conventional SoA with relevant metric"" and benchmarking ""challenging end-to-end scenarios of use"" for industrial adaptation.
"

Field of science

  • /engineering and technology/electrical engineering, electronic engineering, information engineering/electronic engineering/sensors/optical sensors
  • /natural sciences/computer and information sciences/artificial intelligence

Call for proposal

H2020-FETPROACT-2020-01
See other projects for this call

Funding Scheme

RIA - Research and Innovation action

Coordinator

TEKNOLOGIAN TUTKIMUSKESKUS VTT OY
Address
Tekniikantie 21
02150 Espoo
Finland
Activity type
Research Organisations
EU contribution
€ 1 432 172,50

Participants (8)

GESELLSCHAFT FUR ANGEWANDTE MIKRO UND OPTOELEKTRONIK MIT BESCHRANKTERHAFTUNG AMO GMBH
Germany
EU contribution
€ 350 625
Address
Otto Blumenthal Strasse
52074 Aachen
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
BERGISCHE UNIVERSITAET WUPPERTAL
Germany
EU contribution
€ 203 187,50
Address
Gauss-strasse 20
42119 Wuppertal
Activity type
Higher or Secondary Education Establishments
KOVILTA OY
Finland
EU contribution
€ 990 000
Address
Joukahaisenkatu 1
20520 Turku
Activity type
Private for-profit entities (excluding Higher or Secondary Education Establishments)
UNIVERSIDAD DE SANTIAGO DE COMPOSTELA
Spain
EU contribution
€ 653 301,25
Address
Colexio De San Xerome Praza Do Obradoiro S/n
15782 Santiago De Compostela
Activity type
Higher or Secondary Education Establishments
FRAUNHOFER GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Germany
EU contribution
€ 300 425
Address
Hansastrasse 27C
80686 Munchen
Activity type
Research Organisations
POLITECHNIKA LODZKA
Poland
EU contribution
€ 348 750
Address
Ulica Zeromskiego 116
90 924 Lodz
Activity type
Higher or Secondary Education Establishments
LABORATOIRE NATIONAL DE METROLOGIE ET D'ESSAIS
France
EU contribution
€ 420 990
Address
Rue Gaston Boissier 1
75724 Paris
Activity type
Research Organisations
LUNDS UNIVERSITET
Sweden
EU contribution
€ 270 000
Address
Paradisgatan 5C
22100 Lund
Activity type
Higher or Secondary Education Establishments