AdvanCed Hardware/Software Components for Integrated/Embedded Vision SystEms

Project Information

ACHIEVE

Grant agreement ID: 765866

DOI 10.3030/765866

Project closed

EC signature date 1 August 2017

Start date 1 October 2017

End date 31 March 2022

Funded under

• EXCELLENT SCIENCE - Marie Skłodowska-Curie Actions

Total cost € 2 266 907,76

EU contribution € 2 266 907,76

Coordinated by

AGENCIA ESTATAL CONSEJO SUPERIOR DE INVESTIGACIONES CIENTIFICAS
Spain

Deliverables

Documents, reports (5)

Final evaluation of the training programme
Gender balance code
Network-wide training events evaluation

Networkwide training events evaluation reports

Ethical guidelines
Annual training reports

Collection of annual training reports corresponding to the 3 years

Open Research Data Pilot (1)

Data management plan

Other (3)

Main recruitment call

Main recruitment call and list of publicity actions

List of selected fellows
Supervisory Board

Constitution of the supervisory board

Websites, patent fillings, videos etc. (1)

Programme website and communication tools

Programme website and internal communication tools

Publications

Other (1)

Why is FPGA-GPU Heterogeneity the Best Option for Embedded Deep Neural Networks?

Author(s): Carballo-Hernández, Walther; Pelcat, Maxime; Berry, François
Published in: DATE Friday Workshop on System-level Design Methods for Deep Learning on Heterogeneous Architectures (SLOHA 2021), Issue 1, 2021
Publisher: Cornell Tech
DOI: 10.48550/arxiv.2102.01343

Conference proceedings (28)

Is First Person Vision Challenging for Object Tracking?

Author(s): Matteo Dunnhofer, Antonino Furnari, Giovanni Maria Farinella, Christian Micheloni
Published in: 18th IEEE/CVF International Conference on Computer Vision Workshops, 2021
Publisher: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/iccvw54120.2021.00304

A starting point for real-time human action detection

Author(s): Liu, Yu; Yang, Fan; Ginhac, Dominique
Published in: Proceedings of GRETSI 2019 XXVIIème Colloque francophone de traitement du signal et des images, Issue 1, 2019
Publisher: Gretsi

VersaTile Convolutional Neural Network Mapping on FPGAs

Author(s): A. Munio-Gracia, J. Fernandez-Berni, R. Carmona-Galan, A. Rodriguez-Vazquez
Published in: 2020 IEEE International Symposium on Circuits and Systems (ISCAS), 2020, Page(s) 1-4, ISBN 978-1-7281-3320-1
Publisher: IEEE
DOI: 10.1109/iscas45731.2020.9181037

Self Attention based multi branch Network for Person Re-Identification

Author(s): Asad Munir, Christian Micheloni
Published in: 2020 5th International Conference on Smart and Sustainable Technologies (SpliTech), 2020, Page(s) 1-5, ISBN 978-953-290-105-4
Publisher: IEEE
DOI: 10.23919/splitech49282.2020.9243741

Compressive Imaging Using RIP-Compliant CMOS Imager Architecture and Landweber Reconstruction

Author(s): Marco Trevisi, Ali Akbari, Maria Trocan, Ángel Rodríguez-Vázquez, Ricardo Carmona
Published in: IEEE Transactions on Circuits and Systems for Video Technology, Issue 30/2, 2020, Page(s) 387-399, ISSN 1051-8215
Publisher: 10518215
DOI: 10.1109/tcsvt.2019.2892178

Multi Branch Siamese Network For Person Re-Identification

Author(s): Asad Munir, Niki Martinel, Christian Micheloni
Published in: 2020 IEEE International Conference on Image Processing (ICIP), 2020, Page(s) 2351-2355, ISBN 978-1-7281-6395-6
Publisher: IEEE
DOI: 10.1109/icip40778.2020.9191115

Tracking-by-Trackers with a Distilled and Reinforced Model

Author(s): Dunnhofer, Matteo MARTINEL, Niki MICHELONI, Christian
Published in: Asian Conference on Computer Vision, 2020
Publisher: Computer Vision Foundation

Generating Domain and Pose Variations between Pair of Cameras for Person Re-Identification

Author(s): Asad Munir, Gian Luca Foresti, Christian Micheloni
Published in: Proceedings of the 13th International Conference on Distributed Smart Cameras, 2019, Page(s) 1-2, ISBN 9781450371896
Publisher: ACM
DOI: 10.1145/3349801.3357135

A deep residual star generative adversarial network for multi-domain image super-resolution

Author(s): Rao Muhammad Umer, Asad Munir, Christian Micheloni
Published in: 6th International Conference on Smart and Sustainable Technologies, 2021
Publisher: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.23919/splitech52315.2021.9566406

An Exploration of Target-Conditioned Segmentation Methods for Visual Object Trackers

Author(s): Matteo Dunnhofer, Niki Martinel , Christian Micheloni
Published in: Proceedings, 2020, ISBN 978-3-030-68237-8
Publisher: Springer Science and Business Media Deutschland GmbH
DOI: 10.1007/978-3-030-68238-5_41

Unsupervised Hashing with Neural Trees for Image Retrieval and Person Re-Identification

Author(s): Niki Martinel, Gian Luca Foresti, Christian Micheloni
Published in: Proceedings of the 12th International Conference on Distributed Smart Cameras - ICDSC '18, 2018, Page(s) 1-6, ISBN 9781-450365116
Publisher: ACM Press
DOI: 10.1145/3243394.3243687

On-The-Fly Deployment of Deep Neural Networks on Heterogeneous Hardware in a Low-Cost Smart Camera

Author(s): D. Velasco-Montero, J. Fernández-Berni, R. Carmona-Galán, Á. Rodríguez-Vázquez
Published in: Proceedings of the 12th International Conference on Distributed Smart Cameras - ICDSC '18, 2018, Page(s) 1-2, ISBN 9781-450365116
Publisher: ACM Press
DOI: 10.1145/3243394.3243705

CMOS-SPAD Camera Prototype for Single-Sensor 2D/3D Imaging

Author(s): I. Vornicu, R. Carmona-Galán, Á. Rodríguez-Vázquez
Published in: Proceedings of the 12th International Conference on Distributed Smart Cameras - ICDSC '18, 2018, Page(s) 1-2, ISBN 9781-450365116
Publisher: ACM Press
DOI: 10.1145/3243394.3243711

Results of 'iCaveats', a Project on the Integration of Architectures and Components for Embedded Vision

Author(s): R. Carmona-Galán, J. Fernández-Berni, Á. Rodríguez-Vázquez, P. Lopez-Martínez, V. M. Brea-Sánchez, D. Cabello-Ferrer, G. Domenech-Asensi, R. Ruiz-Merino, J. Zapata-Pérez
Published in: Proceedings of the 12th International Conference on Distributed Smart Cameras - ICDSC '18, 2018, Page(s) 1-2, ISBN 9781-450365116
Publisher: ACM Press
DOI: 10.1145/3243394.3243707

CNN Performance Prediction on a CPU-based Edge Platform

Author(s): D. Velasco-Montero, J. Fernández-Berni, R. Carmona-Galán, Á. Rodríguez-Vázquez
Published in: Proceedings of the 13th International Conference on Distributed Smart Cameras - ICDSC 2019, 2019, Page(s) 1-2, ISBN 9781-450371896
Publisher: ACM Press
DOI: 10.1145/3349801.3357131

A survey on FPGA-based high-resolution TDCs

Author(s): Mojtaba Parsakordasiabi, Ion Vornicu, Ricardo Carmona-Galán, Ángel Rodríguez-Vázquez
Published in: Proceedings of the 13th International Conference on Distributed Smart Cameras - ICDSC 2019, 2019, Page(s) 1-2, ISBN 9781-450371896
Publisher: ACM Press
DOI: 10.1145/3349801.3357129

Impact of CNNs Pooling Layer Implementation on FPGAs Accelerator Design

Author(s): A. Muñío-Gracia, J. Fernández-Berni, R. Carmona-Galán, Á. Rodríguez-Vázquez
Published in: Proceedings of the 13th International Conference on Distributed Smart Cameras - ICDSC 2019, 2019, Page(s) 1-2, ISBN 9781-450371896
Publisher: ACM Press
DOI: 10.1145/3349801.3357130

On the Correlation of CNN Performance and Hardware Metrics for Visual Inference on a Low-Cost CPU-based Platform

Author(s): Delia Velasco-Montero, Jorge Femandez-Bemi, Ricardo Carmona-Galan, Angel Rodriguez-Vazquez
Published in: 2019 International Conference on Systems, Signals and Image Processing (IWSSIP), 2019, Page(s) 249-254, ISBN 978-1-7281-3227-3
Publisher: IEEE
DOI: 10.1109/iwssip.2019.8787329

Towards Embedded Heterogeneous FPGA-GPU Smart Camera Architectures for CNN Inference

Author(s): Walther Carballo-Hernández, François Berry, Maxime Pelcat, Miguel Arias-Estrada
Published in: Proceedings of the 13th International Conference on Distributed Smart Cameras - ICDSC 2019, Issue 13, 2019, Page(s) 1-2, ISBN 9781-450371896
Publisher: ACM Press
DOI: 10.1145/3349801.3357136

Dynamic Obstacle Detection in Traffic Environments

Author(s): Gopi Krishna Erabati, Helder Araujo
Published in: Proceedings of the 13th International Conference on Distributed Smart Cameras - ICDSC 2019, 2019, Page(s) 1-2, ISBN 9781-450371896
Publisher: ACM Press
DOI: 10.1145/3349801.3357134

Accurate Single-Stream Action Detection in Real-Time

Author(s): Yu Liu, Fan Yang, Dominique Ginhac
Published in: Proceedings of the 13th International Conference on Distributed Smart Cameras - ICDSC 2019, 2019, Page(s) 1-6, ISBN 9781-450371896
Publisher: ACM Press
DOI: 10.1145/3349801.3349821

Photon-Detection Timing-Jitter Model in Verilog-A

Author(s): Juan Manuel Lopez-Martinez, Ricardo Carmona-Galan, Angel Rodriguez-Vazquez
Published in: 2020 IEEE International Symposium on Circuits and Systems (ISCAS), 2020, Page(s) 1-5, ISBN 978-1-7281-3320-1
Publisher: IEEE
DOI: 10.1109/iscas45731.2020.9181222

Resolution based Feature Distillation for Cross Resolution Person Re-Identification

Author(s): Asad Munir, Chengjin Lyu, Bart Goossens, Wilfried Philips, Christian Micheloni
Published in: 18th IEEE/CVF International Conference on Computer Vision Workshops, 2021, ISBN 978-1-6654-0191-3
Publisher: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/iccvw54120.2021.00036

Why is FPGA-GPU Heterogeneity the Best Option for Embedded Deep Neural Networks?

Author(s): Carballo-Hernández, Walther; Pelcat, Maxime; Berry, François
Published in: Proceedings of the DATE Friday Workshop on System-level Design Methods for Deep Learning on Heterogeneous Architectures (SLOHA 2021), Issue February 5, 2021, yearly publication, 2021, Page(s) 19-24
Publisher: ArXiv

Vertically Stacked CMOS-Compatible Photodiodes for Scanning Electron Microscopy

Author(s): Lionel C. Gontard, Juan A. Lenero-Bardallo, Francisco M. Varela-Feria, Ricardo Carmona-Galan
Published in: 2020 IEEE International Symposium on Circuits and Systems (ISCAS), 2020, Page(s) 1-5, ISBN 978-1-7281-3320-1
Publisher: IEEE
DOI: 10.1109/iscas45731.2020.9181208

Limitation of SPADs quantum efficiency due to the dopants concentration gradient

Author(s): Juan Manuel Lopez-Martinez, Ricardo Carmona-Galan, Angel Rodriguez-Vazquez
Published in: 2020 27th IEEE International Conference on Electronics, Circuits and Systems (ICECS), 2020, Page(s) 1-4, ISBN 978-1-7281-6044-3
Publisher: IEEE
DOI: 10.1109/icecs49266.2020.9294798

Deep Generative Adversarial Residual Convolutional Networks for Real-World Super-Resolution

Author(s): Rao Muhammad Umer, Gian Luca Foresti, Christian Micheloni
Published in: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2020, Page(s) 1769-1777, ISBN 978-1-7281-9360-1
Publisher: IEEE
DOI: 10.1109/cvprw50498.2020.00227

Cellular-Neural-Network Focal-Plane Processor as Pre-Processor for ConvNet Inference

Author(s): Lionel C. Gontard, Ricardo Carmona-Galan, Angel Rodriguez-Vazquez
Published in: 2020 IEEE International Symposium on Circuits and Systems (ISCAS), 2020, Page(s) 1-5, ISBN 978-1-7281-3320-1
Publisher: IEEE
DOI: 10.1109/iscas45731.2020.9181102

Peer reviewed articles (13)

PreVIous: A Methodology for Prediction of Visual Inference Performance on IoT Devices

Author(s): Delia Velasco-Montero, Jorge Fernandez-Berni, Ricardo Carmona-Galan, Angel Rodriguez-Vazquez
Published in: IEEE Internet of Things Journal, Issue 7/10, 2020, Page(s) 9227-9240, ISSN 2327-4662
Publisher: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/jiot.2020.2981684

Fixed Pattern Noise Analysis for Feature Descriptors in CMOS APS Images

Author(s): Juan Zapata-Pérez, Ginés Doménech-Asensi, Ramón Ruiz-Merino, Jose Javier Martínez-Álvarez, Jorge Fernández-Berni, Ricardo Carmona-Galán
Published in: Sensing and Imaging, Issue 21/1, 2020, ISSN 1557-2064
Publisher: Springer Verlag
DOI: 10.1007/s11220-020-0278-3

Impact of Thermal Throttling on Long-Term Visual Inference in a CPU-Based Edge Device

Author(s): Théo Benoit-Cattin, Delia Velasco-Montero, Jorge Fernández-Berni
Published in: Electronics, Issue 9/12, 2020, Page(s) 2106, ISSN 2079-9292
Publisher: MDPI
DOI: 10.3390/electronics9122106

Weakly-Supervised Domain Adaptation of Deep Regression Trackers via Reinforced Knowledge Distillation

Author(s): Matteo Dunnhofer, Niki Martinel, Christian Micheloni
Published in: IEEE ROBOTICS AND AUTOMATION LETTER, 2021, ISSN 2377-3766
Publisher: IEEE
DOI: 10.1109/lra.2021.3070816

Consistent attentive dual branch network for person re-identification

Author(s): Asad Munir, Niki Martinel, Christian Micheloni
Published in: Multimedia Tools and Applications, 2022, Page(s) 1-18, ISSN 1380-7501
Publisher: Kluwer Academic Publishers
DOI: 10.1007/s11042-022-12732-3

Deep Pyramidal Pooling With Attention for Person Re-Identification

Author(s): Niki Martinel, Gian Luca Foresti, Christian Micheloni
Published in: IEEE Transactions on Image Processing, Issue 29, 2020, Page(s) 7306-7316, ISSN 1057-7149
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/tip.2020.3000904

ACDnet: An action detection network for real-time edge computing based on flow-guided feature approximation and memory aggregation

Author(s): Yu Liu, Fan Yang, Dominique Ginhac
Published in: Pattern Recognition Letters, Issue 145, 2021, Page(s) 118-126, ISSN 0167-8655
Publisher: Elsevier BV
DOI: 10.1016/j.patrec.2021.02.001

Compact Real-Time Inter-Frame Histogram Builder for 15-Bits High-Speed ToF-Imagers Based on Single-Photon Detection

Author(s): Ion Vornicu, Angela Darie, Ricardo Carmona-Galan, Angel Rodriguez-Vazquez
Published in: IEEE Sensors Journal, Issue 19/6, 2019, Page(s) 2181-2190, ISSN 1530-437X
Publisher: Institute of Electrical and Electronics Engineers
DOI: 10.1109/jsen.2018.2885960

Optimum Selection of DNN Model and Framework for Edge Inference

Author(s): Delia Velasco-Montero, Jorge Fernandez-Berni, Ricardo Carmona-Galan, Angel Rodriguez-Vazquez
Published in: IEEE Access, Issue 6, 2018, Page(s) 51680-51692, ISSN 2169-3536
Publisher: Institute of Electrical and Electronics Engineers Inc.
DOI: 10.1109/access.2018.2869929

Lord of the Rings: Hanoi Pooling and Self-Knowledge Distillation for Fast and Accurate Vehicle Re-Identification

Author(s): Niki Martinel ,Matteo Dunnhofer, Rita Pucci, Gian Luca Foresti, Christian Micheloni
Published in: IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, ISSN 1551-3203
Publisher: Institute of Electrical and Electronics Engineers

Cost-Effective CNNs for Real-Time Micro-Expression Recognition

Author(s): Reda Belaiche, Yu Liu, Cyrille Migniot, Dominique Ginhac, Fan Yang
Published in: Applied Sciences, Issue 10/14, 2020, Page(s) 4959, ISSN 2076-3417
Publisher: MDPI
DOI: 10.3390/app10144959

Performance Assessment of Deep Learning Frameworks through Metrics of Hardware Exploitation on a CPU-based Embedded Platform

Author(s): Delia Velasco-Montero, Jorge Fernández-Berni, Ricardo Carmona-Galán and Ángel Rodríguez-Vázquez
Published in: Journal of Electrical and Computer Engineering Systems, Issue vol. 11, no. 1, 2020, Page(s) pp. 1-11, ISSN 1847-7003
Publisher: FERIT
DOI: 10.32985/ijeces.11.1.1

A Low-Resources TDC for Multi-Channel Direct ToF Readout Based on a 28-nm FPGA

Author(s): Mojtaba Parsakordasiabi, Ion Vornicu, Ángel Rodríguez-Vázquez, Ricardo Carmona-Galán
Published in: Sensors, Issue 21/1, 2021, Page(s) 308, ISSN 1424-8220
Publisher: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/s21010308

Book chapters (2)

Optimum Network/Framework Selection from High-Level Specifications in Embedded Deep Learning Vision Applications

Author(s): Delia Velasco-Montero, Jorge Fernández-Berni, Ricardo Carmona-Galán, Ángel Rodríguez-Vázquez
Published in: Advanced Concepts for Intelligent Vision Systems - 19th International Conference, ACIVS 2018, Poitiers, France, September 24–27, 2018, Proceedings, Issue 11182, 2018, Page(s) 369-379, ISBN 978-3-030-01448-3
Publisher: Springer International Publishing
DOI: 10.1007/978-3-030-01449-0_31

Clip-Level Feature Aggregation: A Key Factor for Video-Based Person Re-identification

Author(s): Chengjin Lyu, Patrick Heyer-Wollenberg, Ljiljana Platisa, Bart Goossens, Peter Veelaert, Wilfried Philips
Published in: Advanced Concepts for Intelligent Vision Systems - 20th International Conference, ACIVS 2020, Auckland, New Zealand, February 10–14, 2020, Proceedings, Issue 12002, 2020, Page(s) 179-191, ISSN 0302-9743
Publisher: Springer International Publishing
DOI: 10.1007/978-3-030-40605-9_16