Robust Automated Driving in Extreme Weather

Projektinformationen

ROADVIEW

ID Finanzhilfevereinbarung: 101069576

DOI

10.3030/101069576

EK-Unterschriftsdatum 9 Juni 2022

Startdatum 1 September 2022

Enddatum 31 August 2026

Finanziert unter

• Climate, Energy and Mobility

Gesamtkosten

€ 8 014 105,55

EU-Beitrag

€ 6 652 915,80

Koordiniert durch

HOGSKOLAN I HALMSTAD
Sweden

CORDIS bietet Links zu öffentlichen Ergebnissen und Veröffentlichungen von HORIZONT-Projekten.

Links zu Ergebnissen und Veröffentlichungen von RP7-Projekten sowie Links zu einigen Typen spezifischer Ergebnisse wie Datensätzen und Software werden dynamisch von OpenAIRE abgerufen.

Leistungen

Documents, reports (23)

SW on Improved Localization Using High-density Map Updating - Final report

A final report related SW of a compressed HD map representation that can cope with the seasonal changes and can be kept updated while excluding the dynamic objects.

Final KPI specifications

Update on the KPI specifications.

Evaluation of sensors in-situ

Report on robustness of shielded sensors based on data while driving in real-world harsh weather conditions, including possible mitigations such as design choices, filtering, and calibration.

Test plan regarding the most appropriate test method

Report defining how to test single components and integrated automated vehicle systems in virtual and real domains. It will consider specific uses-cases under extreme weather conditions.

Report on data privacy and storage

Data privacy and storage of the logged data.

Final readiness assessment of specific datasets

Final report on the quantitative evaluation of the ROADVIEW DRL method on public datasets and on the ROADVIEW dataset using enlarged feature sets.

Initial readiness assessment of specific datasets

Report on the quantitative evaluation of the ROADVIEW DRL method on public datasets using a limited feature size.

Interim impact report

Interim impact report on communication and dissemination activities, including those at the international level. An update of the DCP plan will be considered.

SW on Improved Localization Using High-density Map Updating - First report

A first report related SW of a compressed HD map representation that can cope with the seasonal changes and can be kept updated while excluding the dynamic objects.

SW on Collaborative Perception Solutions - Final report

A final report on improving vehicle perception with sharing information provided by sensors from other connected vehicles or VRUs and roadside infrastructure.

SW on Adaptive Sensor Fusion and Perception Solutions - Final report

A final report on algorithms and SW developed to detect weather-related physical conditions (e.g., heavy rain, fog, slush and snow), free space detection, object detection and tracking, and adaptive sensor fusion.

SW on Adaptive Sensor Fusion and Perception Solutions - First report

A first report on algorithms and SW developed to detect weather-related physical conditions (e.g., heavy rain, fog, slush and snow), free space detection, object detection and tracking, and adaptive sensor fusion.

Stakeholder report and strategy

Stakeholder report and strategy including detailed stakeholder mapping and strategies to reach key target audiences.

Environmental and weather condition state estimates

Report on the online state estimation method providing the reliable visibility range and weather conditions using camera, LiDAR, and RADAR sensor data.

Vehicle dynamics modelling methodology

A public report will be published along with any relevant publications on vehicle dynamics modelling methodologies. In addition, a representative library of vehicle dynamics models for a selection of vehicles available within the consortium will be delivered.

Definition of the complex environment conditions

An extended ODD taxonomy will be reported considering harsh weather conditions and complex urban/rural environments.

XAI design of perception solutions

Explainability requirement specifications, report and implementation of XAI design for AI models developed in Tasks 5.2 and 5.3.

SW on Collaborative Perception Solutions - First report

A first report on improving vehicle perception with sharing information provided by sensors from other connected vehicles or VRUs and roadside infrastructure.

Report on data annotation

Report on the categorisation and labelling of data.

Use cases and scenarios

A set of use cases with multiple scenarios will be reported based on the ODD taxonomy defined in Task 2.1.

Plan for the dissemination and communication activities

Plan for the dissemination and communication activities including defined strategy, tools, channels and (international) activities.

Initial KPI specifications

Report on the KPI specifications.

Relevant metrics to assert the validity of the simulation-assisted test methods

This report describes the relevant metrics for the validation of simulation-assisted methods in comparison to controlled environment/proving ground reference values.

Other (3)

Library of internal sensor noise models and compound noise modelling methodology

A library of internal sensor noise models for the perception sensors selected for the project will be delivered. This will be accompanied by a report on noise modelling, the methodologies to combine multiple noise factor effects on the sensor outputs for different sensor technologies, and any significant corner cases or scenarios to test where compound noise could create significant degradation of sensor performance.

Library of validated physics-based parameterised noise models

A library of validated physics-based parameterised noise models for the selected perception sensor technologies with detailed report on implementation, validation methods and comparison of the generated models based on the agreed evaluation metrics.

Library of validated statistical noise models

A library of validated statistical noise models for the selected perception sensor technologies will be delivered with a detailed report on implementation and validation methods used.

Data sets, microdata, etc (2)

GitHub release of ROADVIEW Readiness levels

Release of the source code for DRL.

Reference dataset of measured weather characteristics

Reference datasets for the controlled environment and real-world site weather characteristics will be delivered, with a detailed report on data collection methodology.

Websites, patent fillings, videos etc. (1)

ROADVIEW website

ROADVIEW website with dedicated areas for different stakeholder groups.

Demonstrators, pilots, prototypes (1)

ROADVIEW Demonstration 1

Report on the demonstration of early ROADVIEW system components implementations to be used in the subsequent demonstrations.

Veröffentlichungen

Conference proceedings (9)

Synthetic Extreme Weather for AI training: Concept and Validation

Autoren: Letícia Cristófoli Duarte Silva, Maikol Funk Drechsler, Yuri Poledna, Werner Huber, Thiago Antonio Fiorentin
Veröffentlicht in: 2023 Third International Conference on Digital Data Processing (DDP), 2024, ISSN 2473-2001
Herausgeber: IEEExplore
DOI: 10.1109/DDP60485.2023.00044

Creation of digital models for accelerated and reliable testing of automated systems in adverse weather

Autoren: Tuomas Herranen, Erik Henriksson, Pak Hung Chan, Yuri Poledna, Pierre Duthon, Amine Ben-Daoued, Maikol Drechsler, Valentina Donzella
Veröffentlicht in: Autonomous Systems for Security and Defence, 2024
Herausgeber: SPIE
DOI: 10.1117/12.3031473

Semantics-aware LiDAR-Only Pseudo Point Cloud Generation for 3D Object Detection

Autoren: Tiago Cortinhal, Idriss Gouigah, Eren Erdal Aksoy
Veröffentlicht in: 2024 IEEE Intelligent Vehicles Symposium (IV), 2024
Herausgeber: IEEE
DOI: 10.1109/IV55156.2024.10588782

Vehicle Dynamics Parameter Estimation Methodology for Virtual Automated Driving Testing

Autoren: Maikol Funk Drechsler, Yuri Poledna, Mattias Hjort, Sogol Kharrazi, Werner Huber
Veröffentlicht in: 2024 IEEE International Automated Vehicle Validation Conference (IAVVC), 2024
Herausgeber: IEEE
DOI: 10.1109/IAVVC63304.2024.10786416

REHEARSE: adveRse wEatHEr datAset for sensoRy noiSe modEls

Autoren: Yuri Poledna, Maikol Funk Drechsler, Valentina Donzella, Pak Hung Chan, Pierre Duthon, Werner Huber
Veröffentlicht in: 2024 IEEE Intelligent Vehicles Symposium (IV), 2024
Herausgeber: IEEE
DOI: 10.1109/IV55156.2024.10588491

3D-OutDet: A Fast and Memory Efficient Outlier Detector for 3D LiDAR Point Clouds in Adverse Weather

Autoren: Raisuddin, Abu Mohammed; Cortinhal, Tiago; Holmblad, Jesper; Aksoy, Eren Erdal
Veröffentlicht in: 2024 IEEE Intelligent Vehicles Symposium (IV), 2024
Herausgeber: IEEE
DOI: 10.36227/TECHRXIV.24297166.V1

Simulation numérique de capteurs perceptifs du véhicule autonome sous conditions météorologiques dégradées

Autoren: Amine Ben-Daoued; Frédéric Bernardin; Pierre Duthon
Veröffentlicht in: ATEC ITS Congress, 2023
Herausgeber: HAL

The effect of camera data degradation factors on panoptic segmentation for automated driving

Autoren: Wang, Yiting, Zhao, Haonan, Debattista, Kurt and Donzella, Valentina
Veröffentlicht in: 26th IEEE International Conference on Intelligent Transportation Systems (ITSC 2023), 2023
Herausgeber: WRAP Warwick

Parametric Physics-Based Snow Model for Automotive Cameras

Autoren: Pak Hung Chan, Kurt Debattista, Valentina Donzella
Veröffentlicht in: 2024 IEEE SENSORS, 2024
Herausgeber: IEEE
DOI: 10.1109/SENSORS60989.2024.10784836

Peer reviewed articles (11)

A Noise Analysis of 4D RADAR: Robust Sensing for Automotive?

Autoren: Pak Hung Chan; Sepeedeh Shahbeigi Roudposhti; Xinyi Ye; Valentina Donzella
Veröffentlicht in: IEEE Sensors Journal, 2025, ISSN 1558-1748
Herausgeber: IEEE
DOI: 10.36227/TECHRXIV.24517249

Raw Camera Data Object Detectors: An Optimisation for Automotive Video Processing and Transmission

Autoren: Pak Hung Chan, Chuheng Wei, Anthony Huggett, Valentina Donzella
Veröffentlicht in: IEEE Access, Ausgabe 13, 2025, ISSN 2169-3536
Herausgeber: IEEE
DOI: 10.36227/TECHRXIV.23807499.V1

The inconvenient truth of ground truth errors in automotive datasets and DNN-based detection

Autoren: Chan, Pak Hung; Li, Boda; Baris, Gabriele; Sadiq, Qasim; Donzella, Valentina
Veröffentlicht in: Data-Centric Engineering, 2024, ISSN 2632-6736
Herausgeber: Cambridge University Press
DOI: 10.36227/TECHRXIV.170630689.97107789/V1

A Novel Score-based LiDAR Point Cloud degradation Analysis Method

Autoren: Sepeedeh Shahbeigi, Honahan Robinson, Valentina Donzella
Veröffentlicht in: IEEE Transactions and Journals, 2024, ISSN 1803-7232
Herausgeber: IEEE Xplore
DOI: 10.1109/ACCESS.2024.3359300

Automotive DNN-Based Object Detection in the Presence of Lens Obstruction and Video Compression

Autoren: Gabriele Baris, Boda Li, Pak Hung Chan, Carlo Alberto Avizzano, Valentina Donzella
Veröffentlicht in: IEEE Access, Ausgabe 13, 2025, ISSN 2169-3536
Herausgeber: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/ACCESS.2025.3544773

A Comparative Review of the SWEET Simulator: Theoretical Verification Against Other Simulators

Autoren: Amine Ben-Daoued; Frédéric Bernardin; Pierre Duthon
Veröffentlicht in: Journal of Imaging, 2024, ISSN 3064-6936
Herausgeber: MDPI
DOI: 10.3390/JIMAGING10120306

LiDAR De-Snow Score (DSS): Combining Quality and Perception Metrics for Optimized De-Noising

Autoren: Valentina Donzella, Pak Hung Chan, Daniel Gummadi, Abu Mohammed Raisuddin, Eren Erdal Aksoy
Veröffentlicht in: IEEE Sensors Journal, Ausgabe 25, 2025, ISSN 1530-437X
Herausgeber: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/JSEN.2025.3570478

Depth- and semantics-aware multi-modal domain translation: Generating 3D panoramic color images from LiDAR point clouds

Autoren: Tiago Cortinhal, Eren Erdal Aksoy
Veröffentlicht in: Robotics and Autonomous Systems, 2023, ISSN 0921-8890
Herausgeber: Science Direct | Elsevier
DOI: 10.1016/j.robot.2023.104583

SWEET: A Realistic Multiwavelength 3D Simulator for Automotive Perceptive Sensors in Foggy Conditions

Autoren: Amine Ben-Daoued; Pierre Duthon; Frédéric Bernardin
Veröffentlicht in: Journal of Imaging, 2023, ISSN 2313-433X
Herausgeber: MDPI
DOI: 10.3390/jimaging9020054

Influence of AVC and HEVC Compression on Detection of Vehicles Through Faster R-CNN

Autoren: Pak Hung Chan, Anthony Huggett, Georgina Souvalioti, Paul Jennings, Valentina Donzella
Veröffentlicht in: IEEE Transactions on Intelligent Transportation Systems, Ausgabe 25, 2025, ISSN 1524-9050
Herausgeber: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.36227/TECHRXIV.19808566

From operational design domain to test cases: A methodology to include harsh weather

Autoren: Fredrik Warg; Valentina Donzella; Pak Hung Chan; Jonathan Robinson; Yuri Poledna; Sebastien Liandrat; Umut Cihan; Maytheewat Aramrattana; Graham Lee; Eren Erdal Aksoy
Veröffentlicht in: Open Research Europe, 2024, ISSN 2732-5121
Herausgeber: European Commission
DOI: 10.12688/OPENRESEUROPE.18592.1

Other (7)

3D-OutDet: A Fast and Memory Efficient Outlier Detector for 3D LiDAR Point Clouds in Adverse Weather

Autoren: Abu Mohammed Raisuddin, Tiago Cortinhal, Jesper Holmblad, Eren Erdal Aksoy
Veröffentlicht in: TechRxiv, 2023
Herausgeber: TechRxiv
DOI: 10.36227/techrxiv.24297166.v1

Semantics-aware LiDAR-Only Pseudo Point Cloud Generation for 3D Object Detection

Autoren: Tiago Cortinhal, Idriss Gouigah, Eren Erdal Aksoy
Veröffentlicht in: arXiv, 2023
Herausgeber: arXiv
DOI: 10.48550/arXiv.2309.08932

Raw camera data object detectors: an optimisation for automotive processing and transmission

Autoren: Pak Hung Chan, Chuheng Wei, Anthony Huggett, Valentina Donzella
Veröffentlicht in: TechRxiv, 2023
Herausgeber: TechRxiv
DOI: 10.36227/techrxiv.23807499.v1

Correlating traditional image quality metrics and DNN-based object detection: a case study with compressed camera data

Autoren: Daniel Gummadi, Pak Hung Chan, Hetian Wang, Valentina Donzella
Veröffentlicht in: TechRxiv, 2023
Herausgeber: TechRxiv
DOI: 10.36227/techrxiv.24566371.v1

Analysis of Faster R-CNN network prediction in the presence of lens occlusion and video compression

Autoren: Gabriele Baris, Boda Li, Pak Hung Chan, Carlo Alberto Avizzano, Valentina Donzella
Veröffentlicht in: TechRxiv, 2023
Herausgeber: TechRxiv
DOI: 10.36227/techrxiv.23047412.v1

An Experimental Study on ObjectTracking

Autoren: Mahmoud Alshaikh
Veröffentlicht in: 2025
Herausgeber: n/a

A noise analysis of 4D RADAR: robust sensing for automotive?

Autoren: Pak Hung Chan, Sepeedeh Shahbeigi Roudposhti, Xinyi Ye, Valentina Donzella
Veröffentlicht in: TechRxiv, 2023
Herausgeber: TechRxiv
DOI: 10.36227/techrxiv.24517249.v1

Thesis and dissertations (1)

Pixelwise Road Surface Slipperiness Estimation for Autonomous Driving with Weakly Supervised Learning

Autoren: Julius Pesonen
Veröffentlicht in: Machine Learning, Data Science and Artificial Intelligence, 2023
Herausgeber: Aaltodoc publication archive

Book chapters (2)

Road Grip Uncertainty Estimation Through Surface State Segmentation

Autoren: Jyri Maanpää, Julius Pesonen, Iaroslav Melekhov, Heikki Hyyti, Juha Hyyppä
Veröffentlicht in: Lecture Notes in Computer Science, Image Analysis, 2025
Herausgeber: Springer Nature Switzerland
DOI: 10.1007/978-3-031-95911-0_17

Dense Road Surface Grip Map Prediction from Multimodal Image Data

Autoren: Jyri Maanpää, Julius Pesonen, Heikki Hyyti, Iaroslav Melekhov, Juho Kannala, Petri Manninen, Antero Kukko, Juha Hyyppä
Veröffentlicht in: Lecture Notes in Computer Science, Pattern Recognition, 2024
Herausgeber: Springer Nature Switzerland
DOI: 10.1007/978-3-031-78447-7_26