Robust multimodal pedestrian understanding algorithm for pedestrian safety in autonomous driving

Descripción del proyecto

Algoritmo de detección de peatones para la seguridad de los vehículos autónomos

La industria automovilística se encuentra inmersa en una transformación impulsada por los rápidos avances en la conducción autónoma. En el marco de la Estrategia de la Comisión Europea sobre movilidad sostenible e inteligente, más de la mitad de todos los vehículos nuevos vendidos en la Unión Europea (UE) para 2030 estarán equipados con sistemas avanzados de asistencia al conductor o contarán con autonomía total. Con el apoyo de las Acciones Marie Skłodowska-Curie, el equipo del proyecto SAFEPED desarrolla un marco diseñado para mejorar la capacidad de los vehículos autónomos a la hora de responder ante las personas en entornos urbanos complejos. Utiliza la fusión de sensores e incorpora la comprensión semántica de la escena. En última instancia, este trabajo interdisciplinario tiene como objetivo alcanzar la fiabilidad necesaria para que la conducción autónoma segura sea una realidad en toda Europa.

Objetivo

The automotive industry is undergoing a revolutionary transformation with the rapid development of autonomous driving technologies. According to the European Commission's Strategy on Sustainable and Smart Mobility, more than 50% of new vehicles sold in the EU by 2030 are expected to feature advanced driver-assistance systems (ADAS) or full autonomous capabilities. This project focuses on the critical need for robust pedestrian understanding systems in autonomous vehicles by developing an advanced multimodal perception framework that significantly improves detection accuracy, behavior prediction, and safety in complex urban environments. Specially for the following key technical challenges: optimizing the multi-sensor fusion process to reduce feature redundancy while enhancing representation learning; expanding perception systems to incorporate rich semantic scene understanding for better contextual awareness; and developing defense mechanisms against adversarial attacks that could compromise system reliability. The proposed solution integrates cutting-edge deep learning techniques, including transformer-based architectures for efficient feature extraction, multi-task learning paradigms for simultaneous detection and prediction tasks, and adversarial training methods to enhance system robustness. The project's interdisciplinary approach, combining computer vision, machine learning, and transportation safety expertise, positions it to make significant contributions to both academic research and industrial applications in the emerging field of intelligent transportation systems. The expected results will significantly enhance the safety and reliability of autonomous vehicles in pedestrian-rich environments, contributing to the broader development of safer autonomous driving technologies. These advancements will support ongoing EU efforts to promote autonomous driving and build public trust in these systems.