The research in ImmerSAFE has been structured in three scientific and technological work packages (WP) as illustrated in Fig. 1.
The ESRs of WP1 delivered the following main outcomes, which together led to achieving O1.
• Laura Ribeiro developed a method for automatic joint calibration of multiple cameras utilizing an industrial robotic arm, published in Int. Symposium on Image and Signal Processing and Analysis
• Laura also developed a retro-reflective marker-based approach for remote operation and alignment of tools in harsh industrial environments, published in Fusion Engineering and Design, Applied Sciences and EUVIP
• Yuta Miyanishi developed a rigorous modelling framework for simulating observed retinal images in reaction to a light field, applicable for the next-generation near-eye displays, published in Optics Express
• Anirudh Puligandla developed a multi-resolution approach for optimizing camera placement on a heavy machine, which delivers a complete surround view with a minimal number of cameras, published in IEEE Access
• Shahriar Hasan developed a PlatoonSAFE tool that simulates realistic vehicle dynamics, road traffic, wireless communications, fail-operational and fail-safe states, published in IEEE Vehicular Technology Conference and IEEE Open Journal of Intelligent Transportation Systems
• Shahriar also developed machine learning-based methods for predicting communication delays in vehicular networks
• Nayee Muddin Khan Dousai developed a method for detection of humans in UAV images based on ensemble learning, published in IEEE Access
• Emanuele Palma developed a segmentation-based point cloud compression method and an LF sensor image lossless compression method exploiting pixel predictions, published in EUSIPCO, EUVIP and IEEE Access
ESRs within WP2 delivered outcomes achieving O2
• Soheila Sheikh Bahaei extended human and organization modelling elements in existing metamodels used for modelling socio-technical systems to model AR-equipped socio-technical systems, published in Int. Conf. on Computer Safety, Reliability and Security
• She also developed a framework for risk assessment of AR-equipped socio-technical systems, published in Journal of Systems Architecture
• Taufik Akbar Sitompul designed visual representations to be displayed on the windshield of excavators and mobile cranes, published in VRCAI and Multimodal Technologies and Interaction and together with José Rosa prototyped a transparent display with extended visual functionalities, published in ISARC
• Jose also developed new transparent materials that emit red and blue colors, published in Materials
• Saif Hadj Sassi developed a firefighter training simulator for earthquake situations based on virtual reality, published in Sensors
• Dinar Khowaja developed a simulation system for comparing VR and LCD displays in various driving conditions
The ESRs organized in WP3 delivered outcomes toward O3:
• Simone Grassini evaluated stressful and non-stressful conditions utilizing the Stroop and arithmetic test and developed a driving simulator equipped with non-invasive medical devices for monitoring physiological parameters when using AR, published in Frontiers in Psychology and Brain and Behavior
• Syed Muhammad Umair Arif created a multi-platform AR web-based application for enhancing the user experience in control rooms, published in Frontiers in Neuroscience
• Moses Mariajoseph analyzed the operators’ reaction time when using AR, published in IEEE Vehicular Technology Conference
• Mina Saghafian developed cognitive tasks for evaluating human factors (e.g. presence, motion sickness, workload) during the use of IVTs and proposed a model covering the key issues at each stage of organizational technological changes, published in Frontiers in Psychology.
The network training programme, illustrated in Fig. 2, included 3 Training Schools, 3 Tech Days, 2 Webinar Series, and the final ImmerSAFE cluster day.
The project results have been published in 62 scientific publications and were disseminated to the public through presentation at 28 events. The project also contributed to the work of the JPEG and MPEG standardization bodies.
