Making The Invisible Visible for Off-Highway Machinery by Conveying Extended Reality Technologies

Informazioni relative al progetto

THEIA-XR

ID dell’accordo di sovvenzione: 101092861

DOI

10.3030/101092861

Progetto chiuso

Data della firma CE 15 Novembre 2022

Data di avvio 1 Gennaio 2023

Data di completamento 31 Dicembre 2025

Finanziato da

• Digital, Industry and Space

Costo totale

€ 6 192 686,50

Contributo UE

€ 6 192 686,00

Coordinato da

TTCONTROL GMBH
Austria

CORDIS fornisce collegamenti ai risultati finali pubblici e alle pubblicazioni dei progetti ORIZZONTE.

I link ai risultati e alle pubblicazioni dei progetti del 7° PQ, così come i link ad alcuni tipi di risultati specifici come dataset e software, sono recuperati dinamicamente da .OpenAIRE .

Risultati finali

Documents, reports (23)

Impact activities (first version)

Deliverable D7.2 will be the first report on the communication, dissemination, exploitation activities as well as on business value and market propositions.

Technology Analysis and Requirements Specification (final version)

D2.5 will include the state-of-the-art technology analysis and the final requirements specification for the final version of the THEIA-XR technologies and the use cases.

Interaction Scenarios (final version)

Deliverable D3.7 provides the final version of documented interaction scenarios with integrated concepts for ethical, self-efficacious, and meaningful work.

Evaluation Report (final version)

Deliverable D3.10 is the final evaluation report detailing goal attainment, optimization potential and recommendations.

Design guidelines and validation reports for privacy (first version)

Deliverable D7.3 will be a document with design guidelines for privacy and security, ready to be implemented in XR products in work context.

Integrated THEIA-XR technologies and methodologies and use case implementation (first version)

Deliverable D6.1 will provide the first version of the integrated technology and methodology components (from WP3, WP4 and WP5) as well as first implementation of the use case applications and services.

Use Case Specification (first version)

D2.1 will contain a detailed specification of the use cases, highlighting the individual activities and scenarios to be tackled inside the use cases.

Design guidelines and validation reports for privacy (final version)

Deliverable D7.6 will be a validation report of ethics-related questions in deliverables from other work packages.

Context-of-use Analysis (first version)

First report on main user groups descriptions including tasks, resources, environment and threats.

Evaluation Report (first version)

Deliverable D3.5 is the first evaluation report detailing goal attainment, optimization potential and recommendations.

XR Design guidelines

Completed and published set of scientifically validated design guidelines

Integrated THEIA-XR technologies and methodologies and use case implementation (final version)

Deliverable D6.4 will provide the final version of the integrated technology and methodology components (from WP3, WP4 and WP5) as well as the final implementation of the use case applications and services.

Deployment, testing and demonstration of the THEIA-XR use cases (final version)

Deliverable D6.5 will report on the final version of deployed and tested demonstrators.

Context-of-use Analysis (final version)

Final report on main user groups descriptions including tasks, resources, environment and threats.

Deployment, testing and demonstration of the THEIA-XR use cases (first version)

Deliverable D6.3 will report on the first version of deployed and tested demonstrators.

Validation and evaluation (first version)

Deliverable D6.3 will report on the first validation and evaluation results within the projects, through the defined set of KPIs.

Privacy assessment results

A report on the validation of privacy perceptions for each of the tested use cases will be created.

Privacy Requirements

The privacy requirements will outline vital privacy considerations, derived from the process outline in the task description.

Interaction Scenarios (first version)

Deliverable D3.2 provides the first version of documented interaction scenarios with integrated concepts for ethical, self-efficacious, and meaningful work.

Impact activities (final version)

Deliverable D7.5 will be the final report on the communication, dissemination, exploitation activities as well as on business value and market propositions.

Validation and evaluation (final version)

Deliverable D6.6 will report on the final validation and evaluation results and lessons learnt within the projects, through the defined set of KPIs.

Technology Analysis and Requirements Specification (first version)

D2.2 will include the state-of-the-art technology analysis and the initial requirements specification for the 1st version of the THEIA-XR technologies and the use cases.

Use Case Specification (final version)

The final version, D2.4, will update the use case specifications.

Other (5)

Interaction modality assignment

Deliverable D4.2 provides the interaction modality framework with criteria-based recommendations for information presentation.

HMI content list (final version)

Deliverable D4.6 provides the final overview of prioritized and clustered information embedded in the use case descriptions.

HMI content list (first version)

Deliverable D4.1 provides a first overview of prioritized and clustered information embedded in the use case descriptions.

Interaction sequence models (final version)

Final version of the modeled interaction workflows for identified operator activities.

Interaction sequence models (first version)

First version of the modeled interaction workflows for identified operator activities.

Demonstrators, pilots, prototypes (6)

Prototypes for privacy-related questions (first version)

Deliverable D3.3 provides first versions of prototypes and validation reports of concepts investigating privacy-related questions in XR contexts.

Concept of virtual user interface (first version)

First concept of an human-machine interaction with simulated machine model

Prototypes for privacy-related questions (final version)

Deliverable D3.3 provides final versions of prototypes and validation reports of concepts investigating privacy-related questions in XR contexts.

Interaction concepts (final version)

Final playable immersive demonstration illustrating the different interaction concepts

Interaction concepts (first version)

First playable immersive demonstration illustrating the different interaction concepts

Concept of virtual user interface (final version)

Final concept of an human-machine interaction with simulated machine model

Pubblicazioni

Thesis and dissertations (17)

Steering Wheel Control for Virtual Toy Car Driving

Autori: Johannes Aigner
Pubblicato in: 2024
Editore: Technische Universität Graz

XR application for remote operations

Autori: Andrea Alesani
Editore: Politecnica di Milano

Visionäre Arbeitsumgebungen für Snowgroomer: Methodische Ansätze und prototypische Implementierung

Autori: Felix Wickert
Pubblicato in: 2025
Editore: Hochschule Reutlingen

Spotlight Control for Real-Time Targeting

Autori: Mika Heinemann
Pubblicato in: 2024
Editore: Technische Universität Graz

Laser-Projection based Augmented Reality for Snow Grooming

Autori: Maximilian Tschulik
Pubblicato in: 2023
Editore: Technische Universität Graz

Mobile Visual Search revisited

Autori: Timon Kanik
Editore: Graz University of Technology

Combining DLP and Laser Projection for Augmented Reality Visualizations

Autori: Maximilian Tschulik
Editore: Graz University of Technology

Distance and Odometry Measurements on Toy Car with VR Visualization

Autori: Jakob Khom
Pubblicato in: 2024
Editore: Technische Universität Graz

In-Situ Virtual Reality Tour using a realtime 360° video stream

Autori: Simon Fussi
Pubblicato in: 2024
Editore: Technische Universität Graz

Bridge XR: Towards a Cross-Realities Student/Teacher System - A mixed reality training environment

Autori: Franz Feichtinger
Editore: Graz University of Technology

Container Bridge Model using ESP cameras

Autori: Franz Feichtinger
Pubblicato in: 2024
Editore: Technische Universität Graz

Design of a low-cost FMCW Ground-Penetrating Radar based on a single-board computer

Autori: Bernhard Englmair
Editore: Graz University of Technology

3D Depth Experience in VR from Monocular Video

Autori: Christoph Nickas
Editore: Graz University of Technology

How to Build a VR Headset

Autori: Alexander Albin Streißnig
Pubblicato in: 2025
Editore: Technische Universität Graz
DOI: 10.3217/FPGR3-NEM31

Optimizing H.265 Real-Time Streaming

Autori: Lukas Fuchs
Pubblicato in: 2025
Editore: Technische Universität Graz
DOI: 10.3217/K72F3-HS602

Rear-View Camera System for Trailer Parking

Autori: Daniel Kreimer
Editore: Graz University of Technology

MIPI-Camera based Panoramic Camera Design and Implementation

Autori: Lukas Fuchs
Pubblicato in: 2024
Editore: Technische Universität Graz

Conference proceedings (18)

Entwicklung eines Methodenkartensets zur Steigerung der Multimodalität von Bedienkonzepten

Autori: null null, Julius Röhlig, Sebastian Lorenz, null null
Pubblicato in: Entwerfen Entwickeln Erleben 2024 : Menschen, Technik und Methoden in Produktentwicklung und Design, 2024
Editore: Technische Universität Dresden
DOI: 10.25368/2024.EEE.009

International Journal of Human Computer Studies

Autori: Philippe Valoggia, Anastasia Sergeeva, Arianna Rossi, Wilhelmina Maria Botes
Pubblicato in: Proceedings of the 10th International Conference on Information Systems Security and Privacy, 2024, 2024, ISSN 1071-5819
Editore: Academic Press
DOI: 10.5220/0012393100003648

Almost 28 Years later: Mobile Visual Search Using Large Datasets on Handheld Hardware

Autori: Timon Kanik, Philipp Fleck, Thomas Kernbauer, Clemens Arth
Pubblicato in: Proceedings of the 21st International Conference on Computer Vision Theory and Applications, 2026
Editore: SCITEPRESS - Science and Technology Publications
DOI: 10.5220/0014334200004084

Change-Resilient Localization Estimation

Autori: Fernando Reyes-Aviles, Philipp Fleck, Dieter Schmalstieg, Clemens Arth
Pubblicato in: 2026 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2026
Editore: IEEE
DOI: 10.1109/VR67842.2026.00041

Extended Reality Simulator to Evaluate Remote Control Interactions for Reach Stackers

Autori: Andrea Alesani,Kaj Helin,Vladimir Goriachev, Timo Kuula
Editore: VTT Technical Research Centre of Finland
DOI: 10.5281/ZENODO.19860128

Spatial Augmented Reality for Heavy Machinery Using Laser Projections

Autori: Maximilian Tschulik, Thomas Kernbauer, Philipp Fleck, Clemens Arth
Pubblicato in: 2024
Editore: Elsevier BV
DOI: 10.2139/ssrn.4942184

Learning from the Dark Side About How (not) to Engineer Privacy: Analysis of Dark Patterns Taxonomies from an ISO 29100 Perspective

Autori: Philippe Valoggia, Anastasia Sergeeva, Arianna Rossi, Marietjie Botes
Pubblicato in: Proceedings of the 10th International Conference on Information Systems Security and Privacy, 2024
Editore: SCITEPRESS - Science and Technology Publications
DOI: 10.5220/0012393100003648

Assisted Trailer Parking using a Reverse Camera System and Inverse Kinematics

Autori: Kreimer, Daniel; Fleck, Philipp; Kernbauer, Thomas; Arth, Clemens
Pubblicato in: 2025 IEEE Intelligent Vehicles Symposium (IV), 2025
Editore: IEEE
DOI: 10.1109/IV64158.2025.11097420

3D Depth Experience in VR from Monocular Video

Autori: Nickas', Christoph; Fleck, Philipp; Kernbauer, Thomas; Arth, Clemens
Pubblicato in: 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2025
Editore: IEEE
DOI: 10.1109/VRW66409.2025.00086

Power to the operators: Transdisciplinary co-design of XR applications in off-highway vehicle work domains

Autori: Manuel Kulzer, Tanja Brodbeck, Michael Burmester
Pubblicato in: EuroXR 2024: Proceedings of the 21st EuroXR International Conference, 2024
Editore: VTT Technical Research Centre of Finland
DOI: 10.5281/ZENODO.19859995

PanoTherm: Panoramic Thermal Imaging for Object Detection and Tracking

Autori: Kernbauer, Thomas; Fleck, Philipp; Arth, Clemens
Pubblicato in: Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, ISBN 978-989-758-679-8
Editore: SciTePress
DOI: 10.5220/0012330400003660

Augmenting Controls for Tracked Vehicles with Force and Tactile Feedback: a Work in Progress

Autori: Thomas Howard, Benjamin Geslot, Jerome Perret
Pubblicato in: 2024
Editore: VTT Technical Research Centre of Finland
DOI: 10.5281/ZENODO.19858824

Making the invisible visible for off-highway machinery by conveying extended reality technologies

Autori: Martijn Rooker, Michael Burmester, Gerald Fritz-Mayer, Clemens Arth, Sebastian Lorenz, Volker Waurich, Manuel Kulzer, Anastasia Sergeeva, Kaj Helin, Markku Pusenius, Benjamin Geslot, Daniel Röck, Pekka Yli-Paunu
Pubblicato in: Proceedings of the 20th EuroXR International Conference, ISSN 2442-122X
Editore: VTT Technical Research Centre of Finland Ltd.
DOI: 10.32040/2242-122X-2023.T422

Spotlight Control for Real-Time Targeting

Autori: Heinemann, Mika; Thomas, Kernbauer; Fleck, Philipp; Arth, Clemens
Pubblicato in: 32. International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision, ISSN 2464-4617
Editore: University of West Bohemia, Czech Republic
DOI: 10.5281/ZENODO.12658308

Early-stage user experience design of the remote operation concept of the harbour's reachstacker by expoiting eXtended Reality

Autori: Helin, K., Alesani, A., Kuula, T., & Goriachev, V.,
Pubblicato in: International Conference on Applied Human Factor and Ergonomics (AHFE) 2024, 2024
Editore: AHFE Open Access
DOI: 10.54941/ahfe1005411

Identifying Ethical Challenges in XR Implementations in the Industrial Domain: A Case of Off-Highway Machinery

Autori: Anastasia Sergeeva, Claudia Negri-Ribalta, Gabriele Lenzini
Pubblicato in: CHI 2025, 2025
Editore: Cornell University

Shape-Shifting Splats: Realtime Context Translation for Gaussian Splatting in VR

Autori: Thomas Kernbauer, Simon Fussi, Philipp Fleck, Clemens Arth
Pubblicato in: 2026 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2026
Editore: IEEE
DOI: 10.1109/VR67842.2026.00046

Thermochromic Temperature Measurement: Towards an Alternative to Thermal Cameras

Autori: Nussbacher, Thomas; Fleck, Philipp; Arth, Clemens
Pubblicato in: 2025 IEEE Sensors Applications Symposium (SAS), 2025
Editore: IEEE
DOI: 10.1109/SAS65169.2025.11105166

Peer reviewed articles (9)

Bag of World Anchors for Instant Large-Scale Localization

Autori: Reyes Aviles, Fernando; Fleck, Philipp; Schmalstieg, Dieter; Arth, Clemens
Pubblicato in: IEEE Transactions on Visualization and Computer Graphics, ISSN 1941-0506
Editore: IEEE
DOI: 10.1109/TVCG.2023.3320264

An Inexpensive Chest Belt for measuring Respiratory Effort

Autori: Maximilian Geiger, Philipp Fleck, Clemens Arth
Pubblicato in: IEEE Sensors Journal, 2026, ISSN 1530-437X
Editore: Institute of Electrical and Electronics Engineers (IEEE)
DOI: 10.1109/JSEN.2026.3668016

Exploring the Impact of Modality and Speech Rate Manipulation in Voice Permission Requests—Limits of Applicability and Potential for Influencing Decision-Making

Autori: Anna Leschanowsky, Anastasia Sergeeva, Judith Bauer, Sheetal Vijapurapu, Mateusz Dubiel
Pubblicato in: International Journal of Human-Computer Studies, Numero 205, 2026, ISSN 1071-5819
Editore: Elsevier BV
DOI: 10.1016/J.IJHCS.2025.103590

Computers and Graphics

Autori: Tschulik, Maximilian; Kernbauer, Thomas; Fleck, Philipp; Arth, Clemens
Pubblicato in: Computers & Graphics, 2024, ISSN 0097-8493
Editore: Pergamon Press Ltd.
DOI: 10.1109/VRW62533.2024.00047

Computers and Graphics

Autori: Kernbauer, Thomas; Tschulik, Maximilian; Fleck, Philipp; Arth, Clemens
Pubblicato in: Computers & Graphics, 2024, ISSN 0097-8493
Editore: ScienceDirect
DOI: 10.1109/VRW62533.2024.00047

Virtual memory for 3D Gaussian Splatting

Autori: Jonathan Haberl, Philipp Fleck, Clemens Arth
Pubblicato in: Computers & Graphics, Numero 137, 2026, ISSN 0097-8493
Editore: Elsevier BV
DOI: 10.1016/J.CAG.2026.104598

Instant Segmentation and Fitting of Excavations in Subsurface Utility Engineering

Autori: Marco Stranner, Philipp Fleck, Dieter Schmalstieg, Clemens ARth
Pubblicato in: Transactions on Vizualization and Computer Graphics (TVCG), 2024, ISSN 1077-2626
Editore: IEEE
DOI: 10.1109/TVCG.2024.3372064

Spotlight Control for Real-Time Targeting

Autori: Heinemann, Mika; Thomas, Kernbauer; Fleck, Philipp; Arth, Clemens
Pubblicato in: Computer Science Research Notes, 2024, ISSN 2464-4625
Editore: University of West Bohemia
DOI: 10.5281/ZENODO.12658307

International Journal of Human Computer Studies

Autori: Anna Leschanowsky; Anastasia Sergeeva; Judith Bauer; Sheetal Vijapurapu; Mateusz Dubiel
Pubblicato in: International Journal of Human-Computer Studies, 2025, ISSN 1071-5819
Editore: Academic Press
DOI: 10.24406/PUBLICA-5669

Book chapters (2)

Extended Reality simulator to evaluate remote control interactions for reach stackers

Autori: Alesani, Andrea; Helin, Kaj; Goriachev, Vladimir; Kuula, Timo
Pubblicato in: 2024
Editore: VTT Technical Research Centre of Finland
DOI: 10.5281/ZENODO.18338766

Making the Invisible Visible - AR supported situation awareness in the snow groomer operations

Autori: Helin, Kaj; Alesani, Andrea; Kuula, Timo
Pubblicato in: 2025
Editore: VTT Technical Research Centre of Finland
DOI: 10.32040/2242-122X.2025.T440

Other (1)

Entwicklung und Evaluation eines Extended-Reality-Bedieninterfaces für Baumaschinen zur Interaktion mit digitalen Baugrubendaten im Kontext BIM

Autori: Breitbarth, Tim
Pubblicato in: 2024
Editore: Technische Universität Dresden
DOI: 10.5281/ZENODO.18377690