Making The Invisible Visible for Off-Highway Machinery by Conveying Extended Reality Technologies

Informations projet

THEIA-XR

N° de convention de subvention: 101092861

DOI

10.3030/101092861

Projet clôturé

Date de signature de la CE 15 Novembre 2022

Date de début 1 Janvier 2023

Date de fin 31 Decembre 2025

Financé au titre de

• Digital, Industry and Space

Coût total

€ 6 192 686,50

Contribution de l’UE

€ 6 192 686,00

Coordonné par

TTCONTROL GMBH
Austria

CORDIS fournit des liens vers les livrables publics et les publications des projets HORIZON.

Les liens vers les livrables et les publications des projets du 7e PC, ainsi que les liens vers certains types de résultats spécifiques tels que les jeux de données et les logiciels, sont récupérés dynamiquement sur OpenAIRE .

Livrables

Documents, reports (6)

Impact activities (first version)

Deliverable D7.2 will be the first report on the communication, dissemination, exploitation activities as well as on business value and market propositions.

Design guidelines and validation reports for privacy (first version)

Deliverable D7.3 will be a document with design guidelines for privacy and security, ready to be implemented in XR products in work context.

Integrated THEIA-XR technologies and methodologies and use case implementation (first version)

Deliverable D6.1 will provide the first version of the integrated technology and methodology components (from WP3, WP4 and WP5) as well as first implementation of the use case applications and services.

Use Case Specification (first version)

D2.1 will contain a detailed specification of the use cases, highlighting the individual activities and scenarios to be tackled inside the use cases.

Privacy Requirements

The privacy requirements will outline vital privacy considerations, derived from the process outline in the task description.

Technology Analysis and Requirements Specification (first version)

D2.2 will include the state-of-the-art technology analysis and the initial requirements specification for the 1st version of the THEIA-XR technologies and the use cases.

Other (3)

Interaction modality assignment

Deliverable D4.2 provides the interaction modality framework with criteria-based recommendations for information presentation.

HMI content list (first version)

Deliverable D4.1 provides a first overview of prioritized and clustered information embedded in the use case descriptions.

Interaction sequence models (first version)

First version of the modeled interaction workflows for identified operator activities.

Demonstrators, pilots, prototypes (3)

Prototypes for privacy-related questions (first version)

Deliverable D3.3 provides first versions of prototypes and validation reports of concepts investigating privacy-related questions in XR contexts.

Concept of virtual user interface (first version)

First concept of an human-machine interaction with simulated machine model

Interaction concepts (first version)

First playable immersive demonstration illustrating the different interaction concepts

Publications

Thesis and dissertations (14)

Steering Wheel Control for Virtual Toy Car Driving

Auteurs: Johannes Aigner
Publié dans: 2024
Éditeur: Technische Universität Graz

XR application for remote operations

Auteurs: Andrea Alesani
Éditeur: Politecnica di Milano

Spotlight Control for Real-Time Targeting

Auteurs: Mika Heinemann
Publié dans: 2024
Éditeur: Technische Universität Graz

Laser-Projection based Augmented Reality for Snow Grooming

Auteurs: Maximilian Tschulik
Publié dans: 2023
Éditeur: Technische Universität Graz

Mobile Visual Search revisited

Auteurs: Timon Kanik
Éditeur: Graz University of Technology

Combining DLP and Laser Projection for Augmented Reality Visualizations

Auteurs: Maximilian Tschulik
Éditeur: Graz University of Technology

Distance and Odometry Measurements on Toy Car with VR Visualization

Auteurs: Jakob Khom
Publié dans: 2024
Éditeur: Technische Universität Graz

In-Situ Virtual Reality Tour using a realtime 360° video stream

Auteurs: Simon Fussi
Publié dans: 2024
Éditeur: Technische Universität Graz

Bridge XR: Towards a Cross-Realities Student/Teacher System - A mixed reality training environment

Auteurs: Franz Feichtinger
Éditeur: Graz University of Technology

Container Bridge Model using ESP cameras

Auteurs: Franz Feichtinger
Publié dans: 2024
Éditeur: Technische Universität Graz

Design of a low-cost FMCW Ground-Penetrating Radar based on a single-board computer

Auteurs: Bernhard Englmair
Éditeur: Graz University of Technology

3D Depth Experience in VR from Monocular Video

Auteurs: Christoph Nickas
Éditeur: Graz University of Technology

Rear-View Camera System for Trailer Parking

Auteurs: Daniel Kreimer
Éditeur: Graz University of Technology

MIPI-Camera based Panoramic Camera Design and Implementation

Auteurs: Lukas Fuchs
Publié dans: 2024
Éditeur: Technische Universität Graz

Peer reviewed articles (5)

Bag of World Anchors for Instant Large-Scale Localization

Auteurs: Reyes Aviles, Fernando; Fleck, Philipp; Schmalstieg, Dieter; Arth, Clemens
Publié dans: IEEE Transactions on Visualization and Computer Graphics, ISSN 1941-0506
Éditeur: IEEE
DOI: 10.1109/TVCG.2023.3320264

Computers and Graphics

Auteurs: Kernbauer, Thomas; Tschulik, Maximilian; Fleck, Philipp; Arth, Clemens
Publié dans: Computers & Graphics, 2024, ISSN 0097-8493
Éditeur: ScienceDirect
DOI: 10.1109/VRW62533.2024.00047

Instant Segmentation and Fitting of Excavations in Subsurface Utility Engineering

Auteurs: Marco Stranner, Philipp Fleck, Dieter Schmalstieg, Clemens ARth
Publié dans: Transactions on Vizualization and Computer Graphics (TVCG), 2024, ISSN 1077-2626
Éditeur: IEEE
DOI: 10.1109/TVCG.2024.3372064

Spotlight Control for Real-Time Targeting

Auteurs: Heinemann, Mika; Thomas, Kernbauer; Fleck, Philipp; Arth, Clemens
Publié dans: Computer Science Research Notes, 2024, ISSN 2464-4625
Éditeur: University of West Bohemia
DOI: 10.5281/ZENODO.12658307

International Journal of Human Computer Studies

Auteurs: Anna Leschanowsky; Anastasia Sergeeva; Judith Bauer; Sheetal Vijapurapu; Mateusz Dubiel
Publié dans: International Journal of Human-Computer Studies, 2025, ISSN 1071-5819
Éditeur: Academic Press
DOI: 10.24406/PUBLICA-5669

Book chapters (2)

Extended Reality simulator to evaluate remote control interactions for reach stackers

Auteurs: Alesani, Andrea; Helin, Kaj; Goriachev, Vladimir; Kuula, Timo
Publié dans: 2024
Éditeur: VTT Technical Research Centre of Finland
DOI: 10.5281/ZENODO.18338766

Making the Invisible Visible - AR supported situation awareness in the snow groomer operations

Auteurs: Helin, Kaj; Alesani, Andrea; Kuula, Timo
Publié dans: 2025
Éditeur: VTT Technical Research Centre of Finland
DOI: 10.32040/2242-122X.2025.T440

Conference proceedings (10)

International Journal of Human Computer Studies

Auteurs: Philippe Valoggia, Anastasia Sergeeva, Arianna Rossi, Wilhelmina Maria Botes
Publié dans: Proceedings of the 10th International Conference on Information Systems Security and Privacy, 2024, 2024, ISSN 1071-5819
Éditeur: Academic Press
DOI: 10.5220/0012393100003648

Spatial Augmented Reality for Heavy Machinery Using Laser Projections

Auteurs: Maximilian Tschulik, Thomas Kernbauer, Philipp Fleck, Clemens Arth
Publié dans: 2024
Éditeur: Elsevier BV
DOI: 10.2139/ssrn.4942184

Assisted Trailer Parking using a Reverse Camera System and Inverse Kinematics

Auteurs: Kreimer, Daniel; Fleck, Philipp; Kernbauer, Thomas; Arth, Clemens
Publié dans: 2025 IEEE Intelligent Vehicles Symposium (IV), 2025
Éditeur: IEEE
DOI: 10.1109/IV64158.2025.11097420

3D Depth Experience in VR from Monocular Video

Auteurs: Nickas', Christoph; Fleck, Philipp; Kernbauer, Thomas; Arth, Clemens
Publié dans: 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2025
Éditeur: IEEE
DOI: 10.1109/VRW66409.2025.00086

PanoTherm: Panoramic Thermal Imaging for Object Detection and Tracking

Auteurs: Kernbauer, Thomas; Fleck, Philipp; Arth, Clemens
Publié dans: Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, ISBN 978-989-758-679-8
Éditeur: SciTePress
DOI: 10.5220/0012330400003660

Making the invisible visible for off-highway machinery by conveying extended reality technologies

Auteurs: Martijn Rooker, Michael Burmester, Gerald Fritz-Mayer, Clemens Arth, Sebastian Lorenz, Volker Waurich, Manuel Kulzer, Anastasia Sergeeva, Kaj Helin, Markku Pusenius, Benjamin Geslot, Daniel Röck, Pekka Yli-Paunu
Publié dans: Proceedings of the 20th EuroXR International Conference, ISSN 2442-122X
Éditeur: VTT Technical Research Centre of Finland Ltd.
DOI: 10.32040/2242-122X-2023.T422

Spotlight Control for Real-Time Targeting

Auteurs: Heinemann, Mika; Thomas, Kernbauer; Fleck, Philipp; Arth, Clemens
Publié dans: 32. International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision, ISSN 2464-4617
Éditeur: University of West Bohemia, Czech Republic
DOI: 10.5281/ZENODO.12658308

Early-stage user experience design of the remote operation concept of the harbour's reachstacker by expoiting eXtended Reality

Auteurs: Helin, K., Alesani, A., Kuula, T., & Goriachev, V.,
Publié dans: International Conference on Applied Human Factor and Ergonomics (AHFE) 2024, 2024
Éditeur: AHFE Open Access
DOI: 10.54941/ahfe1005411

Identifying Ethical Challenges in XR Implementations in the Industrial Domain: A Case of Off-Highway Machinery

Auteurs: Anastasia Sergeeva, Claudia Negri-Ribalta, Gabriele Lenzini
Éditeur: Cornell University

Thermochromic Temperature Measurement: Towards an Alternative to Thermal Cameras

Auteurs: Nussbacher, Thomas; Fleck, Philipp; Arth, Clemens
Publié dans: 2025 IEEE Sensors Applications Symposium (SAS), 2025
Éditeur: IEEE
DOI: 10.1109/SAS65169.2025.11105166

Other (1)

Entwicklung und Evaluation eines Extended-Reality-Bedieninterfaces für Baumaschinen zur Interaktion mit digitalen Baugrubendaten im Kontext BIM

Auteurs: Breitbarth, Tim
Publié dans: 2024
Éditeur: Technische Universität Dresden
DOI: 10.5281/ZENODO.18377690