Mixed reality ecosystem for teaching robotics in manufacturing

Informations projet

MASTER

N° de convention de subvention: 101093079

DOI 10.3030/101093079

Date de signature de la CE 21 Novembre 2022

Date de début 1 Janvier 2023

Date de fin 30 Juin 2026

Financé au titre de

• Digital, Industry and Space

Coût total € 8 335 379,06

Contribution de l’UE € 7 983 840,00

Coordonné par

PANEPISTIMIO PATRON
Grèce

CORDIS fournit des liens vers les livrables publics et les publications des projets HORIZON.

Les liens vers les livrables et les publications des projets du 7e PC, ainsi que les liens vers certains types de résultats spécifiques tels que les jeux de données et les logiciels, sont récupérés dynamiquement sur OpenAIRE .

Livrables

Démonstrateurs, pilotes, prototypes (8)

Tools for robot application programming with PbD and visual support - First version

The first version of robot programming tool will be described, including the Programming-by-Demonstration (PbD) technique and the Look-and-Move (L&M) technique

Demonstrator of active and passive gaze-based interaction in XR - First version

Description of the first development of a module for active and passive gaze-based interaction in XR settings

Demonstrator of active and passive gaze-based interaction in XR - Initial design

Description of the design of the module for active and passive gazebased interaction in XR settings

Platform for XR content creation - Initial design

Design of the XR platform for content creation

Platform for XR content creation - First version

First version of the XR platform for content creation

MR based features for ensuring health and safety - Initial design

Initial design of MR features integrated with AI decision making tools that will ensure health and safety in a workplace

MR based features for ensuring health and safety - First version

First version of MR features integrated with AI decision making tools, that will ensure health and safety in a workplace.

Tools for robot application programming with PbD and visual support - Initial design

The design of robot programming tool will be described including the ProgrammingbyDemonstration PbD technique and the LookandMove LM technique

Documents, rapports (3)

Definition of platform and educational use cases for each category of end-user

Describe the features that will be included in the XR platform and the didactic use cases based on the end users requirements to build a value proposition that considers their needs

Data Management Plan

Report describing the Data Management Plan that will be followed during the project

Open Call 1 launch documentation package

Description of the documentation package prepared for the 1st OC.

Publications

Articles approuvés par les pairs (2)

A review of machine learning in scanpath analysis for passive gaze-based interaction

Auteurs: Abdulrahman Mohamed Selim. Michael Barz, Omair Shahzad Bhatti1, Hasan Md Tusfiqur Alam, Daniel Sonntag1
Publié dans: Front. Artif. Intell., 2024, ISSN 2624-8212
Éditeur: Frontiers
DOI: 10.3389/frai.2024.1391745

Cross-Viewpoint Semantic Mapping: Integrating Human and Robot Perspectives for Improved 3D Semantic Reconstruction

Auteurs: Kopácsi, László; Baffy, Benjamin; Baranyi, Gábor; Skaf, Joul; Sörös, Gábor; Szeier, Szilvia; Lőrincz, András; Sonntag, Daniel
Publié dans: Sensors, Vol 23, Iss 11, p 5126 (2023), 2023, ISSN 1424-8220
Éditeur: Multidisciplinary Digital Publishing Institute (MDPI)
DOI: 10.3390/s23115126

Actes de conférence (2)

IMETA: An Interactive Mobile Eye Tracking Annotation Method for Semi-automatic Fixation-to-AOI mapping

Auteurs: Kopácsi, László; Barz, Michael; Bhatti, Omair Shahzad; Sonntag, Daniel
Publié dans: IUI'23 Companion, 2023, ISBN 9798400701078
Éditeur: Association for Computing Machinery
DOI: 10.1145/3581754.3584125

Interactive Fixation-to-AOI Mapping for Mobile Eye Tracking Data based on Few-Shot Image Classification

Auteurs: Barz, Michael; Bhatti, Omair Shahzad; Alam, Hasan Md Tusfiqur; Nguyen, Duy Minh Ho; Sonntag, Daniel
Publié dans: IUI'23 Companion, 2023, ISBN 9798400701078
Éditeur: Association for Computing Machinery
DOI: 10.1145/3581754.3584179