Intersubjective AI-driven multimodal interaction for advanced user-centric human robot collaborative applications

Información del proyecto

JARVIS

Identificador del acuerdo de subvención: 101135708

DOI

10.3030/101135708

Fecha de la firma de la CE 20 Octubre 2023

Fecha de inicio 1 Enero 2024

Fecha de finalización 31 Diciembre 2027

Financiado con arreglo a

• Digital, Industry and Space

Coste total

€ 10 338 223,75

Aportación de la UE

€ 9 319 266,26

Coordinado por

PANEPISTIMIO PATRON
Greece

CORDIS proporciona enlaces a los documentos públicos y las publicaciones de los proyectos de los programas marco HORIZONTE.

Los enlaces a los documentos y las publicaciones de los proyectos del Séptimo Programa Marco, así como los enlaces a algunos tipos de resultados específicos, como conjuntos de datos y «software», se obtienen dinámicamente de OpenAIRE .

Resultado final

Demonstrators, pilots, prototypes (3)

JARVIS network deployment – initial version

Report of the network deployment on pre-industrial scale testbeds, undertaken in T5.2.

Cognitive mechatronics for perception, control and decision-making – initial version

Report on design and initial implementation of JARVIS cognitive and intelligent mechatronics of T6.1 to T6.6.

JARVIS AI driven interaction modules – initial version

Deliverable describing the design and initial developments of AI driven modules used for HRI to achieve communication, control and programming developed in T3.1 to T3.6.

Websites, patent fillings, videos etc. (2)

JARVIS internal web portal

Description of design and development of the inline web portal dedicated to internal communication and data sharing between partners

JARVIS public web portal

Document describing the design and implementation of the JARVIS’ public web portal which will support the communication and dissemination activities of the project.

Publicaciones

Conference proceedings (9)

A Review of Personalisation in Human-Robot Collaboration and Future Perspectives Towards Industry 5.0

Autores: James Fant-Male, Roel Pieters
Publicado en: 2025 34th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2025, 2025, ISSN 1944-9437
Editor: IEEE
DOI: 10.1109/RO-MAN63969.2025.11217866

Bidirectional Verbal Communication in Human-Robot Collaboration

Autores: Rami Ojanen, Roel Pieters
Publicado en: IFAC-PapersOnLine, Edición 59(10), 2025, ISSN 2405-8963
Editor: IFAC
DOI: 10.1016/J.IFACOL.2025.09.382

Exploring Operator Requirements for Human-Robot Collaboration in A Composite Lay-Up Process

Autores: Jingyi Zhang, Maryam Bathaeijavareshk, Sarah Fletcher
Publicado en: AHFE International, Human Aspects of Advanced Manufacturing, Production Management and Process Control, Edición 184, 2025
Editor: AHFE International
DOI: 10.54941/AHFE1006449

Evaluating Pointing Gestures for Target Selection in Human-Robot Collaboration

Autores: Noora Sassali, Roel Pieters
Publicado en: 2025 34th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2025, 2025, ISSN 1944-9437
Editor: IEEE
DOI: 10.1109/RO-MAN63969.2025.11217885

Intersubjective AI-driven multimodal interaction for advanced user-centric HRC applications - the JARVIS approach

Autores: Christos Gkrizis, Nikos Dimitropoulos, Konstantinos Katsampiris-Salgado, Panagiotis Karagiannis, George Michalos, Sotiris Makris
Publicado en: Procedia CIRP, Edición 130, 2024, ISSN 2212-8271
Editor: Elsevier BV
DOI: 10.1016/j.procir.2024.10.095

LMPVC and Policy Bank: Adaptive voice control for industrial robots with code generating LLMs and reusable Pythonic policies

Autores: Ossi Parikka, Roel Pieters
Publicado en: 2025 34th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2025, 2025, ISSN 1944-9437
Editor: IEEE
DOI: 10.1109/RO-MAN63969.2025.11217706

BOP-Distrib: Revisiting 6D Pose Estimation Benchmarks for Better Evaluation under Visual Ambiguities

Autores: Boris Meden, Asma Brazi, Fabrice Mayran de Chamisso, Steve Bourgeois, Vincent Lepetit
Publicado en: 2026 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2026
Editor: IEEE
DOI: 10.1109/WACV61042.2026.00159

MoCap-based teleoperation and stylus teaching by demonstration for skill-based collaborative robotics

Autores: Shruti Chakraborty, Adib Rebbouh, Camille Vindolet, Baptiste Gradoussoff
Publicado en: IET Conference Proceedings, Edición 2025(28), 2025, ISSN 2732-4494
Editor: Institution of Engineering and Technology (IET)
DOI: 10.1049/ICP.2025.3686

Leveraging CVAE for Joint Configuration Estimation of Multifingered Grippers from Point Cloud Data

Autores: Julien Mérand, Boris Meden, Mathieu Grossard
Publicado en: 2025 IEEE 21st International Conference on Automation Science and Engineering (CASE 2025), 2025, ISSN 2161-8089
Editor: IEEE
DOI: 10.1109/CASE58245.2025.11164060

Peer reviewed articles (1)

Corr2Distrib: Making Ambiguous Correspondences an Ally to Predict Reliable 6D Pose Distributions

Autores: Asma Brazi, Boris Meden, Fabrice Mayran de Chamisso, Steve Bourgeois, Vincent Lepetit
Publicado en: IEEE Robotics and Automation Letters, Edición 10(6), 2025, ISSN 2377-3766
Editor: IEEE
DOI: 10.1109/LRA.2025.3568312

Book chapters (1)

Advancing Industrial Collaboration: The Next Generation of Human-Robot Interaction

Autores: Anibal Reñones, Mireya de Diego, Francisco Melendez, Zoi Arkouli, Nikos Dimitropoulos, Christos Gkrizis, Sotiris Makris, Fernando Castaño, Wael M. Mohammed, Rodolfo E. Haber, Leire Bastida
Publicado en: Artificial Intelligence, Data and Robotics: Foundations, Transformations and Future Directions, 2026
Editor: Springer Nature Switzerland AG
DOI: 10.1007/978-3-032-10561-5_21