Intersubjective AI-driven multimodal interaction for advanced user-centric human robot collaborative applications

Project Information

JARVIS

Grant agreement ID: 101135708

DOI

10.3030/101135708

EC signature date 20 October 2023

Start date 1 January 2024

End date 31 December 2027

Funded under

• Digital, Industry and Space

Total cost

€ 10 338 223,75

EU contribution

€ 9 319 266,26

Coordinated by

PANEPISTIMIO PATRON
Greece

CORDIS provides links to public deliverables and publications of HORIZON projects.

Links to deliverables and publications from FP7 projects, as well as links to some specific result types such as dataset and software, are dynamically retrieved from OpenAIRE .

Deliverables

Websites, patent fillings, videos etc. (2)

JARVIS internal web portal

Description of design and development of the inline web portal dedicated to internal communication and data sharing between partners

JARVIS public web portal

Document describing the design and implementation of the JARVIS’ public web portal which will support the communication and dissemination activities of the project.

Publications

Conference proceedings (9)

A Review of Personalisation in Human-Robot Collaboration and Future Perspectives Towards Industry 5.0

Author(s): James Fant-Male, Roel Pieters
Published in: 2025 34th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2025, 2025, ISSN 1944-9437
Publisher: IEEE
DOI: 10.1109/RO-MAN63969.2025.11217866

Bidirectional Verbal Communication in Human-Robot Collaboration

Author(s): Rami Ojanen, Roel Pieters
Published in: IFAC-PapersOnLine, Issue 59(10), 2025, ISSN 2405-8963
Publisher: IFAC
DOI: 10.1016/J.IFACOL.2025.09.382

Exploring Operator Requirements for Human-Robot Collaboration in A Composite Lay-Up Process

Author(s): Jingyi Zhang, Maryam Bathaeijavareshk, Sarah Fletcher
Published in: AHFE International, Human Aspects of Advanced Manufacturing, Production Management and Process Control, Issue 184, 2025
Publisher: AHFE International
DOI: 10.54941/AHFE1006449

Evaluating Pointing Gestures for Target Selection in Human-Robot Collaboration

Author(s): Noora Sassali, Roel Pieters
Published in: 2025 34th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2025, 2025, ISSN 1944-9437
Publisher: IEEE
DOI: 10.1109/RO-MAN63969.2025.11217885

Intersubjective AI-driven multimodal interaction for advanced user-centric HRC applications - the JARVIS approach

Author(s): Christos Gkrizis, Nikos Dimitropoulos, Konstantinos Katsampiris-Salgado, Panagiotis Karagiannis, George Michalos, Sotiris Makris
Published in: Procedia CIRP, Issue 130, 2024, ISSN 2212-8271
Publisher: Elsevier BV
DOI: 10.1016/j.procir.2024.10.095

LMPVC and Policy Bank: Adaptive voice control for industrial robots with code generating LLMs and reusable Pythonic policies

Author(s): Ossi Parikka, Roel Pieters
Published in: 2025 34th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2025, 2025, ISSN 1944-9437
Publisher: IEEE
DOI: 10.1109/RO-MAN63969.2025.11217706

BOP-Distrib: Revisiting 6D Pose Estimation Benchmarks for Better Evaluation under Visual Ambiguities

Author(s): Boris Meden, Asma Brazi, Fabrice Mayran de Chamisso, Steve Bourgeois, Vincent Lepetit
Published in: 2026 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2026
Publisher: IEEE
DOI: 10.1109/WACV61042.2026.00159

MoCap-based teleoperation and stylus teaching by demonstration for skill-based collaborative robotics

Author(s): Shruti Chakraborty, Adib Rebbouh, Camille Vindolet, Baptiste Gradoussoff
Published in: IET Conference Proceedings, Issue 2025(28), 2025, ISSN 2732-4494
Publisher: Institution of Engineering and Technology (IET)
DOI: 10.1049/ICP.2025.3686

Leveraging CVAE for Joint Configuration Estimation of Multifingered Grippers from Point Cloud Data

Author(s): Julien Mérand, Boris Meden, Mathieu Grossard
Published in: 2025 IEEE 21st International Conference on Automation Science and Engineering (CASE 2025), 2025, ISSN 2161-8089
Publisher: IEEE
DOI: 10.1109/CASE58245.2025.11164060

Peer reviewed articles (1)

Corr2Distrib: Making Ambiguous Correspondences an Ally to Predict Reliable 6D Pose Distributions

Author(s): Asma Brazi, Boris Meden, Fabrice Mayran de Chamisso, Steve Bourgeois, Vincent Lepetit
Published in: IEEE Robotics and Automation Letters, Issue 10(6), 2025, ISSN 2377-3766
Publisher: IEEE
DOI: 10.1109/LRA.2025.3568312

Book chapters (1)

Advancing Industrial Collaboration: The Next Generation of Human-Robot Interaction

Author(s): Anibal Reñones, Mireya de Diego, Francisco Melendez, Zoi Arkouli, Nikos Dimitropoulos, Christos Gkrizis, Sotiris Makris, Fernando Castaño, Wael M. Mohammed, Rodolfo E. Haber, Leire Bastida
Published in: Artificial Intelligence, Data and Robotics: Foundations, Transformations and Future Directions, 2026
Publisher: Springer Nature Switzerland AG
DOI: 10.1007/978-3-032-10561-5_21