Intersubjective AI-driven multimodal interaction for advanced user-centric human robot collaborative applications

Informacje na temat projektu

JARVIS

Identyfikator umowy o grant: 101135708

DOI

10.3030/101135708

Data podpisania przez KE 20 Października 2023

Data rozpoczęcia 1 Stycznia 2024

Data zakończenia 31 Grudnia 2027

Finansowanie w ramach

• Digital, Industry and Space

Koszt całkowity

€ 10 338 223,75

Wkład UE

€ 9 319 266,26

Koordynowany przez

PANEPISTIMIO PATRON
Greece

CORDIS oferuje możliwość skorzystania z odnośników do publicznie dostępnych publikacji i rezultatów projektów realizowanych w ramach programów ramowych HORYZONT.

Odnośniki do rezultatów i publikacji związanych z poszczególnymi projektami 7PR, a także odnośniki do niektórych konkretnych kategorii wyników, takich jak zbiory danych i oprogramowanie, są dynamicznie pobierane z systemu OpenAIRE .

Rezultaty

Demonstrators, pilots, prototypes (3)

JARVIS network deployment – initial version

Report of the network deployment on pre-industrial scale testbeds, undertaken in T5.2.

Cognitive mechatronics for perception, control and decision-making – initial version

Report on design and initial implementation of JARVIS cognitive and intelligent mechatronics of T6.1 to T6.6.

JARVIS AI driven interaction modules – initial version

Deliverable describing the design and initial developments of AI driven modules used for HRI to achieve communication, control and programming developed in T3.1 to T3.6.

Websites, patent fillings, videos etc. (2)

JARVIS internal web portal

Description of design and development of the inline web portal dedicated to internal communication and data sharing between partners

JARVIS public web portal

Document describing the design and implementation of the JARVIS’ public web portal which will support the communication and dissemination activities of the project.

Publikacje

Conference proceedings (9)

A Review of Personalisation in Human-Robot Collaboration and Future Perspectives Towards Industry 5.0

Autorzy: James Fant-Male, Roel Pieters
Opublikowane w: 2025 34th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2025, 2025, ISSN 1944-9437
Wydawca: IEEE
DOI: 10.1109/RO-MAN63969.2025.11217866

Bidirectional Verbal Communication in Human-Robot Collaboration

Autorzy: Rami Ojanen, Roel Pieters
Opublikowane w: IFAC-PapersOnLine, Numer 59(10), 2025, ISSN 2405-8963
Wydawca: IFAC
DOI: 10.1016/J.IFACOL.2025.09.382

Exploring Operator Requirements for Human-Robot Collaboration in A Composite Lay-Up Process

Autorzy: Jingyi Zhang, Maryam Bathaeijavareshk, Sarah Fletcher
Opublikowane w: AHFE International, Human Aspects of Advanced Manufacturing, Production Management and Process Control, Numer 184, 2025
Wydawca: AHFE International
DOI: 10.54941/AHFE1006449

Evaluating Pointing Gestures for Target Selection in Human-Robot Collaboration

Autorzy: Noora Sassali, Roel Pieters
Opublikowane w: 2025 34th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2025, 2025, ISSN 1944-9437
Wydawca: IEEE
DOI: 10.1109/RO-MAN63969.2025.11217885

Intersubjective AI-driven multimodal interaction for advanced user-centric HRC applications - the JARVIS approach

Autorzy: Christos Gkrizis, Nikos Dimitropoulos, Konstantinos Katsampiris-Salgado, Panagiotis Karagiannis, George Michalos, Sotiris Makris
Opublikowane w: Procedia CIRP, Numer 130, 2024, ISSN 2212-8271
Wydawca: Elsevier BV
DOI: 10.1016/j.procir.2024.10.095

LMPVC and Policy Bank: Adaptive voice control for industrial robots with code generating LLMs and reusable Pythonic policies

Autorzy: Ossi Parikka, Roel Pieters
Opublikowane w: 2025 34th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2025, 2025, ISSN 1944-9437
Wydawca: IEEE
DOI: 10.1109/RO-MAN63969.2025.11217706

BOP-Distrib: Revisiting 6D Pose Estimation Benchmarks for Better Evaluation under Visual Ambiguities

Autorzy: Boris Meden, Asma Brazi, Fabrice Mayran de Chamisso, Steve Bourgeois, Vincent Lepetit
Opublikowane w: 2026 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2026
Wydawca: IEEE
DOI: 10.1109/WACV61042.2026.00159

MoCap-based teleoperation and stylus teaching by demonstration for skill-based collaborative robotics

Autorzy: Shruti Chakraborty, Adib Rebbouh, Camille Vindolet, Baptiste Gradoussoff
Opublikowane w: IET Conference Proceedings, Numer 2025(28), 2025, ISSN 2732-4494
Wydawca: Institution of Engineering and Technology (IET)
DOI: 10.1049/ICP.2025.3686

Leveraging CVAE for Joint Configuration Estimation of Multifingered Grippers from Point Cloud Data

Autorzy: Julien Mérand, Boris Meden, Mathieu Grossard
Opublikowane w: 2025 IEEE 21st International Conference on Automation Science and Engineering (CASE 2025), 2025, ISSN 2161-8089
Wydawca: IEEE
DOI: 10.1109/CASE58245.2025.11164060

Peer reviewed articles (1)

Corr2Distrib: Making Ambiguous Correspondences an Ally to Predict Reliable 6D Pose Distributions

Autorzy: Asma Brazi, Boris Meden, Fabrice Mayran de Chamisso, Steve Bourgeois, Vincent Lepetit
Opublikowane w: IEEE Robotics and Automation Letters, Numer 10(6), 2025, ISSN 2377-3766
Wydawca: IEEE
DOI: 10.1109/LRA.2025.3568312

Book chapters (1)

Advancing Industrial Collaboration: The Next Generation of Human-Robot Interaction

Autorzy: Anibal Reñones, Mireya de Diego, Francisco Melendez, Zoi Arkouli, Nikos Dimitropoulos, Christos Gkrizis, Sotiris Makris, Fernando Castaño, Wael M. Mohammed, Rodolfo E. Haber, Leire Bastida
Opublikowane w: Artificial Intelligence, Data and Robotics: Foundations, Transformations and Future Directions, 2026
Wydawca: Springer Nature Switzerland AG
DOI: 10.1007/978-3-032-10561-5_21