Project description DEENESFRITPL Innovation for immersive interaction with positive social results User content often stimulates antisocial interaction and abuse, representing a threat to vulnerable adults, teenagers and children. The EU-funded GuestXR project intends to develop a socially interactive multisensory platform system that uses extended reality – virtual and augmented – as a vehicle to connect people for immersive, synchronous face to face interaction with positive social results. The project will introduce a critical innovation consisting of the intervention of artificial agents that learn over time to assist the virtual social gathering in realising its purposes. This agent, ‘The Guest’, will exploit machine learning to enable the meeting towards specific results. The project will rely on neuroscience and social psychology research on group behaviour to deliver rules to agent based models. Show the project objective Hide the project objective Objective Immersive online social spaces will soon become ubiquitous. However, there is also a warning that we need to heed from social media. User content is the ‘lifeblood of social media’. However, it often stimulates antisocial interaction and abuse, ultimately posing a danger to vulnerable adults, teenagers, and children.In the VR space this is backed up by the experience of current virtual shared spaces. While they have many positive aspects, they have also become a space full of abuse.Our vision is to develop GuestXR, a socially interactive multisensory platform system that uses eXtended Reality (virtual and augmented reality) as the medium to bring people together for immersive, synchronous face-to-face interaction with positive social outcomes.The critical innovation is the intervention of artificial agents that learn over time to help the virtual social gathering realise its aims. This is an agent that we refer to as “The Guest” that exploits Machine Learning to learn how to facilitate the meeting towards specific outcomes.Underpinning this is neuroscience and social psychology research on group behaviour, which will deliver rules to Agent Based Models (ABM).The combination of AI with immersive systems (including haptics and immersive audio), virtual and augmented reality will be a hugely challenging research task, given the vagaries of social meetings and individual behaviour. Several proof of concept applications will be developed during the project, including a conflict resolution application in collaboration with the UN. A strong User Group made up of a diverse range of stakeholders from industry, academia, government and broader society will provide continuous feedback. An Open Call will be held to bring in artistic support and additional use cases from wider society. Significant work is dedicated to ethics “by design”, to identify problems and look eventually towards an appropriate regulatory framework for such socially interactive systems. Fields of science social sciencespsychologysocial psychologynatural sciencescomputer and information sciencessoftwaresoftware applicationsvirtual realitynatural sciencescomputer and information sciencesartificial intelligencemachine learning Keywords eXtended Reality Augmented Reality Virtual Reality Social Psychology Neuroscience Haptics Immersive audio Social interaction Affective Computing Agent Based Models Reinforcement Learning Programme(s) H2020-EU.1.2. - EXCELLENT SCIENCE - Future and Emerging Technologies (FET) Main Programme H2020-EU.1.2.2. - FET Proactive Topic(s) FETPROACT-EIC-07-2020 - FET Proactive: emerging paradigms and communities Call for proposal H2020-FETPROACT-2018-2020 See other projects for this call Sub call H2020-FETPROACT-2020-2 Funding Scheme RIA - Research and Innovation action Coordinator FUNDACIO EURECAT Net EU contribution € 700 375,00 Address AVENIDA UNIVERSITAT AUTONOMA 23 08290 Cerdanyola Del Valles (Barcelona) Spain See on map Region Este Cataluña Barcelona Activity type Research Organisations Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 700 375,00 Participants (8) Sort alphabetically Sort by Net EU contribution Expand all Collapse all VIRTUAL BODYWORKS SL Spain Net EU contribution € 529 436,88 Address CARRER DE LLANCA NUM. 51 P.12 PTA.2 08015 Barcelona See on map SME The organization defined itself as SME (small and medium-sized enterprise) at the time the Grant Agreement was signed. Yes Region Este Cataluña Barcelona Activity type Private for-profit entities (excluding Higher or Secondary Education Establishments) Links Contact the organisation Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 529 436,88 REICHMAN UNIVERSITY Israel Net EU contribution € 861 125,00 Address 8 HAUNIVERSITA ST 4610101 Herzliya See on map Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 861 125,00 UNIVERSITEIT MAASTRICHT Netherlands Net EU contribution € 785 418,50 Address MINDERBROEDERSBERG 4 6200 MD Maastricht See on map Region Zuid-Nederland Limburg (NL) Zuid-Limburg Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 785 418,50 INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET AUTOMATIQUE France Net EU contribution € 451 121,87 Address DOMAINE DE VOLUCEAU ROCQUENCOURT 78153 Le Chesnay Cedex See on map Region Ile-de-France Ile-de-France Yvelines Activity type Research Organisations Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 490 351,88 Third-party Legal entity other than a subcontractor which is affiliated or legally linked to a participant. The entity carries out work under the conditions laid down in the Grant Agreement, supplies goods or provides services for the action, but did not sign the Grant Agreement. A third party abides by the rules applicable to its related participant under the Grant Agreement with regard to eligibility of costs and control of expenditure. CENTRE NATIONAL DE LA RECHERCHE SCIENTIFIQUE CNRS France Net EU contribution € 39 230,00 Address RUE MICHEL ANGE 3 75794 Paris See on map Region Ile-de-France Ile-de-France Paris Activity type Research Organisations Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 39 230,00 UNIWERSYTET WARSZAWSKI Poland Net EU contribution € 367 500,00 Address KRAKOWSKIE PRZEDMIESCIE 26/28 00-927 WARSZAWA See on map Region Makroregion województwo mazowieckie Warszawski stołeczny Miasto Warszawa Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 367 500,00 G.TEC MEDICAL ENGINEERING GMBH Austria Net EU contribution € 359 375,00 Address SIERNINGSTRASSE 14 4521 Schiedlberg See on map SME The organization defined itself as SME (small and medium-sized enterprise) at the time the Grant Agreement was signed. Yes Region Westösterreich Oberösterreich Steyr-Kirchdorf Activity type Private for-profit entities (excluding Higher or Secondary Education Establishments) Links Contact the organisation Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 359 375,00 UNIVERSITAT DE BARCELONA Spain Net EU contribution € 405 937,50 Address GRAN VIA DE LES CORTS CATALANES 585 08007 Barcelona See on map Region Este Cataluña Barcelona Activity type Higher or Secondary Education Establishments Links Contact the organisation Opens in new window Website Opens in new window Participation in EU R&I programmes Opens in new window HORIZON collaboration network Opens in new window Total cost € 405 937,50