CORDIS

EU research results

CORDIS

Emotive Virtual cultural Experiences through personalized storytelling

Fact Sheet

Reporting

Results

Project information

EMOTIVE

Grant agreement ID: 727188

Project website

Status

Closed project

Start date

1 November 2016
End date

31 October 2019

Funded under:

H2020-EU.3.6.3.1.

Overall budget:

€ 2 646 447,50
EU contribution

€ 2 643 447,50

Coordinated by:

EXUS SOFTWARE LTD

United Kingdom

Objective

Storytelling applies to nearly everything we do. Everybody uses stories, from educators to marketers and from politicians to journalists to inform, persuade, entertain, motivate or inspire. In the cultural heritage sector, however, narrative tends to be used narrowly, as a method to communicate to the public the findings and research conducted by the domain experts of a cultural site or collection.
The principal objective of the EMOTIVE project is to research, design, develop and evaluate methods and tools that can support the cultural and creative industries in creating Virtual Museums which draw on the power of 'emotive storytelling'. This means storytelling that can engage visitors, trigger their emotions, connect them to other people around the world, and enhance their understanding, imagination and, ultimately, their experience of cultural sites and content. EMOTIVE will do this by providing the means to authors of cultural products to create high-quality, interactive, personalized digital stories.
The EMOTIVE project targets two main groups of users:
1. Authors: members of the cultural and creative industries in charge of creating interactive cultural experiences (i.e., interactive stories) and making them available to the visitors.
2. Visitors: people experiencing the cultural site through a “World” created with the EMOTIVE Authoring System. They join in the available experiences when entering the site or when remotely connecting to the site’s Virtual Museum.
The project results will be evaluated and validated in major cultural sites in Europe through an extensive network of cultural organizations and creative industries that have expressed their interest to the project.

Field of Science

journalism

emotion

teaching

Programme(s)

H2020-EU.3.6.3.1. - Study European heritage, memory, identity, integration and cultural interaction and translation, including its representations in cultural and scientific collections, archives and museums, to better inform and understand the present by richer interpretations of the past

Topic(s)

CULT-COOP-08-2016 - Virtual museums and social platform on European digital heritage, memory, identity and cultural interaction.

Call for proposal

H2020-SC6-CULT-COOP-2016

See other projects for this call

Funding Scheme

RIA - Research and Innovation action

Leaflet | Map data © OpenStreetMap contributors, Credit: EC-GISCO, © EuroGeographics for the administrative boundaries

Coordinator

EXUS SOFTWARE LTD

Address

Old Broad Street 25 Tower 42
Ec2n 1pb London

United Kingdom

Activity type

Private for-profit entities (excluding Higher or Secondary Education Establishments)

EU Contribution

€ 489 625

Website

Contact the organisation

Participants (7)

Sort alphabetically

Sort by EU Contribution

Expand all

ATHINA-EREVNITIKO KENTRO KAINOTOMIAS STIS TECHNOLOGIES TIS PLIROFORIAS, TON EPIKOINONION KAI TIS GNOSIS

Greece

EU Contribution

€ 483 062,50

UNIVERSITY OF YORK

United Kingdom

EU Contribution

€ 210 262,50

INSTITUT NATIONAL DE RECHERCHE ENINFORMATIQUE ET AUTOMATIQUE

France

EU Contribution

€ 390 700

CONSIGLIO NAZIONALE DELLE RICERCHE

Italy

EU Contribution

€ 208 437,50

DIGINEXT

France

EU Contribution

€ 461 500

NOHO LIMITED

Ireland

EU Contribution

€ 157 968,75

UNIVERSITY OF GLASGOW

United Kingdom

EU Contribution

€ 241 891,25

Project information

EMOTIVE

Grant agreement ID: 727188

Project website

Status

Closed project

Start date

1 November 2016
End date

31 October 2019

Funded under:

H2020-EU.3.6.3.1.

Overall budget:

€ 2 646 447,50
EU contribution

€ 2 643 447,50

Coordinated by:

EXUS SOFTWARE LTD

United Kingdom

Project information

EMOTIVE

Grant agreement ID: 727188

Project website

Status

Closed project

Start date

1 November 2016
End date

31 October 2019

Funded under:

H2020-EU.3.6.3.1.

Overall budget:

€ 2 646 447,50
EU contribution

€ 2 643 447,50

Coordinated by:

EXUS SOFTWARE LTD

United Kingdom

Periodic Reporting for period 1 - EMOTIVE (Emotive Virtual cultural Experiences through personalized storytelling)

Reporting period: 2016-11-01 to 2017-10-31

Summary of the context and overall objectives of the project

The principal objective of EMOTIVE is to research, design, develop and evaluate methods and tools that can support the cultural and creative industries in offering their diverse audiences effective emotive storytelling. This means storytelling that can engage visitors, trigger their emotions, connect them to other people around the world, and enhance their understanding, imagination and ultimately, their experience of cultural sites and content. EMOTIVE aims to do this by providing authors of cultural products with the means to create high-quality, interactive, personalised digital stories. More specifically, it provides:
- Emotional, interactive forms of storytelling to resonate with the “everyday visitor”
- A continuous exhibition space online, on-site, or simultaneously online and on-site
- Group personalization of the visitor experience responsive to the needs and interests of multiple users at once
- Different digital platforms to support users’, including groups’, technological circumstances;
- Innovative Computer Graphics research providing new solutions to multi-view inpainting and Image-Based Rendering and allowing simple-to-create, highly realistic Virtual Experiences
- Physical artefacts designed to extend the visitor experience
- Collection and analysis of data on visitor choices and behavior to facilitate both personalization of experience and generalization.
To achieve its objectives, EMOTIVE adopts a holistic approach integrating interdisciplinary research involving a complementary group of world-class experts from multiple scientific and technological domains working at two main UNESCO sites, the Neolithic site of Çatalhöyük in Turkey and the Roman Antonine Wall in the UK through the Hunterian Museum’s collection.

Work performed from the beginning of the project to the end of the period covered by the report and main results achieved so far

The objectives of the EMOTIVE activities for Year 1 (M1-M12) were the following:
- The collection of user requirements (WP3)
- The design and production of EMOTIVE experiences (WP3)
- The establishment of EMOTIVE’s conceptual framework (WP5) for the design of emotional storytelling at cultural heritage sites
- The transformation of end-user requirements into system specifications, and their prioritization for the three EMOTIVE releases (WP8)
- The design of the first version of the EMOTIVE Architecture framework and integration plan (WP8)
- The initiation of the technical development efforts, leading to the release of the EMOTIVE Alpha version (WP8), including the EMOTIVE Authoring Tool (WP4), that supports multi-level authoring for different roles of authors, the EMOTIVE Backend (WP5), which is a supportive system that brings all EMOTIVE platform components together, Novel Methods for Virtual Display and Physical Reproduction of Sites and Artefacts (WP6), including Image-Based Rendering (IBR) and Low-Cost Physical Artefact Reproduction techniques, the EMOTIVE Front-end System (WP7) that supports multi-device presentation of cultural heritage experiences.
- The development of the evaluation framework for the effective evaluation of tools and experiences (WP9), and the implementation of initial formative evaluation trials
- The implementation of dissemination activities (WP2) including project’s identity and style, website, social media, newsletter, promotional material, publications and event attendance
- The implementation of initial exploitation activities (WP2) towards the commercialisation of the project’s results
- The establishment of the ethical, societal and privacy principles and procedures (WP1 and WP10)
- The definition and implementation of quality procedures and project management tools (WP1)

Progress beyond the state of the art and expected potential impact (including the socio-economic impact and the wider societal implications of the project so far)

EMOTIVE’s advances beyond the state of the art are towards the following directions:
- EMOTIVE provides a story-based rather than an object-based approach that resonates with people keeping however the cultural site’s offer at the center.
- Interactive storytelling in EMOTIVE is coupled with personalisation, adaptation and social interaction.
- EMOTIVE builds a continuous exhibition space, blending the online with the on-site experience, seamlessly integrating the pre-, during, and post-visit activities, the virtual and real world and the intangible with the tangible.
- Visitors navigate in a hybrid 2D/3D space which comprises high quality reconstructions of the physical space and objects.
- Innovative Computer Graphics research in EMOTIVE has advanced the state of the art in multi-view inpainting, allowing removal of objects in captured scenes with unprecedented levels of quality, and in the field of IBR, allowing free-viewpoint navigation in large wide-baseline scenes for the first time.
- EMOTIVE enables affordable massive physical reproduction of artefacts and their widespread use as part of augmented reality experiences.
- EMOTIVE can effectively support collaborative visits with virtual and on-site visitors sharing a cultural experience and bringing into the group experience a different, complementary perspective.
- Authoring in EMOTIVE combines for the first time adaptation techniques with collaborative, multimodal and multi/trans-device dimensions populating the visitor’s environment to seamlessly interact with an ongoing, consistent, potentially ubiquitous, experience.
- EMOTIVE enables the author to “bend” time and space so that one single person can simulate a virtual museum scenario involving multiple participants using multiple devices, in different places, and interacting with each other’s and the museum environments along a non-linear story that can last hours.
- EMOTIVE supports authors with very different levels of computer science knowledge through the use of a complete authoring environment made of several components, each one specialising in its own domain.
- EMOTIVE provides the first coherent conceptual framework for the design of personalized experiences under a variety of settings.
The EMOTIVE platform is expected to be a cutting edge end-to-end solution for the authoring of cultural heritage interactive experiences and presenting them to visitors. The outcome will put tools in the hands of professionals to create engaging, memorable stories, and enable the public to enjoy and share these stories, from anywhere. It will engage audiences in new ways, putting emotional stories at the heart of museums and heritage sites.We believe that drama-based narratives containing careful reference to a site’s cultural content have the power to transform heritage and museum visitor experiences, encouraging repeat visits, facilitating direct and ongoing interaction and deepening knowledge transfer.
Therefore, EMOTIVE enhances people’s contact with and understanding of cultural heritage by making (remote) sites available to them on familiar terms. It empowers citizens to build their knowledge, competencies, sense of belonging and identities both via digital technologies and via recognizable storytelling genres that connect humans on a worldwide level.
The development of innovative research in engaging technologies such as mobile AR or VR combined with the emotive storytelling approach and the virtual museum concept, promise significant impact on the interest of visitors, especially young generations, for cultural heritage.
The digital experiences and assets resulting from EMOTIVE ultimately become re-usable by both specialists and non-specialists and analysable as data points providing insight into broad-scale human patterns of value-building and sense-making about the past.

EMOTIVE project, 2017 | EMOTIVE personas

EMOTIVE project, 2017 | Bodystorming an ‘emotive’ experience at the Hunterian Museum, Glasgow

EMOTIVE project, 2017 | The Antonine Wall display in Hunterian Museum, University of Glasgow

EMOTIVE project, 2017 | Çatalhöyük on site group experience

EMOTIVE project, 2017 | Çatalhöyük UNESCO World Heritage site – Turkey

EMOTIVE project, 2017 | EMOTIVE 3D printed artefacts

EMOTIVE project, 2017 | Hunterian Museum on site experience

EMOTIVE project, 2017 | Design process of an EMOTIVE experience

Project information

EMOTIVE

Grant agreement ID: 727188

Project website

Status

Closed project

Start date

1 November 2016
End date

31 October 2019

Funded under:

H2020-EU.3.6.3.1.

Overall budget:

€ 2 646 447,50
EU contribution

€ 2 643 447,50

Coordinated by:

EXUS SOFTWARE LTD

Project information

EMOTIVE

Grant agreement ID: 727188

Project website

Status

Closed project

Start date

1 November 2016
End date

31 October 2019

Funded under:

H2020-EU.3.6.3.1.

Overall budget:

€ 2 646 447,50
EU contribution

€ 2 643 447,50

Coordinated by:

EXUS SOFTWARE LTD

United Kingdom

Deliverables

Documents, reports (4)

Conceptual Framework & Guide - First Release

Guide to inform creative industries and other stakeholders on how to achieve engaging, collaborative, personalized experiences using storytelling in cultural contexts

Evaluation Framework & Guidelines

Living document with updates when needed for methods and instruments that may need to be adjusted

Low-cost Physical Artefact Reproduction

Report/Prototype

User Requirements & Scenarios - alpha

Report documenting all input received from users, as well as the experience scenarios

Demonstrators, pilots, prototypes (1)

Other (1)

Websites, patent fillings, videos etc. (2)

"Communication material cycle #1"

Multimedia and/or printed material for project dissemination (three cycles of development)

EMOTIVE Website and social media profiles

Initial website and social media profiles

Publications

Peer reviewed articles (11)

Flow, Staging, Wayfinding, Personalization: Evaluating User Experience with Mobile Museum Narratives

Author(s): Maria Roussou; Akrivi Katifori

Published in: Journal of Multimodal Technologies and Interaction, 2018, ISSN 2414-4088

DOI: 10.5281/zenodo.3544392

State of the Art on Stylized Fabrication

Author(s): Bernd Bickel, Paolo Cignoni, Luigi Malomo, Nico Pietroni

Published in: Computer Graphics Forum, Issue 37/6, 2018, Page(s) 325-342, ISSN 0167-7055

DOI: 10.1111/cgf.13327

The Enchantment of the Archaeological Record

Author(s): Sara Perry

Published in: European Journal of Archaeology, Issue 22/3, 2019, Page(s) 354-371, ISSN 1461-9571

DOI: 10.1017/eaa.2019.24

Volume-aware design of composite molds

Author(s): Thomas Alderighi, Luigi Malomo, Daniela Giorgi, Bernd Bickel, Paolo Cignoni, Nico Pietroni

Published in: ACM Transactions on Graphics, Issue 38/4, 2019, Page(s) 1-12, ISSN 0730-0301

DOI: 10.1145/3306346.3322981

Multi-view relighting using a geometry-aware network

Author(s): Julien Philip, Michaël Gharbi, Tinghui Zhou, Alexei A. Efros, George Drettakis

Published in: ACM Transactions on Graphics, Issue 38/4, 2019, Page(s) 1-14, ISSN 0730-0301

DOI: 10.1145/3306346.3323013

Deep blending for free-viewpoint image-based rendering

Author(s): Peter Hedman, Julien Philip, True Price, Jan-Michael Frahm, George Drettakis, Gabriel Brostow

Published in: ACM Transactions on Graphics, Issue 37/6, 2019, Page(s) 1-15, ISSN 0730-0301

DOI: 10.1145/3272127.3275084

Thin Structures in Image Based Rendering

Author(s): Theo Thonat, Abdelaziz Djelouah, Fredo Durand, George Drettakis

Published in: Computer Graphics Forum, Issue 37/4, 2018, Page(s) 107-118, ISSN 0167-7055

DOI: 10.1111/cgf.13479

Metamolds

Author(s): Thomas Alderighi, Luigi Malomo, Daniela Giorgi, Nico Pietroni, Bernd Bickel, Paolo Cignoni

Published in: ACM Transactions on Graphics, Issue 37/4, 2018, Page(s) 1-13, ISSN 0730-0301

DOI: 10.1145/3197517.3201381

Narralive – Creating and experiencing mobile digital storytelling in cultural heritage

Author(s): Ektor Vrettakis, Vassilis Kourtis, Akrivi Katifori, Manos Karvounis, Christos Lougiakis, Yannis Ioannidis

Published in: Digital Applications in Archaeology and Cultural Heritage, Issue 15, 2019, Page(s) e00114, ISSN 2212-0548

DOI: 10.1016/j.daach.2019.e00114

Single-image SVBRDF capture with a rendering-aware deep network

Author(s): Valentin Deschaintre, Miika Aittala, Fredo Durand, George Drettakis, Adrien Bousseau

Published in: ACM Transactions on Graphics, Issue 37/4, 2018, Page(s) 1-15, ISSN 0730-0301

DOI: 10.1145/3197517.3201378

Exploiting Repetitions for Image-Based Rendering of Facades

Author(s): Simon Rodriguez, Adrien Bousseau, Fredo Durand, George Drettakis

Published in: Computer Graphics Forum, Issue 37/4, 2018, Page(s) 119-131, ISSN 0167-7055

DOI: 10.1111/cgf.13480

Conference proceedings (3)

The EMOTIVE Project – Emotive Virtual Cultural Experiences through Personalized Storytelling,

Author(s): Maria Roussou, Sara Perry, Akrivi Katifori, George Drettakis, Julien Philip, Sebastian Vizcay

Published in: Workshop on Cultural Informatics Research and Applications, co-located with the International Conference on Digital Heritage, CIRA@EuroMed 2018, 2019

Mobile interactive storytelling at the Ancient Agora of Athens: exploring the right balance between the site and the digital application

Author(s): Akrivi Katifori; Maria Roussou; Irene Kaklopoulou; Katerina Servi

Published in: XVII Culture and Computer Science, 2019

DOI: 10.5281/zenodo.3545762

Moving Beyond the Virtual Museum: Engaging Visitors Emotionally

Author(s): Perry, S., Roussou, M., Economou, M., Pujol-Tost, L. and Young, H.

Published in: 23rd International Conference on Virtual Systems and Multimedia (VSMM 2017), 2017

Other (1)

Demonstrating the use of the alphabetic telegraph through a collaborative AR activity

Author(s): Iason Panagiotis Diakoumakos; Akrivi Katifori; Vassilis Kourtis; Manos Karvounis; Yannis Ioannidis

Published in: Proceedings of 23rd Int’l Conference on Virtual Systems and Multimedia, 2017

DOI: 10.5281/zenodo.3544402

Book chapters (1)

Developing Digital Archaeology for Young People: A Model for Fostering Empathy and Dialogue in Formal and Informal Learning Environments

Author(s): Sara Perry, Akrivi Katifori, Sierra McKinney, Vassilis Kourtis

Published in: Communicating the Past in the Digital Age. Proceedings of the International Conference on Digital Methods in Teaching and Learning in Archaeology (12th-13th October 2018), 2019

Project information

EMOTIVE

Grant agreement ID: 727188

Project website

Status

Closed project

Start date

1 November 2016
End date

31 October 2019

Funded under:

H2020-EU.3.6.3.1.

Overall budget:

€ 2 646 447,50
EU contribution

€ 2 643 447,50

Coordinated by:

EXUS SOFTWARE LTD

Project information

EMOTIVE

Grant agreement ID: 727188

Project website

Status

Closed project

Start date

1 November 2016
End date

31 October 2019

Funded under:

H2020-EU.3.6.3.1.

Overall budget:

€ 2 646 447,50
EU contribution

€ 2 643 447,50

Coordinated by:

EXUS SOFTWARE LTD

United Kingdom

Project information

EMOTIVE

Grant agreement ID: 727188

Project website

Status

Closed project

Start date

1 November 2016
End date

31 October 2019

Funded under:

H2020-EU.3.6.3.1.

Overall budget:

€ 2 646 447,50
EU contribution

€ 2 643 447,50

Coordinated by:

EXUS SOFTWARE LTD

Download

PDF

XML

Last update: 23 June 2017

Record number: 205688

CORDIS

Project information

Objective

Coordinator

Participants (7)

Project information

Project information

Periodic Reporting for period 1 - EMOTIVE (Emotive Virtual cultural Experiences through personalized storytelling)

Project information

Project information

Deliverables

Publications

Project information

Project information

Project information

Share this page

Download