Perceptive Enhanced Realities of Colored collEctions through AI and Virtual Experiences

Project Information

PERCEIVE

Grant agreement ID: 101061157

DOI

10.3030/101061157

Project closed

EC signature date 9 December 2022

Start date 1 February 2023

End date 31 January 2026

Funded under

• Culture, creativity and inclusive society

Total cost

€ 3 785 358,75

EU contribution

€ 3 785 358,75

Coordinated by

CONSIGLIO NAZIONALE DELLE RICERCHE
Italy

CORDIS provides links to public deliverables and publications of HORIZON projects.

Links to deliverables and publications from FP7 projects, as well as links to some specific result types such as dataset and software, are dynamically retrieved from OpenAIRE .

Deliverables

Demonstrators, pilots, prototypes (4)

PERCEIVE PLATFORM

PERCEIVE PLATFORM (Report and Demonstrator, Updated at M36). It includes: D5.2.1. Runtime Environment (FORTH) [M18] R, DEM. D5.2.2 API design (FORTH), [M36] R, OTH D5.2.3 Perceive Tools (NTNU) [M18,36] R, DEM D5.2.4 Perceive Services (FORTH) [M36] R, DEM

PERCEIVE Design ToolBox

PERCEIVE Design ToolBox (Demonstrator and Report)

Material appearance models

Material appearance models (updated at M36) Report and Demonstrator

Design and implementation of PERCEIVE Prototypes

Design and implementation of PERCEIVE Prototypes (ANAMNESIA) [M9, 18, 24, 36]. DEM, RWe will present at each review meeting the state of advancement with the design and implementation.It includes: 6.1.1 PERCEIVE Concept Design, UX and Design Brief (IGD) [M9,18]6.1.2 Prototype implementation (ANAMNESIA) [24.36]6.1.3 Prototypes Applied to Case Studies (CNR) [M36]

Documents, reports (6)

PERCEIVE PLATFORM Specification
PERCEIVE training program

PERCEIVE training program: report on the program and its results

PERCEIVE theory

PERCEIVE theory (updated M19)

Communication and Dissemination Strategy and Plan

Communication and Dissemination Strategy and Plan (updated at M12)

Operational plan, Progress Report and Evaluation Report

this report include the Operational Plan, the Progress Report, the Advisory Board report and the Final Evaluation (updated at M15,25,36):

Evaluation Strategy

Evaluation Strategy: Psychophysics and Psychometrics observation studies (updated at M36)

Publications

Conference proceedings (28)

Digital Restoration of Visual Art using Synthetic Training, Deep Segmentation and Inpainting

Author(s): Saptarshi Neil Sinha, Paul Julius Kühn, Johannes Koppe, Holger Graf, Michael Weinmann
Published in: 2024 International Conference on Cyberworlds (CW), 2025
Publisher: IEEE
DOI: 10.1109/CW64301.2024.00062

Interaction Design as Catalyzer of Creative and Interpretative Praxes in Museum Context

Author(s): M. Veggi
Published in: 2023, ISSN 2312-6124
Publisher: The Eurographics Association
DOI: 10.2312/gch.20231154

Sketching Interactive Experiences: Can Co-creation with Artificial Generative Systems Enhance the Communication of Cultural Heritage?

Author(s): Veggi, M., Catalano, C. E., & Pescarin, S.
Published in: ACM/EG Expressive Symposium-WICED
Publisher: EG Digital Library
DOI: 10.2312/EXW20251058

SpectralSplatsViewer: An Interactive Web-Based Tool for Visualizing Cross-Spectral Gaussian Splats

Author(s): Saptarshi Neil Sinha, Julius Kühn, Holger Graf, Michael Weinmann
Published in: Proceedings of the 29th International ACM Conference on 3D Web Technology, 2025
Publisher: ACM
DOI: 10.1145/3665318.3677151

Interactive and Immersive Discovery of Diagnostic Processes on Multi-Layered 3D Collections on the Web: The MuLaX Tool

Author(s): Fanini, B., Massidda, M., Ferdani, D., Bonifazi, F., Magrini, D., Iannaccone, R., and Barandoni, C.
Published in: 2025
Publisher: The Eurographics Association
DOI: 10.2312/DH.20253102

Prototyping Care: Two Case Studies

Author(s): A. Clay, G. Trumpy, M. Weinmann, R. Wetzel
Published in: 2023, ISSN 2312-6124
Publisher: The Eurographics Association
DOI: 10.2312/gch20231178

Evaluating Segmentation of Human Body Parts Across Datasets

Author(s): Paul Julius Kühn, Thomas Pöllabauer, Alexander Hartmann, Arjan Kuijper
Published in: Lecture Notes in Computer Science, Advances in Visual Computing, 2025
Publisher: Springer Nature Switzerland
DOI: 10.1007/978-3-031-77389-1_3

Participatory Experiences as a New Way to Access Conservation Data in Museum Contexts

Author(s): M. Veggi, S. Pescarin
Published in: Mimesis Journal - Proceeding of DRHA (Digital Research in the Humanities and Arts), 2024
Publisher: Università di Torino
DOI: 10.13135/2389-6086/9906

A First Experimental Protocol on Creative Engagement and Meaning Creation in Interactive Experiences for Cultural Heritage v1

Author(s): Manuele Veggi, sofia.pescarin not provided
Published in: 2025
Publisher: Springer Science and Business Media LLC
DOI: 10.17504/PROTOCOLS.IO.6QPVR367BVMK/V1

SemanticSplatStylization: Semantic scene stylization based on 3D Gaussian splatting and class-based style transfer.

Author(s): Sinha, S. N., Graf, H., & Weinmann, M.
Published in: 2024
Publisher: The Eurographic Association
DOI: 10.2312/GCH.20241256

Implementing Curiosity Hooks and Caring Practices in the Reconstruction of Lost Polychromy: Design Prototypes for Interactive Experiences.

Author(s): Bonifazi, F., Veggi, M., Massidda, M., Ferdani, D., and Pescarin, S.
Publisher: The Eurographics Association
DOI: 10.2312/DH.20253108

Authenticity in VR and XR Experiences: a Conceptual Framework for Digital Heritage

Author(s): Pescarin, Sofia and Città, Giuseppe and Gentile, Manuel and Spotti, Samuele
Published in: 2023, ISSN 2312-6124
Publisher: The Eurographics Association
DOI: 10.2312/gch.20231153

ImmersiveAutochrome: Enhanced Digitized Mono-Autochrome Viewing through Deep Learning and Virtual Reality

Author(s): Saptarshi Neil Sinha, Robin Horst, Irina-Mihaela Ciortan, Holger Graf, Arjan Kuijper, Michael Weinmann
Published in: 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2025
Publisher: IEEE
DOI: 10.1109/VRW66409.2025.00014

Hybrid XR collaborative and guided experiences in Cultural Heritage: Brancacci POV prototype

Author(s): S. Pescarin, I. Cerato, E. D’Annibale, B. Fanini, D. Ferdani, R. Manganelli Del Fà, A. Marasco, M. Massidda, A. Palombini, D. Ronchi
Published in: 2023, ISSN 2312-6124
Publisher: The Eurographics Association
DOI: 10.2312/gch.20231171

Text2Autochrome: Text guided autochrome synthesis using generative models.

Author(s): Kühn, P. J., Sinha, S. N., Nguyen, D. A., Horst, R., Kuijper, A., & Fellner, D. W.
Publisher: The Eurographics Association
DOI: 10.2312/DH.20253061

Portrait2Bust: DualStyleGAN-based Portrait Image Stylization Based on Bust Sculpture Images

Author(s): S.N. Sinha, M. Weinmann
Published in: 2023, ISSN 2312-6124
Publisher: The Eurographics Association
DOI: 10.2312/gch.20231159

Using Spatial Augmented Reality to Increase Perceived Translucency of Real 3D Objects

Author(s): G. Trumpy D. Gigilashvili
Published in: 2023, ISSN 2312-6124
Publisher: The Eurographics Association
DOI: 10.2312/gch.20231162

Prototyper: A web3D Platform for Collaborative Design and Simulation of Hybrid Museum Exhibitions

Author(s): Massidda, M., Fanini, B., and Pescarin, S.
Published in: 2025
Publisher: The Eurographics Association
DOI: 10.2312/DH.20253009

The Scream (ca. 1910) through the Years: from Photographic Documentation to Spatio-Temporal Modelling

Author(s): I. Ciortan, G. Trumpy, I. Sandu, H. Bjørngård
Published in: 2023, ISSN 2312-6124
Publisher: The Eurographics Association
DOI: 10.2312/gch.20231182

One-to-many Reconstruction of 3D Geometry of cultural Artifacts using a synthetically trained Generative Model

Author(s): T. Pöllabauer, J. Kühn, J. Li, A. Kuijper
Published in: 2023, ISSN 2312-6124
Publisher: The Eurographics Association
DOI: 10.2312/gch.20231161

Semantic Stylization and Shading via Segmentation Atlas utilizing Deep Learning Approaches.

Author(s): Sinha, S. N., Kühn, P. J., Rojtberg, P., Graf, H., Kuijper, A., & Weinmann, M.
Published in: Smart Tools and Applications in Graphics, 2024
Publisher: The Eurographics Association
DOI: 10.2312/STAG.20241352

Designing Authentic Digital Experiences

Author(s): Spotti, S., Bonifazi, F., Massidda, M., Pescarin, S., and Travaglini, L.
Publisher: The Eurographics Association
DOI: 10.2312/DH.20253148

An Atlas-based Approach for Appearance-aware Virtual 3D Restoration and Simulation of Fading in Fugitive Textiles.

Author(s): Sinha, S. N., Ciortan, I. M., Kneiphof, T., Kühn, P. J., Doherty, B., Burgio, L., Palmer, R., Pinto, C., Martel, L., Buti, D., Monico, L., Klein, R., Kuijper, A., & Weinmann, M.
Publisher: The Eurographics Association
DOI: 10.2312/DH.20253147

What Can a Historic Black and White Photograph Tell Us about the Original Colours of a Painting? A Case Study on Edvard Munch’s the Scream (1910?)

Author(s): Siozos, P., Sandu, I. C. A., Stavroulakis, P. I., and Sotiropoulou, S.
Published in: 2025
Publisher: The Eurographics Association
DOI: 10.2312/DH.20253314

Current Practices for Autochrome Digitization

Author(s): Yoko Arteaga, Irina-Mihaela Ciortan, Giorgio Trumpy, Catlin Langford
Published in: Archiving Conference, Issue 22, 2025, ISSN 2161-8798
Publisher: Society for Imaging Science & Technology
DOI: 10.2352/ISSN.2168-3204.2025.22.1.38

The CoDesign Tool. A Card-Based Framework for Interactive and Collaborative Design in Cultural Heritage

Author(s): Laura Travaglini, Marcello Massidda, Andreas Zapf, Samuele Spotti, Manuele Veggi, Sofia Pescarin
Published in: Lecture Notes in Computer Science, HCI International 2025 – Late Breaking Papers, 2026
Publisher: Springer Nature Switzerland
DOI: 10.1007/978-3-032-13164-5_18

Large room scale augmented reality in an unaltered world heritage site

Author(s): M. Olbrich, A. Zapf, C. Stiegemann, A. Pröbe
Published in: 2023, ISSN 2312-6124
Publisher: The Eurographics Association
DOI: 10.2312/gch.20231172

Perceptive Enhanced Realities of Coloured Collections through AI and Virtual Experiences.

Author(s): Pescarin, S., Aga, B., Kiyomoto, I. Y. A., Barandoni, C., Bonifazi, F., Boracchi, B. G., Burgio, L., Cerato, I., Ciortan, I., Clay, A., Fanini, B., Fedon, G. C., Ferdani, D., Graf, H., Hardeberg, J. Y., Magrini, D., Massidda, M., Panteleris, et al.
Published in: 2025
Publisher: The Eurographics Association
DOI: 10.2312/DH.20253350

Peer reviewed articles (15)

Light source classification and colour change modelling for understanding and predicting pigments discolouration

Author(s): Panagiotis Siozos, Letizia Monico, Aldo Romani, Costanza Miliani, Brenda Doherty, Irina Crina Anca Sandu, Hartmut Kutzke, Ingrid M T Flåte, Petros Stavroulakis, Sophia Sotiropoulou
Published in: Journal of Physics: Photonics, Issue 7, 2025, ISSN 2515-7647
Publisher: IOP Publishing
DOI: 10.1088/2515-7647/ADE8C2

SpectralGaussians: Semantic, spectral 3D Gaussian splatting for multi-spectral scene representation, visualization and analysis

Author(s): Saptarshi Neil Sinha, Holger Graf, Michael Weinmann
Published in: ISPRS Journal of Photogrammetry and Remote Sensing, Issue 227, 2025, ISSN 0924-2716
Publisher: Elsevier BV
DOI: 10.1016/J.ISPRSJPRS.2025.06.008

Shining a light on the degradation of triarylmethane dyes: Multi-analytical study of a faded 1880s printed cotton dress

Author(s): Catarina M. Pinto, David Buti, Letizia Monico, Aldo Romani, Lucia Burgio, Brenda Doherty
Published in: Journal of Cultural Heritage, Issue 78, 2026, ISSN 1296-2074
Publisher: Elsevier BV
DOI: 10.1016/J.CULHER.2026.01.008

Silver/dyes decoupling and colour restoration of autochromes using multispectral imaging

Author(s): Irina Ciortan, Yoko Arteaga, Giorgio Trumpy
Published in: The European Physical Journal Plus, Issue 140, 2025, ISSN 2190-5444
Publisher: Springer Science and Business Media LLC
DOI: 10.1140/EPJP/S13360-025-06284-2

Digital Applications in Archaeology and Cultural Heritage

Author(s): Veggi M.; Pescarin S.
Published in: Digital Applications in Archaeology and Cultural Heritage, 2024, ISSN 2212-0548
Publisher: Elsevier
DOI: 10.1016/J.DAACH.2024.E00321

Designing hybrid and XR narrative applications: a framework to describe authoring tools in cultural domain

Author(s): M. Massidda, L. Travaglini, S. Pescarin
Published in: Digital Applications in Archaeology and Cultural Heritage, Issue 38, 2025, ISSN 2212-0548
Publisher: Elsevier BV
DOI: 10.1016/J.DAACH.2025.E00424

Ultramarine Blue in Edvard Munch’s Collection: A Multi-Analytical Study of Early 20th Century Commercial Oil Paints

Author(s): Beatrice G. Boracchi, Eun-Jin Strand Ferrer, Margherita Gnemmi, Laura Falchi, Francesca Caterina Izzo, Irina Crina Anca Sandu
Published in: Heritage, Issue 7, 2025, ISSN 2571-9408
Publisher: MDPI AG
DOI: 10.3390/HERITAGE7080190

Tactile 3D-printed media interaction with the color surface features of paintings. The case of the Scream (1910?) painting

Author(s): Petros Ioannis Stavroulakis, Alfonsina Pagano, Beatrice Boracchi, Panagiotis Siozos, Sophia Sotiropoulou, Emilien Leonhardt, Vincent Sabatier, Giorgio Trumpy, Irina C. A. Sandu
Published in: Frontiers in Computer Science, Issue 7, 2025, ISSN 2624-9898
Publisher: Frontiers Media SA
DOI: 10.3389/FCOMP.2025.1597880

Multiband Photogrammetry for Multispectral 3D Reconstruction of Statuary

Author(s): Ferdani, D., Barandoni, C., Bonifazi, F., Iannaccone, R., and Magrini, D.
Published in: Journal of Cultural Heritage, Issue 76, 2025, ISSN 1778-3674
Publisher: Elsevier
DOI: 10.1016/J.CULHER.2025.09.003

European Physical Journal Plus

Author(s): Boracchi, B.G., Ferrer, EJ.S., Gnemmi, M. et al.
Published in: Eur. Phys. J. Plus, Issue 140, 188, 2025, ISSN 2190-5444
Publisher: EDP Sciences, Società Italiana di Fisica and Springer Berlin Heidelberg
DOI: 10.1140/EPJP/S13360-025-06062-0

European Physical Journal Plus

Author(s): Beatrice Giorgia Boracchi; Eun-Jin Strand Ferrer; Margherita Gnemmi; Laura Falchi; Francesca Caterina Izzo; Irina Crina Anca Sandu
Published in: The European Physical Journal Plus, 2025, ISSN 2190-5444
Publisher: EDP Sciences, Società Italiana di Fisica and Springer Berlin Heidelberg
DOI: 10.1140/EPJP/S13360-025-06062-0

How Much Do We Care About Cultural Heritage? A Rasch Scale Validation Study Among Young Adults

Author(s): Manuele Veggi, Alessandro von Gal, Laura Piccardi, Sofia Pescarin, Raffaella Nori
Published in: Heritage, Issue 8, 2025, ISSN 2571-9408
Publisher: MDPI AG
DOI: 10.3390/HERITAGE8080317

Digital Applications in Archaeology and Cultural Heritage

Author(s): Manuele Veggi and Sofia Pescarin
Published in: Digital Applications in Archaeology and Cultural Heritage, Issue 32, 2024, ISSN 2212-0548
Publisher: Elsevier BV
DOI: 10.1016/j.daach.2024.e00321

Beyond Static Colors: An Interactive Participatory Design Perspective on Color-Centric Experiences

Author(s): D. S. Martinez Pandiani, S. Pescarin
Published in: INTERNATIONAL JOURNAL OF CONSERVATION SCIENCE, Issue 13, 2022, ISSN 2067-533X
Publisher: Zenodo
DOI: 10.5281/zenodo.8167391

Advanced X-ray techniques to study the alteration of pigments in paintings

Author(s): Letizia Monico, Koen Janssens, Marine Cotte, Samuel M. Webb, Frederik Vanmeert, Victor Gonzalez, Geert Van der Snickt, Katrien Keune, Brunetto Giovanni Brunetti, Gerald Falkenberg, Jan Garrevoet, Annelies van Loon, Marc Vermeulen, Maite Maguregui, Steven De Meyer, Ermanno Avranovich Clerici, Fréderique T. H. Broers, Laura Cartechini, Nouchka De Keyser, Francesco d’Acapito, Florian Meirer, Aldo Romani, Francesca Rosi, Sara Carboni Marri, Daniela Comelli, Nina Deleu, Ida Fazlic, Marta Ghirardello, Clément Holé, Silvia Pérez-Diez, Mathieu Thoury, Costanza Miliani
Published in: La Rivista del Nuovo Cimento, Issue 48, 2025, ISSN 0393-697X
Publisher: Springer Science and Business Media LLC
DOI: 10.1007/S40766-025-00070-7

Other (25)

Cultural Probe Kit on Authenticity triggers in XR experiences: activity book and diary for designers to explore and develop authentic experiences in Digital Heritage

Author(s): Spotti Samuele; Pescarin Sofia
Published in: 2023
Publisher: Zenodo
DOI: 10.5281/zenodo.8286449

D3.2 Material Appearance Models

Author(s): NTNU
Published in: 2026
Publisher: Zenodo
DOI: 10.5281/ZENODO.16903578

D2.2 Stakeholders needs and Requirement Analysis

Author(s): MANN, CNR, NTNU, V&A, MUNCH, HSLU, ANAMNESIA, FORTH
Published in: 2023
Publisher: Zenodo
DOI: 10.5281/ZENODO.16903555

Born Digital Art: Fleeting Masterpieces?

Author(s): A. Clay
Published in: 2023
Publisher: Zenodo - Perceive Web Portal
DOI: 10.5281/zenodo.10458440

Perceive Isis Colours Exhibition Catalogue

Author(s): Cristiana Barandoni, Marialucia Giacco, Caterina Serena Martucci, Sofia Pescarin (Eds.)
Publisher: Valtrend Editore

Adaptive Horizons: Navigating Museums in a Post-Pandemic World

Author(s): A. Clay, G. Grieco, D. Lanfranconi, C. G. Fedon
Published in: 2023
Publisher: Zenodo - Perceive Web Portal
DOI: 10.5281/zenodo.10458408

D7.2 Assessment of Tools and Services and Prototypes v.2

Author(s): NTNU, CNR, Fraunhofer
Published in: 2026
Publisher: Zenodo
DOI: 10.5281/ZENODO.16903593

D2.1 PERCEIVE Theory v.1.1

Author(s): CNR, HSLU, FORTH, NTNU, Munch Museum, MANN Museum, AIC
Published in: 2023
Publisher: Zenodo
DOI: 10.5281/ZENODO.16903529

D8.2 PERCEIVE Innovation and Call Report v.3.1

Author(s): National Research Council, Anamnesia, IMKI, Fraunhofer
Publisher: Zenodo
DOI: 10.5281/ZENODO.16903626

D2.3 Training Program

Author(s): CNR, NTNU
Published in: 2026
Publisher: Zenodo
DOI: 10.5281/ZENODO.19366466

D5.1. PERCEIVE Platform Specifications

Author(s): FORTH, CNR, Fraunhofer, IMKI, NTNU
Published in: 2023
Publisher: Zenodo
DOI: 10.5281/ZENODO.16903587

D6.1 PERCEIVE Concept Design, UX and Design Brief

Author(s): Fraunhofer, CNR
Publisher: Zenodo
DOI: 10.5281/ZENODO.10658272

PERCEIVE Design Cultural Probe Kit Tools

Author(s): Pescarin, S., Veggi, M., Bonanno, V., & Spotti, S.
Published in: 2023
Publisher: Zenodo
DOI: 10.5281/zenodo.10260211

D1.3 Quality Assessment Plan, Risks and IPR management v.3

Author(s): CNR, Fraunhofer, FORTH
Publisher: Zenodo
DOI: 10.5281/ZENODO.16903455

Survey on the use of Generative AI for Design in Digital Cultural Heritage - Questions and data (1.0.0) [Data set]

Author(s): Veggi, M., Catalano, C. E., & Pescarin, S.
Publisher: Zenodo
DOI: 10.5281/ZENODO.15178218

Cultural Probe Kit on Curiosity triggers in XR experiences: activity book and diary for designers to explore and solicit curiosity in Digital Heritage

Author(s): Bonifazi F., Pescarin S.
Published in: 2023
Publisher: Zenodo
DOI: 10.5281/zenodo.8286037

D8.1. Communication and Dissemination Strategy and Plan v.2

Author(s): CNR, ANAMNESIA, IMKI
Published in: 2024
Publisher: Zenodo
DOI: 10.5281/ZENODO.16903479

D1.2. Data Management Plan

Author(s): Fraunhofer, CNR, NTNU, FORTH
Published in: 2026
Publisher: Zenodo
DOI: 10.5281/ZENODO.16903402

D1.4 Policy Briefing v. 2.2

Author(s): CNR, Fraunhofer
Published in: 2026
Publisher: Zenodo
DOI: 10.5281/ZENODO.16903483

D1.1 Operational plan, Progress Report and Evaluation Report

Author(s): CNR
Published in: 2023
Publisher: Zenodo
DOI: 10.5281/ZENODO.16903277

PERCEIVE Cultural Probe Kit on Caring attitude in XR experiences: activity book, diary and art practices for designers to explore and solicit care in Cultural Heritage domain

Author(s): Pescarin S., Fiorenza G., & Veggi M.
Published in: 2023
Publisher: Zenodo
DOI: 10.5281/zenodo.8285610

D8.3 PERCEIVE Publication and (Catalogue of) Demonstrators v.2

Author(s): National Research Council, Anamnesia, IMKI
Published in: 2026
Publisher: Zenodo
DOI: 10.5281/ZENODO.16903668

D7.1 Evaluation Strategy: Psychophysics and Psychometrics observation studies

Author(s): NTNU
Published in: 2024
Publisher: Zenodo
DOI: 10.5281/ZENODO.16903577

CHARE Scale. Focus Group and Validation Study on Young Adults - Raw Data and Validation Walkthrough (1.0.0) [Data set]

Author(s): Veggi, M., von Gal, A., Piccardi, L., Pescarin, S., & Nori, R.
Published in: 2024
Publisher: Zenodo
DOI: 10.5281/ZENODO.14267775

D5.2 PERCEIVE Platform v.2

Author(s): IMKI, FORTH
Published in: 2026
Publisher: Zenodo

Monographic books (2)

Chromatic Visions

Published in: Lecture Notes in Computer Science, 2026
Publisher: Springer Nature Switzerland
DOI: 10.1007/978-3-032-17700-1

Chromatic Visions

Published in: Lecture Notes in Computer Science, 2025
Publisher: Springer Nature Switzerland
DOI: 10.1007/978-3-032-07792-9