PHYGITAL SOLUTIONS FOR THE CULTURAL AND CREATIVE INDUSTRIES

Projektinformationen

AMPLIFY

ID Finanzhilfevereinbarung: 101177413

DOI

10.3030/101177413

EK-Unterschriftsdatum 29 September 2024

Startdatum 1 November 2024

Enddatum 31 Oktober 2027

Finanziert unter

• Culture, creativity and inclusive society

Gesamtkosten

Keine Daten

EU-Beitrag

€ 3 985 884,79

Koordiniert durch

FUNDACION CENTRO DE TECNOLOGIAS DE INTERACCION VISUAL Y COMUNICACIONES VICOMTECH
Spain

Periodic Reporting for period 1 - AMPLIFY (PHYGITAL SOLUTIONS FOR THE CULTURAL AND CREATIVE INDUSTRIES)

Berichtszeitraum: 2024-11-01 bis 2026-04-30

Zusammenfassung vom Kontext und den Gesamtzielen des Projekts

The Cultural and Creative Industries (CCIs) are undergoing a deep transformation driven by digitalization and immersive technologies, yet smaller creative actors face significant barriers like high entry costs and the potential threat of AI to human creativity. AMPLIFY addresses the critical lack of accessible, open-source immersive tools by focusing on music as a universal language to empower underrepresented cultural communities. The project’s overall objectives center on creating novel human-centered "phygital" (physical-digital) experiences. This is achieved through the development of AMPLIFY CREATIVE (formerly, PORTABLE), an AI-driven production tool for community-level co-creation, and AMPLIFY IMMERSIVE, a toolset utilizing volumetric video and spatial audio to reach remote audiences. These tools are validated through real-world pilot trials across Europe (Gaelic folk culture in the UK, concerts for babies in Portugal, Augmented Reality concerts in Italy and opera co-creation in Spain) to ensure adaptability and foster CCI sustainability. AMPLIFY’s pathway to impact follows a multi-dimensional strategy designed to ensure that European Cultural and Creative Industries CCIs lead a human-centered digital transition. Scientifically, the project advances TRLs for open-source AI and XR tools, sharing findings through high-impact journals and international conferences. Economically, it focuses on the sector’s "long tail" of small and micro-organisations democratizing access to immersive tools that have high costs. By promoting remote "phygital" collaboration, AMPLIFY simultaneously addresses environmental sustainability by reducing the carbon footprint associated with creative travel.

Arbeit, die ab Beginn des Projekts bis zum Ende des durch den Bericht erfassten Berichtszeitraums geleistet wurde, und die wichtigsten bis dahin erzielten Ergebnisse

During the first 18 months of the project, AMPLIFY has achieved significant progress in the design and initial development of its core digital suites:
* Ethical and Human-Centric Framework (WP2): Establishment of a comprehensive methodological roadmap to guide the technical development in WP3 and WP4. Key achievements include: Methodological Roadmap: Defined specified methods, evaluation measures, and success criteria for understanding co-creation requirements and iterative testing. Requirement Analysis: Completed the initial description of requirements for the four pilot trials, tailoring the approach to specific needs such as Gaelic folk culture (UK) and opera co-creation (ES). Ethical Guidelines: Outlined essential ethical requirements, prioritizing data protection and "ethics by design" to foster a sustainable digital transition.
* AMPLIFY CREATIVE (former PORTABLE (WP3): Scientific work focused on creating an AI-driven, auto-operated production tool for multi-sensorial musical experiences. Main achievements include: System Architecture: Completed the initial design and architecture of the PORTABLE suite. AI Integration: Developed context-aware sensing components to understand user behavior (audience and performers) in real-time. Modular Prototypes: Progressed toward a portable hardware/software "box" designed to facilitate remote learning and performance at the community level.
* AMPLIFY IMMERSIVE (WP4):Development aimed at creating immersive stages for XR-driven social experiences. Key achievements include: XR Design: Defined the architecture for delivering volumetric video and spatial audio across devices, from mobiles to headsets. Media Orchestration: Implemented an orchestration layer to intelligently adapt the phygital experience to different network conditions and rendering environments. Technological Components: Delivered the first iteration of technological components designed to connect distributed artists and audiences with ultra-low latency.
* Small-Scale Pilot Trial Preparations (WP5): WP5 provided the scientific basis for real-world evaluation. Achievements include: Co-Design Insights: Conducted the first phase of co-design and experimentation with creative partners to validate the technical requirements of the tools. Initial Testing: Synthesized overall insights from continuous user testing during the first 18 months to inform technical refinements

Fortschritte, die über den aktuellen Stand der Technik hinausgehen und voraussichtliche potenzielle Auswirkungen (einschließlich der bis dato erzielten sozioökonomischen Auswirkungen und weiter gefassten gesellschaftlichen Auswirkungen des Projekts)

1) Human-Centric methodology: establishment of a robust methodology that integrates Social Sciences and Humanities (SSH) to ensure technology serves artistic and social needs rather than purely commercial ones.
2) AMPLIFY CREATIVE: initial architecture for an AI-driven, auto-operated audiovisual production "box" aimed at simplifying phygital live music creation for small-scale communities.
3) AMPLIFY IMMERSIVE: design for an XR toolset utilizing volumetric video and spatial audio to create immersive stages for distributed audiences.
4) Pilot requirements: Extracted over 20 technical requirements from initial pilot trial engagements, ensuring the tools are tailored to diverse real-world settings like Gaelic folk culture and community opera.