Periodic Reporting for period 1 - SCENE (Searchable multi-dimensional Data Lakes supporting Cognitive Film Production & Distribution for the Promotion of the EuropeaN Cultural HeritagE)
Periodo di rendicontazione: 2023-02-01 al 2024-04-30
The SCENE project has been majorly designed to offer the means for a modern & globally competitive, European filmmaking industry, by building upon two solid pillars, i.e. semantically cognitive AI technologies and the (in) tangible European Cultural assets, always with respect to the European values & policies regarding the human and its environment. SCENE aims to develop a wide set of cutting-edge technologies & services that are able to cover the whole pipeline of the film-making industry. SCENE aims to innovate by enriching the existing data lakes with high-qualitative & editable 3D digital models of European cultural sites, and by enhancing their accessibility with the integration of multi-dimensional knowledge graphs carrying location- & cultural-aware information.
During M1-M15, work in all project’s WPs has been carried out. More specifically, requirements for the SCENE platform and its components have been collected, analyzed and led to the design of the first version of platform’s architecture. Specifications per component have been extracted, while initial implementation of each component has started (i.e. Media Asset Manager, Location scouting, Audience Building tool, post-production effects and quality management, Recommendation and distribution engine). The data layer of SCENE platform, including the DataLake & SCENE-O ontology, have been designed and tutorials of using the DataLake for information storage and retrieval have been prepared. As far as the 3D reconstruction of 3D cultural heritage monuments concerns, the pilot site partners defined the pilot sites, have proceeded with requests for access permission on the pilot sites, defined the equipment required for the 3D model creation and performed protogrammetric acquisition campaigns of monuments in Cyprus and Italy. Also, during the reporting period, an initial version of the audio and lighting simulation modules has been implemented.
During M1-M15, work in all project’s WPs has been carried out. More specifically, requirements for the SCENE platform and its components have been collected, analyzed and led to the design of the first version of platform’s architecture. Specifications per component have been extracted, while initial implementation of each component has started (i.e. Media Asset Manager, Location scouting, Audience Building tool, post-production effects and quality management, Recommendation and distribution engine). The data layer of SCENE platform, including the DataLake & SCENE-O ontology, have been designed and tutorials of using the DataLake for information storage and retrieval have been prepared. As far as the 3D reconstruction of 3D cultural heritage monuments concerns, the pilot site partners defined the pilot sites, have proceeded with requests for access permission on the pilot sites, defined the equipment required for the 3D model creation and performed protogrammetric acquisition campaigns of monuments in Cyprus and Italy. Also, during the reporting period, an initial version of the audio and lighting simulation modules has been implemented.
During M1-M15 SCENE consortium submitted 11 deliverables: D1.1,D1.2,D2.2,D2.6,D5.4,D6.1,D6.2,D6.3,D6.4,D7.1,D7.2 & reached 3 Milestones (MS1, MS2, MS4).
Main achievements:
• Technical, ethical & legal requirements’ collection from stakeholders of the filmmaking industry
o Design of SCENE platform’s architecture
o Formulation of a DataLake & design of SCENE-O ontology for information retrieval
• Preparation of mockups for the SCENE platform
• Implementation of the following components:
o the AI-based audience preferences scouting
o a Retrieval - Augmented Generation Chatbot, for the search & retrieval of locations in a human-like conversational way
o the Media Assets Manager (MAM)
• Development of first draft of Ricardian Contract legal agreement document for IPR protection
• Development of 3D reconstruction models from monuments in Cyprus & Italy
• Preparation of Communication, Dissemination and exploitation plan
Main achievements:
• Technical, ethical & legal requirements’ collection from stakeholders of the filmmaking industry
o Design of SCENE platform’s architecture
o Formulation of a DataLake & design of SCENE-O ontology for information retrieval
• Preparation of mockups for the SCENE platform
• Implementation of the following components:
o the AI-based audience preferences scouting
o a Retrieval - Augmented Generation Chatbot, for the search & retrieval of locations in a human-like conversational way
o the Media Assets Manager (MAM)
• Development of first draft of Ricardian Contract legal agreement document for IPR protection
• Development of 3D reconstruction models from monuments in Cyprus & Italy
• Preparation of Communication, Dissemination and exploitation plan
The expected project results are the following:
1: SCENE platform that offers AI-enabled tools to filmmaking industries for all phases to increase competitiveness
2: AI-based audience preferences scouting to better understand the trends and Audience building tools
3: European cultural sites/assets 3D representations for usage in the production phase by the audio & light simulation engine.
4: Development of descriptive, self-emerging, self-learning, self-adaptive and automatically integrated SCENE-O ontologies and the associated semantic annotation tools
5: Data lakes formulation for uploading/ using (IPR protected) multimedia assets & 3D models
6: MAM (Media Assets Manager) that will facilitate the filmmaking content management
7: Location Scouting tool
8: Licencing services via Blockchain technologies for IPR protection
9: Distribution engine & Recommender systems, for targeted promotion and distribution of the film
10: >20 publications on SCENE discoveries by the end of the project
11: Demonstrate & Evaluate the SCENE solution to 3 use cases for cloud-cloud, cloud-edge, and edge-edge tests and adaptations
The expected project impacts are listed as follows:
EI#1: Open access benchmark data and publications;
EI#2: Fully fledged SCENE as an open source project
EI#3: Fostering diffusion of knowledge and creation of synergies in the filmmaking value chain
EI#4: At least 50 industries will use SCENE platform until 2030
EI#5: At least 500 new jobs created in the EU filmmaking domain due to SCENE by 2030
EI#6: Reduced visits to sites for testing, resulting in carbon footprint reduction
EI#7: Friendly user interfaces, increasing the UX
EI#9: SCENE open-source community will transfer innovations across the EU economy
EI#10: New growing strategies and business goals
EI#11: New BMs
EI#12: Social practices and social sustainability
EI#13: Efficient energy management, resulting in costs reduction
EI#14: Filmmaking market liberalisation – Business opportunities for replication
EI#15: Strengthen position in relevant networks –development of synergies
1: SCENE platform that offers AI-enabled tools to filmmaking industries for all phases to increase competitiveness
2: AI-based audience preferences scouting to better understand the trends and Audience building tools
3: European cultural sites/assets 3D representations for usage in the production phase by the audio & light simulation engine.
4: Development of descriptive, self-emerging, self-learning, self-adaptive and automatically integrated SCENE-O ontologies and the associated semantic annotation tools
5: Data lakes formulation for uploading/ using (IPR protected) multimedia assets & 3D models
6: MAM (Media Assets Manager) that will facilitate the filmmaking content management
7: Location Scouting tool
8: Licencing services via Blockchain technologies for IPR protection
9: Distribution engine & Recommender systems, for targeted promotion and distribution of the film
10: >20 publications on SCENE discoveries by the end of the project
11: Demonstrate & Evaluate the SCENE solution to 3 use cases for cloud-cloud, cloud-edge, and edge-edge tests and adaptations
The expected project impacts are listed as follows:
EI#1: Open access benchmark data and publications;
EI#2: Fully fledged SCENE as an open source project
EI#3: Fostering diffusion of knowledge and creation of synergies in the filmmaking value chain
EI#4: At least 50 industries will use SCENE platform until 2030
EI#5: At least 500 new jobs created in the EU filmmaking domain due to SCENE by 2030
EI#6: Reduced visits to sites for testing, resulting in carbon footprint reduction
EI#7: Friendly user interfaces, increasing the UX
EI#9: SCENE open-source community will transfer innovations across the EU economy
EI#10: New growing strategies and business goals
EI#11: New BMs
EI#12: Social practices and social sustainability
EI#13: Efficient energy management, resulting in costs reduction
EI#14: Filmmaking market liberalisation – Business opportunities for replication
EI#15: Strengthen position in relevant networks –development of synergies