Periodic Reporting for period 1 - FotoInMotion (Repurposing and enriching images for immersive storytelling through smart digital tools)
Periodo di rendicontazione: 2018-01-01 al 2019-06-30
Acknowledging the above, the following critical questions become imminent in both content production and dissemination contexts: how to repurpose this massive amount of content; what kind of innovative tools are most suitable for this process; and finally, how these tools can offer new forms of monetization possibilities for creative industries' professionals.
FotoInMotion, sets to solve these critical questions and provide an innovative solution to the repurposing of content by offering automated tools for innovative contextual data extraction, object recognition, creative transformation, editing and text animation as well as state of the art 3D conversion options that allow content creators to transform their photos into highly engaging spatial and three-dimensional video experiences.
FotoInMotion is focusing on three major creative industries sectors: photojournalism to develop interactive photo driven stories; fashion, by opening up new forms of marketing, product placement and event coverage; and festivals, by enabling PR and publicity managers to communicate the festival experiences and engage audiences through immersive communication and repurposing festival archives. Professionals and experts from these three creative industries will continuously explore and test the FotoInMotion technological outcomes in order to achieve results of highest level in terms of quality, performance and innovation.
In parallel with the end users and based on user requirements, technical partners have initiated experimentation of state-of-the-art Machine Learning-based platforms and algorithms for the extraction and identification of visual features. Based on these results, it defined a first functional specification of the visual analysis and classification component (iCAT) and of relevant APIs for its integration within the complete FotoInMotion system architecture. In parallel, it selected and adopted a set of neural networks and started to configure, parametrise, train and fine-tune such Neural Networks to analyse photographs and identify features relevant for the FotoInMotion use cases. That lead to the development of the first version of the FotoInMotion image annotation tool (AAT). Such tool receives the output of the image analysis and features extraction tools and enables the user to enhance and/or augment the automatically obtained tags. In turn, it provides new training material and data to assess, validate, re-train and fine-tune the mentioned image analysis tools.
The technical partners have been also working towards developing and testing the first set of 2D image editing quality assistance tools, used by end users to prepare images to be processed by the FotoInMotion application. This refers to actions like cropping, changing the color balances and apply transformations on images. In parallel, the team has also developed and tested the first set of video effects, to assist narration and, consequently, produce a 3D video.
All technical work has been capitalized into the development of the first web-version of the FotoInMotion application, which will be pilot tested by the end users. This web platform is based on web-services architecture and in a user-friendly User Interface based on requests received by the pilot users and current trends. Adding to the above, the first version of the mobile application, with limited functionality, has been developed however more work will be implemented in the following months.