Final Activity Report Summary - AXIOM (Automated eXtraction of Image Object Metadata)
AXIOM has addressed scientific and technical challenges in the analysis, organisation, searching and manipulation of digital image streams for the digital cinema industry by reaching the following objectives:
1. to transfer knowledge about efficient probabilistic inference for image sequence processing from TCD to the foundry;
2. to transfer knowledge about film postproduction media and software interface standards from the foundry to TCD;
3. to expose TCD researchers to users experiencing the current film postproduction workflow in the course of their everyday editing tasks;
4. to train algorithm developers at the Foundry in the state-of the art of image and video processing algorithms;
5. to identify key areas in which content-based information could enhance the digital intermediate workflow, and to organise that content description in some meaningful way.
The objectives were implemented in a programme of exchanges of scientific staff between the foundry and TCD, with exchanges in both directions of a total of four experienced and two very experienced Fellows in a structured programme of training and research.
The results of the project were new algorithms, software plug-ins, research publications and employment opportunities for highly skilled researchers in academia and industry.
In this final year of the collaboration, we have found that our groups both gained in momentum with the return of the first Marie Curie Fellows (Francois Pitie and David Corrigan) to Sigmedia, as well as the increase in personnel as a whole at the foundry. Francois and David have both introduced the use of NUKE as a research tool into the Sigmedia Group's activities. In addition, the training that they have received in PlugIn development has been transferred to the Sigmedia. Both groups thus were able to put their training to practice on a shared problem drawn from the on-going matting work in both groups. In addition, Simon Robinson from the foundry introduced the TCD team to graph-based image-processing systems as used in post-production, some of the new development work in the Nuke compositing product, and an overview of new techniques for stereo image processing.
From the research teams came significant scientific progress in two areas: global motion blur and local motion blur. Two algorithms were developed, and have working Matlab implementations.
These two software plug-ins for diagnostics and matting were produced:
1. The diagnostics plug-in, 'Grain detection', was implemented as part of an OpenFX plug-in for the Nuke film compositing system. The work is incorporated into the automatic grain analysis tool available in the DeNoise plugin of the Furnace suite.
2. The matting plug-in, 'ForegroundMatter', was developed from algorithmic produced within the project. This now exists in C++ as a useful OpenFX plug-in running inside the Nuke film.
There was continuous dissemination of knowledge throughout the project, which included papers being given at the Third IET conference on visual media production. The plug-ins were showcased at two trade shows, NAB and IBC. In all the three years, these shows were attended.
While on his fellowship, David Corrigan published work on pathological motion that was relevant to WP3 Content level information (TCD Sigmedia and The Foundry), particularly motion discontinuities.
AXIOM disseminated information to other research projects such as Salero by attending a SALERO demonstration and having discussions with project members.
1. to transfer knowledge about efficient probabilistic inference for image sequence processing from TCD to the foundry;
2. to transfer knowledge about film postproduction media and software interface standards from the foundry to TCD;
3. to expose TCD researchers to users experiencing the current film postproduction workflow in the course of their everyday editing tasks;
4. to train algorithm developers at the Foundry in the state-of the art of image and video processing algorithms;
5. to identify key areas in which content-based information could enhance the digital intermediate workflow, and to organise that content description in some meaningful way.
The objectives were implemented in a programme of exchanges of scientific staff between the foundry and TCD, with exchanges in both directions of a total of four experienced and two very experienced Fellows in a structured programme of training and research.
The results of the project were new algorithms, software plug-ins, research publications and employment opportunities for highly skilled researchers in academia and industry.
In this final year of the collaboration, we have found that our groups both gained in momentum with the return of the first Marie Curie Fellows (Francois Pitie and David Corrigan) to Sigmedia, as well as the increase in personnel as a whole at the foundry. Francois and David have both introduced the use of NUKE as a research tool into the Sigmedia Group's activities. In addition, the training that they have received in PlugIn development has been transferred to the Sigmedia. Both groups thus were able to put their training to practice on a shared problem drawn from the on-going matting work in both groups. In addition, Simon Robinson from the foundry introduced the TCD team to graph-based image-processing systems as used in post-production, some of the new development work in the Nuke compositing product, and an overview of new techniques for stereo image processing.
From the research teams came significant scientific progress in two areas: global motion blur and local motion blur. Two algorithms were developed, and have working Matlab implementations.
These two software plug-ins for diagnostics and matting were produced:
1. The diagnostics plug-in, 'Grain detection', was implemented as part of an OpenFX plug-in for the Nuke film compositing system. The work is incorporated into the automatic grain analysis tool available in the DeNoise plugin of the Furnace suite.
2. The matting plug-in, 'ForegroundMatter', was developed from algorithmic produced within the project. This now exists in C++ as a useful OpenFX plug-in running inside the Nuke film.
There was continuous dissemination of knowledge throughout the project, which included papers being given at the Third IET conference on visual media production. The plug-ins were showcased at two trade shows, NAB and IBC. In all the three years, these shows were attended.
While on his fellowship, David Corrigan published work on pathological motion that was relevant to WP3 Content level information (TCD Sigmedia and The Foundry), particularly motion discontinuities.
AXIOM disseminated information to other research projects such as Salero by attending a SALERO demonstration and having discussions with project members.