Periodic Reporting for period 2 - MAGNETO (Multimedia Analysis and Correlation Engine for Organised Crime Prevention and Investigation)
Reporting period: 2019-05-01 to 2021-04-30
MAGNETO's objectives are to:
- Augment the capabilities of Law Enforcement Agencies (LEAs) in managing, investigating, correlating and reasoning from huge volumes of heterogeneous and disjoint multimedia data.
- Develop dedicated technical breakthroughs to anticipate both the growth in volume and types of data, and the resources and evolution of crime and criminality.
- Design and compose an open framework and develop powerful tools to deliver increased innovation capacity in Europe, and more efficient information exchange between operators and other users.
MAGNETO has carried out a series of 12 feature-rich demonstrations to internal and external LEAs, policy makers, external advisors, and other key stakeholders. Dedicated training sessions were organized and appropriate training materials (structured into 8 different modules) were produced, suitable for online training (in response to COVID-19 challenges). On-premise installation and deployment of the MAGNETO Platform was achieved in 7 different countries.
Legal and ethical guidelines were transformed into appropriate impact assessment tools as well as enabled relevant technical design choices. Outreach activities were intensified through the use of appropriate dissemination and communication measures. Three dedicated task forces were set up to perform market analysis and positioning, clarify IPR issues and formalize the IPR framework, as well as finalize the value chain analysis and the value proposition of MAGNETO.
-Multimedia analysis: MAGNETO aims to perform content and context metadata extraction, data indexing, data fusion and efficient search and retrieval.
-Semantic information fusion: MAGNETO aims to build a comprehensive Semantic Information Fusion system based on recent advances, to deploy it at the test sites, and to implement an ontology modelling the classes and their interrelations for the data streams arriving at the information fusion stages.
- Text mining, data mining, pattern recognition and machine learning: In MAGNETO, semantic notations and real-time machine learning algorithms will enable efficient processing and analysis in terms of speed, variety and different types of content.
- Heterogeneous data exchange and sharing: MAGNETO's ontology will allow knowledge exchange between different LEA systems.
- Augmented intelligence: MAGNETO investigates novel immersive Human-Machine Interfaces (HMIs), based on web and virtual reality technologies, creating a multidimensional environment that allows better situational awareness.
The MAGNETO project is expected to deliver the following results:
- Evidence collection platform employing heterogeneous data mining and multimedia content indexing making it available for further processing.
- Sophisticated representational model for representing knowledge in an open, standardized manner to unlock the discovery of relations and enable interoperability.
- Advanced correlation engine, which will facilitate automatic discovery of new, unsuspected relations within big datasets.
- Threat prediction engine by semantic reasoning, which will enable trends analysis and threat level assessment.
- Augmented intelligence tools that will deliver immersive and interactive HMIs to enhance situation awareness.
- Results transferability framework.
- Legal and ethical assessment framework for examining the impact of MAGNETO and ensuring its compliance to ethical standards and legislation.
- Training curricula for the use of MAGNETO tools.
MAGNETO brings a set of substantial impacts including:
- Improvement of investigation capabilities of the LEAs, by providing tools that reduce the time to solve crimes.
- Enhanced prediction and prevention of terrorist endeavors.
- Better identification and understanding of criminal activities.
- Better capabilities to prevent, investigate, and mitigate criminal acts.
- Compliance with the Privacy and Ethical directives of EU.