The technical progress of the project has focused on designing the BD4OPEM architecture, with the principles of scalability and interoperability, on ensuring the appropriate data integration and management, on developing the BD4OPEM Marketplace and on defining the requirements of the Big Data services.
The advances of this first period have permitted the identification and analysis of business and technical use-cases, the collection and definition of standards and protocols to be implemented and the definition of the architecture of BD4OPEM platform. BD4OPEM architecture has been built based on SGAM reference architecture (with the required identification and analysis of business and technical use-cases) and on the “4+1” View Model (logical, implementation, process, deployment and scenarios views). This architecture will be adapted to the specificities of the five pilot sites, which offer a significant amount of data from diverse sources, covering different attributes (e.g. voltage, active power), domains (energy consumption generation, failures, weather, topology), grid assets (MV/LV grid transformer, Smart Meters installed at customer premises) and also related to data dimension (volume, velocity, variety, value, veracity). This data heterogeneity is typically the first barrier to analyse and exploit data, so there is a need for harmonization of the data.
A seamless and scalable data access is being ensured from all the pilot data providers to the BD4OPEM Marketplace and to the various data end-users, for the realisation of advanced analytics services. The analysis of the involved data sources and data flows (including the identification of data formats, data granularity and communication frequency) is being used as basis for implementation of the unified interfaces for data acquisition across heterogeneous sources.
The Marketplace being created is enabling the integration of third-party services and applications, including tools for employing Business Intelligence on top of the Big Data analytics deployed for energy-related data. The solution is enabling the share of energy domain data, by adopting the an Open Innovation Marketplace, permitting the “matchmaking” among providers of data, providers of services and interested users, as well as the ability to request and create new services. The interaction between solution (or service) providers with the Data Analytics Engine is being ensured so as to facilitate the development of the BD4OPEM services, which have now the scope and requirements fully identified.