Periodic Reporting for period 2 - SatisFactory (A collaborative and augmented-enabled ecosystem for increasing SATISfaction and working experience in smart FACTORY environments)
Reporting period: 2016-07-01 to 2017-12-31
SatisFactory aims to enhance and enrich the manufacturing working environment towards attractive factories of the future that encompass key enabling technologies such as augmented reality, wearable and ubiquitous computing as well as and customised social communication platforms coupled with experience design and gamification techniques for the efficient transfer of knowledge and experience among employees. The final achievements were to develop and deploy emerging knowledge-driven training techniques (gamification aware) and wearable devices (AR-enabled Glasses) for the enhancement of innovation, productivity and scheduling of work in the production line while enriching its flexibility through the support of team interactions in the shop floor which consequently will add to the work-related satisfaction. Special attention in the deployment of cutting-edge incentives (wearable computing, gamified working experience) has been given towards further increase of attractiveness to the younger generation. The focus that has been given on user experience and gamification ensured optimal balance between workers performance and satisfaction.
In order for the SatisFactory project to successfully reach its goals, several prerequisites have been set in the form of major Scientific and Technological Objectives throughout the duration of the project:
Objective 1: Context-aware control and re-adaptation of shop floor production facilities for increased productivity and flexibility in use of shop floor resources.
Objective 2: Improvement of attractiveness and productivity through collaboration, social interaction and gamification approaches.
Objective 3: Real-time knowledge-sharing and AR-based collaboration and training services.
Objective 4: Improved shop floor feedback and decision making for gains in productivity, workers wellbeing and comfort.
Objective 5: Adaptive and augmented interfaces for collaboration, knowledge sharing and real time support.
Objective 6: Deployment and Evaluation of the solution to large-scale Industrial Facilities from the Automotive and Energy factory domains.
In order for the SatisFactory project to successfully reach its goals, several prerequisites have been set in the form of major Scientific and Technological Objectives throughout the duration of the project:
Objective 1: Context-aware control and re-adaptation of shop floor production facilities for increased productivity and flexibility in use of shop floor resources.
Objective 2: Improvement of attractiveness and productivity through collaboration, social interaction and gamification approaches.
Objective 3: Real-time knowledge-sharing and AR-based collaboration and training services.
Objective 4: Improved shop floor feedback and decision making for gains in productivity, workers wellbeing and comfort.
Objective 5: Adaptive and augmented interfaces for collaboration, knowledge sharing and real time support.
Objective 6: Deployment and Evaluation of the solution to large-scale Industrial Facilities from the Automotive and Energy factory domains.
During the second period of the SatisFactory project, the SatisFactory Consortium has completed the circle of all necessary actions denoted in the project’s Description of Action (DoA –Annex I). The work in the second period of the project (M19-M36) focused on the fulfilment of user requirements analysis and use cases finalization, as well as on the overall SatisFactory system implementation and evaluation. In parallel, the development efforts have been finalised in all domains of the SatisFactory project, e.g. social collaboration platform, gamification framework, HR re-adaptation toolkit, context-aware manager, decision support engine, IoT infrastructure, AR glasses, AR toolkit and “on-the-job” education toolkit, along with the technical developments of the SatisFactory hardware infrastructure. Moreover, project efforts proceeded in focusing also on several horizontal activities regarding diffusing project objectives, concepts and achievements in key stakeholders as well as to the general public.
The developments for the reporting period can be summarized, but not limited to the following points:
1. Definition of end-user, shop-floor and system requirements and specifications. Finally 89 requirements have been defined from the 3 pilot shop-floors.
2. Actors and procedures interconnection modelling. There were defined 3-6 actors groups, depending on the shop-floor, which can be divided at 11 subcategories.
3. Definition of the SatisFactory Use-Cases and Application Scenarios. Eleven (11) business scenarios and twenty three (23) cases (UCs) were defined.
4. Implementation of the Common Information Data Exchange Model (CIDEM) and its APIs for the storing information of the shop-floors.
5. Development of the Plant Data Exchange Component (PDEC), in order to connect existing shop-floor infrastructure with the SatisFactory or other frameworks.
6. Definition of the SatisFactory architecture.
7. Development of novel tools for increasing attractiveness of the workplaces:
o Social Collaboration platform;
o Gamification platform;
o Suggestions for improvements platform;
o Digital Andon;
8. Implementation of a human resources optimization and re-adaptation toolkit;
9. Development of context-aware components to enable Knowledge Share and support Decision Making process:
o Localization manager (LM);
o Multiple-media manager;
o Gesture and content recognition manager;
o Incident detection algorithms;
10. Development of the SatisFactory decision support system (DSS):
o Core DSS engine;
o Incident detection – Malfunction diagnosis application;
11. Design and development of IoT infrastructure:
o UWB localization infrastructure;
o Single & multi-radio nodes for collecting data from shop-floor sensors;
o Comfort-related IoT devices;
12. Design and creation of Augmented Reality Glasses to improve attractiveness & knowledge share on the move;
13. Design and development of a AR “On-The-Job” education toolkit:
o Creation toolkit;
o Presentation tool;
o Image processing algorithms supporting AR operation;
14. Development of an intelligent notification and control middleware;
15. Definition of the project’s Data Management Plan;
Furthermore, the installation and testing at the pre-pilot shop-floor (CERTH/CPERI) has been finalized, while the SatisFactory framework has been successfully deployed in the industrial pilot shop-floors (COMAU and SUNLIGHT). The system has been evaluated, while the evaluation results and the lessons learned has been documented.
Regarding the horizontal activities of the project, the consortium established and effectively maintained a bulk of facilities for the dissemination of the project concept, objectives and results. Some indicative are the official SatisFactory web site (http://www.satisfactory-project.eu/) popular social media, publications in scientific conferences and journals, a video, brochures, press-releases, etc.
The developments for the reporting period can be summarized, but not limited to the following points:
1. Definition of end-user, shop-floor and system requirements and specifications. Finally 89 requirements have been defined from the 3 pilot shop-floors.
2. Actors and procedures interconnection modelling. There were defined 3-6 actors groups, depending on the shop-floor, which can be divided at 11 subcategories.
3. Definition of the SatisFactory Use-Cases and Application Scenarios. Eleven (11) business scenarios and twenty three (23) cases (UCs) were defined.
4. Implementation of the Common Information Data Exchange Model (CIDEM) and its APIs for the storing information of the shop-floors.
5. Development of the Plant Data Exchange Component (PDEC), in order to connect existing shop-floor infrastructure with the SatisFactory or other frameworks.
6. Definition of the SatisFactory architecture.
7. Development of novel tools for increasing attractiveness of the workplaces:
o Social Collaboration platform;
o Gamification platform;
o Suggestions for improvements platform;
o Digital Andon;
8. Implementation of a human resources optimization and re-adaptation toolkit;
9. Development of context-aware components to enable Knowledge Share and support Decision Making process:
o Localization manager (LM);
o Multiple-media manager;
o Gesture and content recognition manager;
o Incident detection algorithms;
10. Development of the SatisFactory decision support system (DSS):
o Core DSS engine;
o Incident detection – Malfunction diagnosis application;
11. Design and development of IoT infrastructure:
o UWB localization infrastructure;
o Single & multi-radio nodes for collecting data from shop-floor sensors;
o Comfort-related IoT devices;
12. Design and creation of Augmented Reality Glasses to improve attractiveness & knowledge share on the move;
13. Design and development of a AR “On-The-Job” education toolkit:
o Creation toolkit;
o Presentation tool;
o Image processing algorithms supporting AR operation;
14. Development of an intelligent notification and control middleware;
15. Definition of the project’s Data Management Plan;
Furthermore, the installation and testing at the pre-pilot shop-floor (CERTH/CPERI) has been finalized, while the SatisFactory framework has been successfully deployed in the industrial pilot shop-floors (COMAU and SUNLIGHT). The system has been evaluated, while the evaluation results and the lessons learned has been documented.
Regarding the horizontal activities of the project, the consortium established and effectively maintained a bulk of facilities for the dissemination of the project concept, objectives and results. Some indicative are the official SatisFactory web site (http://www.satisfactory-project.eu/) popular social media, publications in scientific conferences and journals, a video, brochures, press-releases, etc.
The key innovation points of the project can be summarized as follows:
• Development and manufacturing of AR glasses software, firmware and hardware.
• Research and Development of the AR “on-job” education & training toolkit.
• Research and Development of the Gamification toolkit for industrial environments.
• Research and Development of algorithms and technology for employees localization and ergonomics analysis – new wearable for localization & ergonomics support.
• Research and Development of algorithms for gesture and content recognition.
• Research and Development of advanced signal processing for early incident diagnosis at factory processes incorporating depth and thermal information processing.
• Research and Development of IoT infrastructure to enable context-aware analysis of the shop-floor activities.
• Development and manufacturing of AR glasses software, firmware and hardware.
• Research and Development of the AR “on-job” education & training toolkit.
• Research and Development of the Gamification toolkit for industrial environments.
• Research and Development of algorithms and technology for employees localization and ergonomics analysis – new wearable for localization & ergonomics support.
• Research and Development of algorithms for gesture and content recognition.
• Research and Development of advanced signal processing for early incident diagnosis at factory processes incorporating depth and thermal information processing.
• Research and Development of IoT infrastructure to enable context-aware analysis of the shop-floor activities.