The main results obtained from the project were as follows.
- The Validation Best Practices Manual contains best/good practices for the three areas considered in CAATS. The 'case' format is used to collate this information.
- In the Validation domain, best practices in operational concept validation for all ATM R&D projects have formed the E-OCVM. The Joint Programme Board (JPB) in its meeting on 24 January 2005, required the application of E-OCVM and the use of Validation Data Repository (VDR) by all ATM-related projects in particular within the collaboration between the EC and EUROCONTROL in the ATM Master Plan and also along the ACARE Strategic Research Agenda SRA-2.
- In the Safety domain, through a very active interaction with a number of target projects and safety experts, a long and rich list of emerging good practices and needs for improvement for safety key elements in ATM were identified for performing the Safety Case.
- In the Human Factors domain, the Human Factors good practices collected in the Best Practices Manual constitute the most comprehensive and state-of-the-art approach to build the Human Factors Case.
- The Guide to a Comprehensive Incorporation of Validation in ATM R&D Projects, to provide support for effective management of the validation, safety and human factors activities as part of the overall ATM R&D project, by issuing clear and concise checklist guidelines.
- Dissemination activities have enabled active interaction with target projects through participation to the various CAATS workshops. The results to these activities have been.
- increased awareness of the Best Practices Manual (in the areas of Validation, Human Factors and Safety) among EC´s and Eurocontrol projects.
- gaps identified and recommendations issued to improve the Best Practices Manual.
CAATS has thus achieved its objectives by identifying and consolidating knowledge in these areas - making it state-of-the-art - and disseminated it to the relevant stakeholders.
The activities performed in the work packages are the following:
- knowledge audit, including knowledge both within and beyond the actual FP6 projects,
- gap analysis and filling,
- identification of best practices,
- preparation and dissemination of best practices,
- coordination of a feedback process,
- evolution and maintenance of best practices,
- support to users as requested.
The Safety Team reviewed safety objectives, safety regulations, safety management, safety levels and criteria, and safety assessment methodologies. Safety aspects for all phases of flight and airport movements, and at all stages in the development lifecycle of new air traffic operations were covered.
The Human Factors Team was focused mainly on two aspects: human/machine interaction principles, and stakeholder and acceptance issues of the new concepts and technologies. The Validation Team was focused mainly on two aspects of the domain of Validation: generic Air Traffic Management (ATM) validation methodologies, and specific ATM system validation methodologies.
For Air Traffic Management, Safety deserves attention from three different perspectives
- Safety perception (e.g. by pilot, controller, passenger, human society, et cetera.). An ATM design that is perceived as being unsafe will not easily be accepted by the pilots and controllers involved. Fact is that their positive perception about the safety of an ATM design is a training and deployment critical requirement. By its very nature, however, safety perception is a subjective notion, and therefore insufficient to really guide the approval of safety-critical changes in ATM. Moreover, the safety perception by passengers and human society can not be identified on the basis of an ATM design.
-Dependability of a technical system (e.g. an automation support system, an aircraft navigation system, a satellite-based communication system) stands for a collective term used to describe the availability performance and its influencing factors, reliability performance, maintainability performance and maintenance-support performance. Metrics for dependability elements have been widely studied in literature for technical systems and are in use e.g. by the JAA and EUROCONTROL.
-Accident risk, e.g. for 1st (crew), 2nd (passengers) and 3rd parties (external persons) in air transport. Accident risk metrics are commonly in use for human controlled safety-critical operations in chemical and nuclear industries, and in civil aviation. Two well known ICAO-adopted accident risk metrics are for an aircraft to collide either with another aircraft during en-route phase, or with fixed obstacles during landing. Risk may also be expressed in economic terms or societal risk.