Exploitable results A software tool which supports video-assisted observational studies DRUM is a software tool which has been developed by close co-operation between Human Factors professionals and software engineers to provide a broad range of support for video-assisted observational studies. DRUM directly supports the MUSiC Performance Measurement Method for usability evaluation. Evaluation sessions are recorded on video and subsequently analysed with the help of DRUM. The diagnostic recorder for usability measurement (DRUM) is a software tool which assists the analysis of usability evaluation sessions. DRUM connects with a video recorder and enables the evaluator to build a log of interesting events linked to the time-code recorded on the tape. A logged event can be located simply by clicking on it with the mouse (DRUM) automatically winds the video tape to the exact frame of the recording, making it easy to compile a clips tape for demonstrating usability issues to developers. The number and duration of different categories of logged events can be summarized, and MUSiC Performance Measurement Method metrics can be derived if required. Summary data may be output to plain text files for further processing with a spreadsheet or statistical analysis tool. DRUM has been in use in commercial organisations since 1992 and has been continuously improved in consultation with industrial and research clients. #SECTION 2: The Performance Measurement Method for planning, carrying out and documenting a user-based evaluation of usability The MUSiC Performance Measurement Method is used to validate the final quality and usability of a system for the end user. Quantitative goals can be set and evaluated, and feedback obtained to improve the design. It is based on a procedure for analysing user behaviour, supported by a video recording. The method gives reliable measures of the effectiveness and efficiency of system use, by evaluating the extent to which specific task goals are achieved, and the times taken to achieve them. It also gives measures of time spent unproductively plus valuable data about the source of such difficulties. These measures enable comparison of prototypes of alternative designs with earlier versions of a system, for example, or with competing products. The diagnostic information helps identify where specific problems are encountered and where improvements need to be made. A major benefit of using MUSiC methods for usability measurement is that they provide a means of specifying usability goals and evaluating whether they have been achieved. The goals are expressed in terms of the purpose of the business system which is to enable users to achieve tasks effectively, efficiently and with satisfaction. It is possible to measure; whether typical users can correctly complete the task; the efficiency of typical users; how the efficiency of typical users compares with an expert user: this gives an indication of the point on the learning curve and may highlight a need to improve the user interface or to provide more training; the proportion of the time for which a user is productive: this may also highlight a need to improve the user interface or to provide more training. It is also important to measure user satisfaction, particularly as poor satisfaction is likely to lead to future deterioration in performance.. Software Usability Measurement Inventory (SUMI) The Software Usability Measurement Inventory (SUMI) is a rigorously tested and proven method of measuring software quality from the user's viewpoint. It is a consistent method for assessing the quality of use of a software product. It is backed by an extensive reference database embedded in an effective analysis and report generation tool. The Software Usability Measurement Inventory is a product arising from participation in research partly funded by the EC DGXIII ESPRIT Framework Programme. It is a questionnaire designed for analysing the degree of end user satisfaction, and the quality of use of the system being analysed. It is marketed by the HFRG, and it has been standardised in all the major European languages and is also sold in the USA in a separate USA language version and standardisation. SUMI is regarded as the 'de facto' international standard for usability questionnaires. SUMI focuses on the perception or feelings that the typical user has when using a piece of software and enables this perception of how usable a software product is, to be measured. It produces valid and reliable numbers which are indicators of the usability of the software being rated. It is a questionnaire method which is concerned with the users' perceptions and attitudes to a piece of software. The Inventory has been shown to be reliable and valid in a number of field trials conducted by the HFRG and independently by several organisations throughout Europe. The questionnaire incorporates five empirically defined sub-scales of this concept: Efficiency, Affect, Helpfulness, Control and Learnability, as well as a Global Usability Figure. Extensive standardisation data for SUMI has been collected over a wide range of software products and a large sample of users. Project URL : http://www.ucc.ie/hfrg/questionnaires/sumi/ Searching for OpenAIRE data... There was an error trying to search data from OpenAIRE No results available
