Objectif
A theory of the cognitive impact of choice of modalities in communication between people and machines will be developed, especially the choice and combination of language, graphics and animation: ie, the modality allocation problem. The theory is to serve as the basis for generalising interface taxonomy, design and evaluation. It will take a modality-independent characterisation of information and then explore the cognitive effects of translating the same information into different media and combinations of media. Hence semantic theory will guide interface design which undergoes psychological evaluation to study the impact of closely comparable information presented in different modality combinations.
Research is being carried out in order to develop a theory of the cognitive impact of modality choice in communication between people and machines, especially the choice and combination of language, graphics and animation.
The study has focused on foundational issues in the semantics and pragmatics of graphical representations, and on gathering data on: graphically based interactions between humans; interface design practice; and the effects on learning of exposure to graphics.
The key idea of specificity has been characterized more formally and criteria distinguishing multimodal and multimedia systems from traditional interfaces have been investigated. Secondly, a preliminary methodology has been developed for selecting combinations of modalities in interface design, and a software workbench has also been developed for investigating the theoretical space of graphics. Thirdly, an algebraic semantics for systems of graphically based reasoning support has been substantially developed and empirical studies have been carried out on the effects of graphics on the acquisition of abstract reasoning skills. Fourthly, an event based logical characterization of animations have been developed, and the effects on comprehension of dynamic display techniques have been studied. The applicability to multimodal interfaces of existing theories of linguistic discourse structure has been surveyed and a version of Gestalt theory was used to model implicature in network diagrams. Finally, empirical studies of human human graphical interactions have been carried out and interviews have been held with designers to elicit design rationales.
APPROACH AND METHODS
Methods of semantic analysis developed for natural language discourse will be applied to the more general case of multi-media dialogue between user and computer, thus bridging the gap between "top-down" and "bottom-up" approaches to human-computer interaction (HCI). GRACE's central theoretical claim is that the key to understanding the graphical modality is its specificity: graphics forces the over-determination of information in a message. The major aspects of the work include: characterisation of information-modality mappings in terms of relevant parameters; utilisation of the analysis offered by the SITUE functions described by top-down HCI as input to the semantic analysis of interactive multi-modal communications; development of a taxonomy of existing multi-modal interfaces based on this general theory; development of cognitive characterisations of the operation of specificity and of abstractive conventions of interpretation; extension of existing applications of the theory in static graphics to animation; exploration of the relation between graphical reasoning and model-building techniques from constraint logic programming and AI; development of a software tool to support experimentation with different interface parameters, and demonstration of optimal interface techniques.
POTENTIAL
GRACE is expected to contribute to the development of HCI, discourse and animation theory, and to practical improvements in computer interface design, design methodology, and, further downstream, to produce training material relating the project's results to interface design practice. Exploitation will be facilitated by the establishment and maintenance of a set of industrial "uncles", generally IT providers, who will be expected to monitor project progress and attend annual briefings and specific workshops. Each project partner will support at least two such uncles. We expect that the relationship between the project and its uncles will be mutual: uncles will gain early access to project results, while the project will gain access to uncles' experience with real-world problems.
Champ scientifique (EuroSciVoc)
CORDIS classe les projets avec EuroSciVoc, une taxonomie multilingue des domaines scientifiques, grâce à un processus semi-automatique basé sur des techniques TLN. Voir: Le vocabulaire scientifique européen.
CORDIS classe les projets avec EuroSciVoc, une taxonomie multilingue des domaines scientifiques, grâce à un processus semi-automatique basé sur des techniques TLN. Voir: Le vocabulaire scientifique européen.
Vous devez vous identifier ou vous inscrire pour utiliser cette fonction
Programme(s)
Programmes de financement pluriannuels qui définissent les priorités de l’UE en matière de recherche et d’innovation.
Programmes de financement pluriannuels qui définissent les priorités de l’UE en matière de recherche et d’innovation.
Thème(s)
Les appels à propositions sont divisés en thèmes. Un thème définit un sujet ou un domaine spécifique dans le cadre duquel les candidats peuvent soumettre des propositions. La description d’un thème comprend sa portée spécifique et l’impact attendu du projet financé.
Données non disponibles
Les appels à propositions sont divisés en thèmes. Un thème définit un sujet ou un domaine spécifique dans le cadre duquel les candidats peuvent soumettre des propositions. La description d’un thème comprend sa portée spécifique et l’impact attendu du projet financé.
Appel à propositions
Procédure par laquelle les candidats sont invités à soumettre des propositions de projet en vue de bénéficier d’un financement de l’UE.
Données non disponibles
Procédure par laquelle les candidats sont invités à soumettre des propositions de projet en vue de bénéficier d’un financement de l’UE.
Régime de financement
Régime de financement (ou «type d’action») à l’intérieur d’un programme présentant des caractéristiques communes. Le régime de financement précise le champ d’application de ce qui est financé, le taux de remboursement, les critères d’évaluation spécifiques pour bénéficier du financement et les formes simplifiées de couverture des coûts, telles que les montants forfaitaires.
Régime de financement (ou «type d’action») à l’intérieur d’un programme présentant des caractéristiques communes. Le régime de financement précise le champ d’application de ce qui est financé, le taux de remboursement, les critères d’évaluation spécifiques pour bénéficier du financement et les formes simplifiées de couverture des coûts, telles que les montants forfaitaires.
Données non disponibles
Coordinateur
EH1 1HN Edinburgh
Royaume-Uni
Les coûts totaux encourus par l’organisation concernée pour participer au projet, y compris les coûts directs et indirects. Ce montant est un sous-ensemble du budget global du projet.