Skip to main content

Spatially Coordinated Auditory/Tactile Interactive Scenario

Objective

SCATIS is a basic-research project in the area of Virtual Reality and Multimodal Human/Machine Interaction. It provides an advanced laboratory system, SCAT-LAB, for the generation of an interactive virtual auditory/tactile scenario - plus Human Factors research in this scenario. The scenario definition is as follows:

A subject is exposed to a virtual space with various (invisible) auditory/tactile objects distributed in it. He/she will localise and identify these virtual objects auditorily, and be able to reach for them and grasp them individually. Upon tactile contact, contour, texture, and thermal attributes of the virtual objects will be perceived. It is the task of the subject to move the objects around manually, ie to re-arrange their spatial position and orientation according to an experimental plan. Auditory feedback is given.
Research on the following scenario is being carried out: a subject is exposed to a virtual space with various (invisible) auditory and/or tactile objects distributed in it. He or she will localize and identify these virtual objects auditorily, and be able to reach for them and grasp them individually. Upon tactile contact, contour, texture, and thermal attributes of the virtual objects will be perceived. It is the task of the subject to move the objects around manually, to rearrange their spatial position and orientation according to an experimental plan. Auditory feedback is given.

The work is separated into 3 main phases: a definition and specification, implementation, and an integration and evaluation. The definition and specification phase was finished in April 1993 and the first milestone document compiled. To this end a thorough state of the art analysis was carried out dealing with hardware, software, and psychophysics. The architecture of the SCAT-LAB, was defined in terms of logical functionalities and information flow with respect to the interaction of the single SCAT-LAB components. Additionally, the corresponding hardware setup was defined. The logical interfaces between all components of the SCAT-LAB were formulated.

It is planned to describe the interfaces in a high level programming language (C++) and to develop simple prototypes for most of the software components of the SCAT-LAB.
APPROACH AND METHODS

The SCATIS experimental scenario is considered to be representative of a variety of engineering problems in Multi-Media and Virtual-Reality applications with human beings involved in, eg, control, guidance, surveillance, access or evaluation tasks - not to mention training and entertainment. It has been chosen because the auditory and tactile domains are essential for intuitive Human/Machine Interaction, but still lack sufficient exploration with IT engineering in mind. Vision is not addressed in the project to avoid distraction and masking effects due to sensory dominance which might affect selective analysis of the auditory/tactile modalities: however, binocular visors can be interfaced to SCAT-LAB for software verification purposes.

Hardware includes a novel 36-channel binaural processor, a handmounted assembly with novel tactile effectors to transmit contour, texture and thermal information, as well as equipment necessary for tracking head and wrist-palm-fingers position and orientation. Software includes a virtual-world system, renderers, drivers, interfaces, subject monitor, task controller and editor. The complete system runs in real time. As soon as the components and the complete SCAT-LAB become available, multisensory pilot studies in human factors will be conducted. Research issues to be addressed are selected in order to support the construction of interactive VR systems. Towards the end of the current project, a detailed experimental plan for the application of SCAT-LAB in multimodal interactive Human-Factors research will be established.

POTENTIAL

Virtual Reality systems constitute an enabling technology for various applications in modern information technology such as teleconferencing, high-definition tv, robotics (sensing and control), information retrieval, multi-media, and human/computer interaction. This broad technological potential is basically due to the fact that Virtual Reality systems offer the possibility of designing advanced interactive multi-modal human/machine interfaces. The SCATIS consortium is composed of three universities and two SMEs: the universities will disseminate the knowledge and experience gained from this project by means of publication, education and consulting, the SMEs plan on direct exploitation through collaborate product development.

Coordinator

RUHR-UNIVERSITY BOCHUM
Address
Universitätsstraße 150
44780 Bochum
Germany

Participants (4)

AALBORG UNIVERSITET
Denmark
Address
Fibigerstraede, 13
9220 Aalborg East
HEAD Acoustics GmbH
Germany
Address
Kaiserstraße 100
52134 Herzogenrath
SCUOLA SUPERIORE DI STUDI UNIVERSITARI E DI PERFEZIONAMENTO S. ANNA DI PISA
Italy
Address
Piazza Martiri Della Libertà 33
56127 Pisa
Scienzia Machinale Srl
Italy
Address
Via Sancasciani 35-37
56100 Pisa