Skip to main content

Glove-Like Advanced Interface for the Control of Manipulative and Exploratory Procedures in Artificial Realities

Objective

GLAD-IN-ART deals with the development of a human-computer interface system conceived for the active control of manipulative procedures represented in computer-generated virtual environments. The interaction device will be an instrumented glove, worn by the human operator and capable of recording the hand's geometrical configuration in the control space.
The glove like advanced interface for the control of manipulative and exploratory procedures in artificial realities (GLAD-IN-ART) project deals with the development of a human computer interface system conceived for the active control of manipulative procedures represented in computer generated images.
The interaction device will be an instrumented glove, worn by the human operator and capable of recording the hand geometrical configuration in the control space. Information about the user's hand configuration can be used for controlling a virtual hand represented in the computer and interacting with the depicted artificial environment. The morphology of such an interface device allows the operator to control the motions of the represented virtual objects in a more natural way without the displacement constraints of current interaction devices. Inside a 3-dimensional control space, the pose of the human operator's wrist is recognized by a purposely developed vision system. The set of video cameras, shooting from fixed locations the user's hand/arm configuration, acquires information which can also be processed in order to implement the concept of gesture interface; the human operator sends commands to the software application by performing appropriate hand/arm gestures.
A further characteristic of the GLAD-IN-ART project is the attempt to introduce components that transmit kinesthetic forces and internal grasping force feedback sensations onto the user's wrists and hands respectively. The introduction of such systems could improve the sensation of reality felt by the user during the manipulative interaction procedure.

At present the design phase of the different GLAD-IN-ART components has been performed. Different solutions for hand proprioceptive sensors have been identified together with possible mechanical solutions for hand force feedback. An integrated workstation comprising both human computer interface and vision system is under development.
The morphology of such an interface device allows the operator to control the motions of the represented virtual objects in a more natural way without the displacement constraints of current interaction devices such as joy-sticks or handballs.

A basic characteristic of the GLAD-IN-ART system is the management of components devoted to replicate kinesthetic force and internal grasping force feedback on the user's wrists and hands espectively. This greately improves the sensation of reality felt by the user during manipulative procedures.

Inside a 3-D control space, the pose of the human operator's wrist is recognised by a purposely developed vision system. The set of video cameras, shooting from fixed locations the user's hand/arm configuration, acquires information which can also be processed in order to implement the concept of gesture interface: the human operator sends commands to the software application by performing appropriate hand/arm gestures.

The system is actually an integrated set of sub-systems that can be used individually or together in a multiplicity of combinations depending on the nature of the application.

Coordinator

Aitek Srl
Address
Via Assarotti 22-38
16122 Genova
Italy

Participants (4)

SCUOLA SUPERIORE DI STUDI UNIVERSITARI E DI PERFEZIONAMENTO S. ANNA DI PISA
Italy
Address
Piazza Martiri Della Libertà 33
56127 Pisa
Technology Applications Group
United Kingdom
Address
5 Bolams Mill Dispensary Street
NE66 1LN Alnwick
University of Dublin
Ireland
Address
Trinity College
Dublin 2
Video Display Systems Srl
Italy
Address
Via Muzio Clementi 16
50127 Firenze