Objective
Nowadays, some of the obstacles that impede to blind people to have access to the computer applications are being solved with the use of screen reader software, speech synthesisers, Braille displays or haptic mouses (2D). However there is an inaccessible field yet for them: the 3D computer graphics. The main aim of the project is to eliminate this barrier allowing blind people to access to the 3D graphic computer world through the sense of touch and with audio help, by means of a new Haptic Virtual Environment (HVE). In addition to display the images of a 3D object, the proposed HVE would allow the user to feel with his fingers the shape and tactile surface properties of the virtual object as if he was manipulating a real mock-up of the object. This would be achieved implementing a new Haptic Interface specifically developed to touch 3D virtual objects both with the thumb and the index fingertips while moving the hand in a desktop workspace. The new HVE could serve to develop a great number of training, learning and entertainment systems like the utilities proposed in the project: a training system for the recognition of virtual maps of cities, a system for education and reinforcement of the auditory memory and an application for the development of 3D Haptic Graphical User Interfaces (GUIs) through virtual buttons.
DESCRIPTION OF WORK
The proposed HVE is based on the integration of:
- a new force feedback haptic interface (HI): capable of replicating independent force vectors at the thumb and the index tip (the simultaneous contact of these fingers with the object would facilitate to the user the recognition of the shape of the objects), with a workspace covering a large part of the user desktop and with a high force feedback fidelity to perceive tiny geometrical details of the objects. A device with such characteristics does not exist in the state-of-the-art. Therefore its development is strategic and would allow fulfilling an existing user need that is found also in other applications.
- a new haptic geometric modeller based on an existing geometric modeller (developed by one of the partners) and 2 additional modules to: provide sound aids and allow the interaction among the user, the new HI and any 3D virtual object.
The HVE could serve to develop multiple applications in different fields, but the project focuses on 3 specific utilities selected for their promising positive impact on the life quality of blind people:
- Training system for the recognition of virtual maps of cities to allow the user to move within a virtual map through the sense of touch and with audio help. He could recognise the shape, size and location of their different components (streets, houses, bus, etc.) and get a mental image of the map that would be of great aid during his real walking.
- System for the education and reinforcement of the auditory memory (Master Mind game) to allow the user to play the Master Mind game, not only as an entertainment but also with pedagogic purposes. The adaptation of this game, substituting colours by geometric shapes associated to different sounds, would allow the user to interact with virtual objects and share with them information regarding the objects' shape and sound. It would be very useful in training users auditory memory and the shape recognition.
- Application for the development of 3D Haptic GUIs through virtual buttons to allow developing GUIs based on haptic exploration of virtual icons-buttons instead of using the mouse (a great obstacle for blind people). In order to execute a command the user should "touch and push" the corresponding virtual button. The new HVE and its applications would be tested by a great number of people with different vision problems and profiles and a quantitative analysis of the level of user satisfaction would be performed at the end of the project.
MILESTONES
M12- prototype 1: mock-up and drawings of the HI, interface sound and utilities to generate virtual maps
M18- prototype 2: first full functionality model of HI, haptic exploration of objects and 3D haptic GUI
M30- final prototype: engineering model of the HI, recognition of virtual maps and virtual game. The main expected result is a new HVE that allows blind people to access to the 3D graphic computer world through the sense of touch and with audio help. In the future, this HVE could also be used to develop multiple applications.
Fields of science (EuroSciVoc)
CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques.
CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques.
- natural sciencescomputer and information sciencessoftware
- engineering and technologymaterials engineeringcolors
- medical and health scienceshealth sciencesinfectious diseasesRNA virusesHIV
You need to log in or register to use this function
Topic(s)
Data not availableCall for proposal
Data not availableFunding Scheme
CSC - Cost-sharing contractsCoordinator
48160 DERIA
Spain