Objective
Nowadays, some of the obstacles that impede to blind people to have access to the computer applications are being solved with the use of screen reader software, speech synthesisers, Braille displays or haptic mouses (2D). However there is an inaccessible field yet for them: the 3D computer graphics. The main aim of the project is to eliminate this barrier allowing blind people to access to the 3D graphic computer world through the sense of touch and with audio help, by means of a new Haptic Virtual Environment (HVE). In addition to display the images of a 3D object, the proposed HVE would allow the user to feel with his fingers the shape and tactile surface properties of the virtual object as if he was manipulating a real mock-up of the object. This would be achieved implementing a new Haptic Interface specifically developed to touch 3D virtual objects both with the thumb and the index fingertips while moving the hand in a desktop workspace. The new HVE could serve to develop a great number of training, learning and entertainment systems like the utilities proposed in the project: a training system for the recognition of virtual maps of cities, a system for education and reinforcement of the auditory memory and an application for the development of 3D Haptic Graphical User Interfaces (GUIs) through virtual buttons.
DESCRIPTION OF WORK
The proposed HVE is based on the integration of:
- a new force feedback haptic interface (HI): capable of replicating independent force vectors at the thumb and the index tip (the simultaneous contact of these fingers with the object would facilitate to the user the recognition of the shape of the objects), with a workspace covering a large part of the user desktop and with a high force feedback fidelity to perceive tiny geometrical details of the objects. A device with such characteristics does not exist in the state-of-the-art. Therefore its development is strategic and would allow fulfilling an existing user need that is found also in other applications.
- a new haptic geometric modeller based on an existing geometric modeller (developed by one of the partners) and 2 additional modules to: provide sound aids and allow the interaction among the user, the new HI and any 3D virtual object.
The HVE could serve to develop multiple applications in different fields, but the project focuses on 3 specific utilities selected for their promising positive impact on the life quality of blind people:
- Training system for the recognition of virtual maps of cities to allow the user to move within a virtual map through the sense of touch and with audio help. He could recognise the shape, size and location of their different components (streets, houses, bus, etc.) and get a mental image of the map that would be of great aid during his real walking.
- System for the education and reinforcement of the auditory memory (Master Mind game) to allow the user to play the Master Mind game, not only as an entertainment but also with pedagogic purposes. The adaptation of this game, substituting colours by geometric shapes associated to different sounds, would allow the user to interact with virtual objects and share with them information regarding the objects' shape and sound. It would be very useful in training users auditory memory and the shape recognition.
- Application for the development of 3D Haptic GUIs through virtual buttons to allow developing GUIs based on haptic exploration of virtual icons-buttons instead of using the mouse (a great obstacle for blind people). In order to execute a command the user should "touch and push" the corresponding virtual button. The new HVE and its applications would be tested by a great number of people with different vision problems and profiles and a quantitative analysis of the level of user satisfaction would be performed at the end of the project.
MILESTONES
M12- prototype 1: mock-up and drawings of the HI, interface sound and utilities to generate virtual maps
M18- prototype 2: first full functionality model of HI, haptic exploration of objects and 3D haptic GUI
M30- final prototype: engineering model of the HI, recognition of virtual maps and virtual game. The main expected result is a new HVE that allows blind people to access to the 3D graphic computer world through the sense of touch and with audio help. In the future, this HVE could also be used to develop multiple applications.
Fields of science (EuroSciVoc)
CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.
CORDIS classifies projects with EuroSciVoc, a multilingual taxonomy of fields of science, through a semi-automatic process based on NLP techniques. See: The European Science Vocabulary.
- natural sciences computer and information sciences software
- engineering and technology materials engineering colors
- medical and health sciences health sciences infectious diseases RNA viruses HIV
You need to log in or register to use this function
Programme(s)
Multi-annual funding programmes that define the EU’s priorities for research and innovation.
Multi-annual funding programmes that define the EU’s priorities for research and innovation.
Topic(s)
Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.
Data not available
Calls for proposals are divided into topics. A topic defines a specific subject or area for which applicants can submit proposals. The description of a topic comprises its specific scope and the expected impact of the funded project.
Call for proposal
Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.
Data not available
Procedure for inviting applicants to submit project proposals, with the aim of receiving EU funding.
Funding Scheme
Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.
Funding scheme (or “Type of Action”) inside a programme with common features. It specifies: the scope of what is funded; the reimbursement rate; specific evaluation criteria to qualify for funding; and the use of simplified forms of costs like lump sums.
Coordinator
48160 DERIA
Spain
The total costs incurred by this organisation to participate in the project, including direct and indirect costs. This amount is a subset of the overall project budget.