Regarding law and policy, WP2 has clarified the situation of people with deafblindness and other disabilities across 5 EU countries in relation to new technologies. The need for protection from exploitation and manipulation was highlighted and specific measures to ensure the uptake of opportunities as users of new technologies by these groups. For example, exemptions to permit the use of face recognition and biometric identification have been recommended to policymakers, together with the need for continuing involvement of people with disabilities and the scope for further technical development. The work has been linked to current developments to ensure it is timely and relevant.
Regarding visual analysis (WP3) we have developed algorithms for real-time detection and recognition of objects, faces, scenes high accuracy using sophisticated dimensionality reduction and machine learning approaches running both on sophisticated servers and on onboard Raspberry Pi device. With respect to semantics, we have developed a full-fledged ontology-based model that can very flexibly represent various aspects and respond to users queries with natural language which can be then converted to haptograms and be conveyed to the user. Moreover, we have successfully integrated the two components which also comprises great progress beyond state of the art approaches for environment cues perception.
WP4 achieved proper selection and implementation of sensors for location and depth sensing and computer vision that are suitable for being worn, and development of a modular mini-computer based system for using them; implemented a ROS- and MQTT-based communication system to enable modular communication with sensors and processors both on and off the garment; mounted and tested sensors and algorithms developed.
With regards to psychophysical testing (WP6):
- We completed and published 2 extensive literature overviews (one on thermal devices and one on haptic communication devices) to provide all partners (and the international haptic community) with the necessary background knowledge; a third one on haptic navigation is made internally available, but will be submitted to a journal at a later stage.
- In several studies we gathered fundamental knowledge on how well humans can perceive vibrotactile patterns that are envisioned to be used with the HIPI.
- We produced a list of recommendations for the design of haptic vibration patterns.
- We made and tested a first version of an app that can be used to learn SHC. We received positive feedback from a person with deafblindness.
WP7 achieved the following results and impacts:
- We now have a much better understanding of the concept of play and playfulness of persons with deafblindness
- We derived concepts of gamified scenarios tailored to individuals with deafblindness, designed to enrich experiences, gamify learning of HIPI and enhance social experiences.
- We implemented several gamified concepts for individuals with deafblindness (e.g. Easter-Egg-Hunt-Scenario, Follow-your-Partner-Scenario).
- In several studies we gathered knowledge on how humans with deafblindness can playfully interact with vibrotactile patterns.
- We developed the tactile board, a multimodal augmentative communication device for individuals with deafblindness.
In WP8, dissemination and exploitation, we reached a broad target audience of various stakeholders (research, industry, interest-groups, general public) through various means, such as the website, newsletters, social media presence and various events or fair participation. This helped increase project awareness.
