The novel hardware & software components developed further advances the world of Smart and Connected Things. They enable secure & healthy Human-Machine Interfaces (HMIs) by improved communication not only between humans, but also between humans and all kinds of smart devices, by means of ultrasound gesture recognition, voice recognition and speech control and/or haptic feedback.
Regarding transducer technologies a big step beyond SToA was made with micromachined transducers that become available especially for (ultrasound-) loudspeakers. SILENSE low power, high bandwidth transducer devices were demonstrated, enabling applications envisioned by the SILENSE use cases. Another SILENSE realization in the transducer area is the demonstration of large arrays (up to several cm², with up to 1000 elements) on glass or flexible substrates, suitable for a broad range of applications (fine gesture recognition, haptic feedback, medical imaging,...). Concurrently novel electronics interfaces that can integrate multiple operations (i.e. sound and ultrasound) have been developed and verified for both ultrasound emission (smart amplifiers) and detection activities (microphones with ultrasound functionalities). For heterogeneous systems built from discrete components (transducers and corresponding ICs), a Roll-to-Roll manufacturing process on flexible substrates was developed, allowing for a variety of applications. In order to avoid substrates after all and to achieve a high degree of integration and thus miniaturization, a modified FOWLP approach was developed, which allows for integration of even the most delicate cMUTs with fragile membranes.
SILENSE improved state of the art for acoustic localisation and communication methods, as illustrated in several demonstrators for underwater communication. In terms of action and gesture recognition, SILENSE advanced significantly the knowledge related to usage of deep learning models, ranging from simple and fast to recognize actions to very complex gestures.
The potential of the developed technologies has been demonstrated in a wide range of applications, such as wearables (including underwater wearables), smart homes and automotive. The SILENSE consortium developed 9 different demonstrators for these markets, which were validated in relevant scenarios reaching TRLs 5-6.
These novel applications will bring many benefits to the general public, ranging from enhanced user experience to improved health and safety. Enhanced safety by touchless control is a highly relevant aspect as is security by gestural authentication as it increases robustness of authentication scenarios. In the present COVID-19 situation, the use of ultrasound gesture control can be applied in touchless control of devices both in everyday life, work as well as health care centres, to help in containing the spread of the virus. SILENSE research and results allow enhancing the quality of life for all people.
