Periodic Reporting for period 3 - VirtualGrasp (Speeding up the virtual reality revolution with realistic & real-time animation of hand-to-object interaction)
Berichtszeitraum: 2020-11-01 bis 2021-04-30
A - VR training
While learning by doing has been proven as the most efficient way to learn practical tasks, staff in manufacturing industry often cannot practice on the machines due to the high costs and dangers. VirtualGrasp allows machine operators to practice hands-on training in a safe virtual environment and to train emergency responses. It also allows to stage situations that are expensive and difficult-to-simulate in real-life. By introducing a standardized technology to enable hand interactions for training purposes, Gleechi is significantly reducing the time it takes to create VR training applications as well as increasing the quality of the training experience.
B – Stroke rehabilitation
One of the key reasons for why people struggle to recover from stroke is because of lack of motivation to travel to rehabilitation centers and perform repetitive rehabilitation exercises. By allowing stroke survivors to perform rehabilitation exercises with the help of virtual reality, the rehabilitation is made accessible and motivating. In a VR-based rehabilitation application, users can do exercises in a gamified environment.
C – VR games
Hands are notoriously difficult and time-consuming to animate in 3D video games, and many of the developers settle with unrealistically looking hands, with fingers protruding objects, or pre-animate a limited number of grasps, restricting the user from naturally interacting with the environment. VirtualGrasp solves the problem of accurate hand visualization and hand-to-object interaction and makes it easy to apply for any interactive VR game.
VR training: The work has been focused on implementation of VirtualGrasp for industry training applications, including evaluation of the results, improvement of the technology, and preparation for commercial exploitation. The demand among industry companies is growing rapidly and the segment has been verified to be ready for accelerated growth. We have now started to sell the software solution to enable easy creation of interactive VR training towards several multinational industrial clients.
Stroke rehabilitation: we have tested and evaluated VirtualGrasp for VR-based stroke rehabilitation together with experts and potential users. The software has been proven to enable specifically hand and finger rehabilitation exercises that has the potential to improve the rehabilitation effect significantly. However, while the market has a strong potential, the COVID-19 pandemic has resulted in a temporary pause of the commercialization process due to several partners in the healthcare industry putting innovation efforts outside of the pandemic on hold.
VR games: We have been integrating VirtualGrasp towards the two major game development engines - Unity and Unreal - and tested them together with VR game developers. We have also improved VirtualGrasp based on the developers’ feedback. The game developers that we have been working with have identified that high-quality animations are a must-have for their applications to be successful.
The product, results of research and results from successful client collaborations has been shared through our website as well as several conferences and articles.
For stroke rehabilitation, we have implemented VirtualGrasp for VR-based rehabilitation applications and concluded based on our studies that rehabilitation with VR and with empowered movement capabilities has the potential to speed up the rehabilitation process. Although competitive VR rehabilitation approaches exist, VirtualGrasp is the only solution available for predicting and visualizing fine finger movement and accurate grasping. With VirtualGrasp, limited movement from patients’ hands are amplified to make them able to use their virtual hands perfectly. Studies have shown that visually amplified movement can significantly improve the rehabilitation effect. By enabling stroke rehabilitation for the hands, we will enable millions of people who suffer from stroke every year to perform more convenient stroke rehabilitation from their home and return to normal life.
For VR games, VirtualGrasp has been tested, improved and packaged to be used by developers. The software has been proven to both speed up implementation of natural interaction, and enhance the virtual experience for the end-user.