At the forefront of modern technological innovation, FrontEndART Ltd. and Zengo Ltd. have jointly launched a research and development project. Forming a micro-consortium, the two companies initiated a 9-month project aimed at developing Unity tools that enable the recording and recognition of complex gestures.
FrontEndART Ltd. has submitted a research and development project covering two trending areas—AI and XR—forming a micro-consortium with Zengo Ltd. The aim of the 9-month project is to develop Unity tools for recording and recognizing complex gestures in order to enhance the creation of educational content for VR applications, particularly in manufacturing robotics. Initially, the project focuses on developing Unity Editor XR tools and a dynamic hand gesture recognition module powered by artificial intelligence. FrontEndART will develop AI algorithms to learn and recognize complex gestures, while Zengo will facilitate communication between the Unity tools and the AI platform.
In the second phase, these tools will be integrated into the MASTER-XR platform to ensure compatibility and seamless operation within the existing infrastructure. The final phase will involve thorough technical validation to verify the accuracy and reliability of gesture recognition. This includes comprehensive testing of the AI algorithms, collecting user feedback, and conducting usability assessments to refine the overall user experience.
The project is progressing in line with the current state of technology by enabling recognition of complex dynamic hand gestures with learning techniques based on only a few samples, achieving high accuracy with just a few practice repetitions. This approach surpasses existing technologies, which primarily recognize static poses or predefined gestures and require extensive repetition for new gesture patterns. The Unity tools under development will enable users to intuitively define new, complex hand gestures, thereby enhancing the functionality of VR applications. The project proposal was submitted on Friday, 31 May, and is expected to be evaluated during the summer. If successful, development will begin on 1 October.
The project initiated by FrontEndART Ltd. and Zengo Ltd. is an innovative step in the advancement of VR technology and could mark significant progress in the development of educational content for manufacturing robotics. With successful implementation, dynamic hand gesture recognition will become possible with just a few practice repetitions, outperforming current technological capabilities.