News

Human-machine collaboration in industry

2 February 2024
XR-Robot en la Industria_Tecnalia

“TECNALIA presents an innovative convergence between extended reality (XR) and industrial robots”

Join the XR-Robot symbiosis in industry: human-machine collaboration

TECNALIA presents an innovative convergence between extended reality (XR) and industrial robots, highlighting a practical and efficient approach to human-machine interaction. To demonstrate this, the user, equipped with a Meta Quest Pro device, intuitively collaborates with a UR20 robot arm. This experience allows the user to virtually outline the area to be polished on a real part, taking full advantage of the capabilities of these XR devices for clear, efficient communication with the virtual environment. The strategic use of XR technology not only simplifies delineation tasks, but also optimises communication between the user and the robot arm. This approach not only represents a technical breakthrough, but also marks a concrete way towards efficiency in industrial automation. Human-machine collaboration, powered by extended reality, is the key to a future where precision and agility set the standard for interaction with industrial machinery.

A user interacting with a UR20 robot arm using a Quest device

TECNALIA's Core Visual team looks at reality and virtuality as a continuous space, connecting people, data and interaction with diverse, innovative tools, making use of its extensive experience in deep learning techniques for image understanding and their application. The group is exploring approaches for overcoming the scarcity of annotated data, with techniques such as self-supervised learning and synthetic data. It is also looking to extend these techniques to non-conventional capture devices such as 3D, Raman, spectroscopy and hyperspectral imaging, moving beyond the paradigm of supervised learning on RGB images. The video shows how a user can interact with a UR20 robot arm using a Quest device to virtually indicate the area to be polished on a real part. This project demonstrates the advantages of extended reality for human-machine interaction, which facilitates precision and agility in industrial processes.

More information on the European CONVERGING initiative