Human-Computer Interaction

Immersive Desktop - Hand Tracking

This project is already completed.


Hand Tracking is becoming more popular in immersive virtual reality (VR) with head-mounted displays (HMD). Devices like the Oculus Quest or the Varjo allow users to interact with their real hands in virtual environments. This interaction technique offers new possibilities for more natural interaction in virtual worlds.

However, not everyone has access to an HMD due to various reasons, and social VR is expected to support a wide range of diverse devices such as desktop PCs. Recent research has shown, that VR Controllers can improve the experience of a desktop user by giving him more control over the interaction with the virtual environment.

The next consequent step of these findings is to implement hand tracking for desktop users in virtual environments. There are already different solutions for hand tracking out there. Focusing on the real-time and the low-budget hardware aspects, building on top of a solution like media pipe could be a feasible approach.


The topic will focus on the following tasks:


Contact Persons at the University Würzburg

Christian Merz (Primary Contact Person)
Mensch-Computer-Interaktion, Universität Würzburg

Christopher Göttfert
Mensch-Computer-Interaktion, Universität Würzburg

Marc Erich Latoschik
Mensch-Computer-Interaktion, Universität Würzburg

Legal Information