Real-time hand tracking and collision detection for immersive mixed-reality boxing training on Apple Vision Pro

(Echtzeit-Handtracking und Kollisionserkennung für ein immersives Mixed-Reality-Boxtraining auf der Apple Vision Pro)

This study presents a real-time hand tracking and collision detection system for immersive mixed-reality boxing training on Apple Vision Pro (Apple Inc., Cupertino, CA, USA). Leveraging the device`s advanced spatial computing capabilities, this research addresses the limitations of traditional fitness applications that lack precision for technique-based sports like boxing with visual-only hand tracking. The system is designed to provide objective feedback by recognizing boxing-specific gestures with sub-centimeter accuracy and validating biomechanical correctness during punch execution. A three-stage pipeline consisting of geometric filtering, biomechanical validation, and punch technique assessment rejects accidental or improper motions. Experimental evaluation involving 12 participants demonstrated a gesture recognition accuracy of 96.3% and a technique validation accuracy of 88.5%. The system consistently operated at 60 FPS with low latency and high robustness across diverse lighting conditions. These results indicate the potential of Apple Vision Pro as a platform for precision sports training and highlight the educational impact of mixed reality in democratizing access to high-quality boxing instruction. The proposed framework is extensible to other skill-based sports requiring fine motor control and real-time feedback.
© Copyright 2025 Sensors. Alle Rechte vorbehalten.

Bibliographische Detailangaben
Schlagworte:
Notationen:Kampfsportarten Naturwissenschaften und Technik
Tagging:virtuelle Realität virtuell
Veröffentlicht in:Sensors
Sprache:Englisch
Veröffentlicht: 2025
Online-Zugang:https://doi.org/10.3390/s25164943
Jahrgang:25
Heft:16
Seiten:4943
Dokumentenarten:Artikel
Level:hoch