Real-time hand tracking and collision detection for immersive mixed-reality boxing training on Apple Vision Pro
(Echtzeit-Handtracking und Kollisionserkennung für ein immersives Mixed-Reality-Boxtraining auf der Apple Vision Pro)
This study presents a real-time hand tracking and collision detection system for immersive mixed-reality boxing training on Apple Vision Pro (Apple Inc., Cupertino, CA, USA). Leveraging the device`s advanced spatial computing capabilities, this research addresses the limitations of traditional fitness applications that lack precision for technique-based sports like boxing with visual-only hand tracking. The system is designed to provide objective feedback by recognizing boxing-specific gestures with sub-centimeter accuracy and validating biomechanical correctness during punch execution. A three-stage pipeline consisting of geometric filtering, biomechanical validation, and punch technique assessment rejects accidental or improper motions. Experimental evaluation involving 12 participants demonstrated a gesture recognition accuracy of 96.3% and a technique validation accuracy of 88.5%. The system consistently operated at 60 FPS with low latency and high robustness across diverse lighting conditions. These results indicate the potential of Apple Vision Pro as a platform for precision sports training and highlight the educational impact of mixed reality in democratizing access to high-quality boxing instruction. The proposed framework is extensible to other skill-based sports requiring fine motor control and real-time feedback.
© Copyright 2025 Sensors. Alle Rechte vorbehalten.
| Schlagworte: | |
|---|---|
| Notationen: | Kampfsportarten Naturwissenschaften und Technik |
| Tagging: | virtuelle Realität virtuell |
| Veröffentlicht in: | Sensors |
| Sprache: | Englisch |
| Veröffentlicht: |
2025
|
| Online-Zugang: | https://doi.org/10.3390/s25164943 |
| Jahrgang: | 25 |
| Heft: | 16 |
| Seiten: | 4943 |
| Dokumentenarten: | Artikel |
| Level: | hoch |