This study presents a real-time hand tracking and collision detection system for immersive mixed-reality boxing training on Apple Vision Pro (Apple Inc., Cupertino, CA, USA). Leveraging the device`s advanced spatial computing capabilities, this research addresses the limitations of traditional fitness applications that lack precision for technique-based sports like boxing with visual-only hand tracking. The system is designed to provide objective feedback by recognizing boxing-specific gestures with sub-centimeter accuracy and validating biomechanical correctness during punch execution. A three-stage pipeline consisting of geometric filtering, biomechanical validation, and punch technique assessment rejects accidental or improper motions. Experimental evaluation involving 12 participants demonstrated a gesture recognition accuracy of 96.3% and a technique validation accuracy of 88.5%. The system consistently operated at 60 FPS with low latency and high robustness across diverse lighting conditions. These results indicate the potential of Apple Vision Pro as a platform for precision sports training and highlight the educational impact of mixed reality in democratizing access to high-quality boxing instruction. The proposed framework is extensible to other skill-based sports requiring fine motor control and real-time feedback.
© Copyright 2025 Sensors. All rights reserved.