Synthesising 2D videos from 3D data: enlarging sparse 2D video datasets for machine learning applications
(Synthese von 2-D-Videos aus 3-D-Daten: Vergrößerung spärlicher 2-D-Videodatensätze für Anwendungen des maschinellen Lernens)
This study outlines a technique to repurpose widely available high resolution three-dimensional (3D) motion capture data for training a machine learning model to estimate the ground reaction forces from two-dimensional (2D) pose estimation keypoints. Keypoints describe anatomically related landmarks in 2D image coordinates. The landmarks can be calculated from 3D motion capture data and projected to different image planes, serving to synthesise a near-infinite number of 2D camera views. This highly efficient method of synthesising 2D camera views can be used to enlarge sparse 2D video databases of sporting movements. We show the feasibility of this approach using a sidestepping dataset and evaluate the optimal camera number and location required to estimate 3D ground reaction forces. The method presented and the additional insights gained from this approach can be used to optimise corporeal data capture by sports practitioners.
© Copyright 2022 ISBS Proceedings Archive (Michigan). Northern Michigan University. Veröffentlicht von International Society of Biomechanics in Sports. Alle Rechte vorbehalten.
| Schlagworte: | |
|---|---|
| Notationen: | Naturwissenschaften und Technik |
| Tagging: | 2D maschinelles Lernen |
| Veröffentlicht in: | ISBS Proceedings Archive (Michigan) |
| Sprache: | Englisch |
| Veröffentlicht: |
Liverpool
International Society of Biomechanics in Sports
2022
|
| Online-Zugang: | https://commons.nmu.edu/isbs/vol40/iss1/121/ |
| Jahrgang: | 40 |
| Heft: | 1 |
| Seiten: | Article 121 |
| Dokumentenarten: | Kongressband, Tagungsbericht |
| Level: | hoch |