Synthesising 2D videos from 3D data: enlarging sparse 2D video datasets for machine learning applications

(Synthese von 2-D-Videos aus 3-D-Daten: Vergrößerung spärlicher 2-D-Videodatensätze für Anwendungen des maschinellen Lernens)

This study outlines a technique to repurpose widely available high resolution three-dimensional (3D) motion capture data for training a machine learning model to estimate the ground reaction forces from two-dimensional (2D) pose estimation keypoints. Keypoints describe anatomically related landmarks in 2D image coordinates. The landmarks can be calculated from 3D motion capture data and projected to different image planes, serving to synthesise a near-infinite number of 2D camera views. This highly efficient method of synthesising 2D camera views can be used to enlarge sparse 2D video databases of sporting movements. We show the feasibility of this approach using a sidestepping dataset and evaluate the optimal camera number and location required to estimate 3D ground reaction forces. The method presented and the additional insights gained from this approach can be used to optimise corporeal data capture by sports practitioners.
© Copyright 2022 ISBS Proceedings Archive (Michigan). Northern Michigan University. Veröffentlicht von International Society of Biomechanics in Sports. Alle Rechte vorbehalten.

Bibliographische Detailangaben
Schlagworte:
Notationen:Naturwissenschaften und Technik
Tagging:2D maschinelles Lernen
Veröffentlicht in:ISBS Proceedings Archive (Michigan)
Sprache:Englisch
Veröffentlicht: Liverpool International Society of Biomechanics in Sports 2022
Online-Zugang:https://commons.nmu.edu/isbs/vol40/iss1/121/
Jahrgang:40
Heft:1
Seiten:Article 121
Dokumentenarten:Kongressband, Tagungsbericht
Level:hoch