Decoupling video and human motion: Towards practical event detection in athlete recordings

In this paper we address the problem of motion event detection in athlete recordings from individual sports. In contrast to recent end-to-end approaches, we propose to use 2D human pose sequences as an intermediate representation that decouples human motion from the raw video information. Combined with domain-adapted athlete tracking, we describe two approaches to event detection on pose sequences and evaluate them in complementary domains: swimming and athletics. For swimming, we show how robust decision rules on pose statistics can detect different motion events during swim starts, with a F1 score of over 91% despite limited data. For athletics, we use a convolutional sequence model to infer stride-related events in long and triple jump recordings, leading to highly accurate detections with 96% in F1 score at only +/- 5ms temporal deviation. Our approach is not limited to these domains and shows the flexibility of pose-based motion event detection.
© Copyright 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition. IEEE. All rights reserved.

Bibliographic Details
Subjects:
Notations:strength and speed sports endurance sports technical and natural sciences
Tagging:Posenerkennung
Published in:IEEE/CVF Conference on Computer Vision and Pattern Recognition
Language:English
Published: 2020
Online Access:https://openaccess.thecvf.com/content_CVPRW_2020/html/w53/Einfalt_Decoupling_Video_and_Human_Motion_Towards_Practical_Event_Detection_in_CVPRW_2020_paper.html
Pages:892-893
Document types:article
Level:advanced