Utilizing mask R-CNN for waterline detection in canoe sprint video analysis

Determining a waterline in images recorded in canoesprint training is an important component for the kinematic parameter analysis to assess an athlete`s performance. Here, we propose an approach for the automated waterline detection. First, we utilized a pre-trained MaskR-CNN by means of transfer learning for canoe segmentation. Second, we developed a multi-stage approach to estimate a waterline from the outline of the segments. It consists of two linear regression stages and the systematic selection of canoe parts. We then introduced a parameterization of the waterline as a basis for further evaluations. Next, we conducted a study among several experts to estimate the ground truth waterlines. This not only included an average waterline drawn from the individual experts annotations but, more importantly, a measure for the uncertainty between individual results. Finally, we assessed ourmethod with respect to the question whether the predicted waterlines are in accordance with the experts annotations.Our method demonstrated a high performance and provides opportunities for new applications in the field of automated video analysis in canoe sprint.
© Copyright 2020 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). Published by IEEE. All rights reserved.

Bibliographic Details
Subjects:
Notations:endurance sports technical and natural sciences
Tagging:maschinelles Lernen
Published in:2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
Language:English
Published: Piscataway, NJ IEEE 2020
Online Access:https://ieeexplore.ieee.org/document/9151040
Pages:3826-3835
Document types:article
Level:advanced