Utilizing mask R-CNN for waterline detection in canoe sprint video analysis

Determining a waterline in images recorded in canoe sprint training is an important component for the kinematic parameter analysis to assess an athlete's performance. Here, we propose an approach for the automated waterline detection. First, we utilized a pre-trained Mask R-CNN by means of transfer learning for canoe segmentation. Second, we developed a multi-stage approach to estimate a waterline from the outline of the segments. It consists of two linear regression stages and the systematic selection of canoe parts. We then introduced a parameterization of the waterline as a basis for further evaluations. Next, we conducted a study among several experts to estimate the ground truth waterlines. This not only included an average waterline drawn from the individual experts annotations but, more importantly, a measure for the uncertainty between individual results. Finally, we assessed our method with respect to the question whether the predicted waterlines are in accordance with the experts annotations. Our method demonstrated a high performance and provides opportunities for new applications in the field of automated video analysis in canoe sprint.
© Copyright 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition. IEEE. All rights reserved.

Bibliographic Details
Subjects:
Notations:strength and speed sports technical and natural sciences
Published in:IEEE/CVF Conference on Computer Vision and Pattern Recognition
Language:English
Published: 2020
Online Access:https://openaccess.thecvf.com/content_CVPRW_2020/html/w53/von_Braun_Utilizing_Mask_R-CNN_for_Waterline_Detection_in_Canoe_Sprint_Video_CVPRW_2020_paper.html
Pages:876-877
Document types:article
Level:advanced