Online training for body part segmentation in infant movement videos

Qian Zhang, Yuan Xue, Xiaolei Huang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper, we investigate methods based on Convolutional Neural Networks (CNN) and online learning for infant body part segmentation in videos. Long videos of infant movement can be used to detect abnormal neurological development caused by various reasons. In order to perform movement analysis and assist with diagnosis, it is crucial to accurately segment infant body parts in videos. Existing CNN based segmentation methods can perform reasonably well given sufficient training data, but cannot reach an accuracy level that is needed for clinical use. We propose and experimentally validate three methods that significantly improve segmentation accuracy and efficiency: (1) content-dependent training sample selection reduces the amount of training data needed while boosts segmentation accuracy, (2) a weighted loss function with different weights for different body parts is shown to both improve accuracy and reduce computation time, (3) online learning by dynamically augmenting the training set with a small number of sample frames from new videos significantly improves testing accuracy on the new videos. Our experiments are conducted on infant movement videos that exhibit large variations in object pose, shape, appearance, background and camera viewpoints. Both qualitative segmentation results and quantitative comparisons demonstrate the superiority and efficiency of our proposed approach.

Original languageEnglish (US)
Title of host publicationISBI 2019 - 2019 IEEE International Symposium on Biomedical Imaging
PublisherIEEE Computer Society
Pages489-492
Number of pages4
ISBN (Electronic)9781538636411
DOIs
StatePublished - Apr 2019
Event16th IEEE International Symposium on Biomedical Imaging, ISBI 2019 - Venice, Italy
Duration: Apr 8 2019Apr 11 2019

Publication series

NameProceedings - International Symposium on Biomedical Imaging
Volume2019-April
ISSN (Print)1945-7928
ISSN (Electronic)1945-8452

Conference

Conference16th IEEE International Symposium on Biomedical Imaging, ISBI 2019
CountryItaly
CityVenice
Period4/8/194/11/19

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Biomedical Engineering
  • Radiology Nuclear Medicine and imaging

Cite this

Zhang, Q., Xue, Y., & Huang, X. (2019). Online training for body part segmentation in infant movement videos. In ISBI 2019 - 2019 IEEE International Symposium on Biomedical Imaging (pp. 489-492). [8759374] (Proceedings - International Symposium on Biomedical Imaging; Vol. 2019-April). IEEE Computer Society. https://doi.org/10.1109/ISBI.2019.8759374