Multi-region saliency-aware learning for cross-domain placenta image segmentation

Zhuomin Zhang, Dolzodmaa Davaasuren, Chenyan Wu, Jeffery A. Goldstein, Alison D. Gernand, James Z. Wang

Research output: Contribution to journalArticlepeer-review

Abstract

We propose a multi-region saliency-aware learning (MSL) method for cross-domain placenta image segmentation. Unlike most existing image-level transfer learning methods that fail to preserve the semantics of paired regions, our MSL incorporates the attention mechanism and a saliency constraint into the adversarial translation process, which can realize multi-region mappings in the semantic level. Specifically, the built-in attention module serves to detect the most discriminative semantic regions that the generator should focus on. Then we use the attention consistency as another guidance for retaining semantics after translation. Furthermore, we exploit the specially designed saliency-consistent constraint to enforce the semantic consistency by requiring the saliency regions unchanged. We conduct experiments using two real-world placenta datasets we have collected. We examine the efficacy of this approach in (1) segmentation and (2) prediction of the placental diagnoses of fetal and maternal inflammatory response (FIR, MIR). Experimental results show the superiority of the proposed approach over the state of the art.

Original languageEnglish (US)
Pages (from-to)165-171
Number of pages7
JournalPattern Recognition Letters
Volume140
DOIs
StatePublished - Dec 2020

All Science Journal Classification (ASJC) codes

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Multi-region saliency-aware learning for cross-domain placenta image segmentation'. Together they form a unique fingerprint.

Cite this