Adversarial learning for mono- or multi-modal registration

  • Fan, Jingfan
  • Cao, Xiaohuan
  • Wang, Qian
  • Yap, Pew-Thian
  • Shen, Dinggang
Citations

WEB OF SCIENCE

145
Citations

SCOPUS

169

초록

This paper introduces an unsupervised adversarial similarity network for image registration. Unlike existing deep learning registration methods, our approach can train a deformable registration network without the need of ground-truth deformations and specific similarity metrics. We connect a registration network and a discrimination network with a deformable transformation layer. The registration network is trained with the feedback from the discrimination network, which is designed to judge whether a pair of registered images are sufficiently similar. Using adversarial training, the registration network is trained to predict deformations that are accurate enough to fool the discrimination network. The proposed method is thus a general registration framework, which can be applied for both mono-modal and multi-modal image registration. Experiments on four brain MRI datasets and a multi-modal pelvic image dataset indicate that our method yields promising registration performance in accuracy, efficiency and generalizability compared with state-of-the-art registration methods, including those based on deep learning. (C) 2019 Elsevier B.V. All rights reserved.

키워드

Deformable image registrationFully convolutional neural networkGenerative adversarial networkDIFFEOMORPHIC IMAGE REGISTRATIONALIGNMENTROBUSTDEMONS
제목
Adversarial learning for mono- or multi-modal registration
저자
Fan, JingfanCao, XiaohuanWang, QianYap, Pew-ThianShen, Dinggang
DOI
10.1016/j.media.2019.101545
발행일
2019-12
유형
Article; Proceedings Paper
저널명
Medical Image Analysis
58