Assessment of knee pain from MR imaging using a convolutional Siamese network
- PDF / 2,357,327 Bytes
- 11 Pages / 595.276 x 790.866 pts Page_size
- 25 Downloads / 149 Views
IMAGING INFORMATICS AND ARTIFICIAL INTELLIGENCE
Assessment of knee pain from MR imaging using a convolutional Siamese network Gary H. Chang 1 & David T. Felson 2,3 & Shangran Qiu 1 & Ali Guermazi 4 & Terence D. Capellini 5,6 & Vijaya B. Kolachalama 1,7,8,9 Received: 20 November 2019 / Revised: 2 January 2020 / Accepted: 15 January 2020 # European Society of Radiology 2020
Abstract Objectives It remains difficult to characterize the source of pain in knee joints either using radiographs or magnetic resonance imaging (MRI). We sought to determine if advanced machine learning methods such as deep neural networks could distinguish knees with pain from those without it and identify the structural features that are associated with knee pain. Methods We constructed a convolutional Siamese network to associate MRI scans obtained on subjects from the Osteoarthritis Initiative (OAI) with frequent unilateral knee pain comparing the knee with frequent pain to the contralateral knee without pain. The Siamese network architecture enabled pairwise learning of information from two-dimensional (2D) sagittal intermediate-weighted turbo spin echo slices obtained from similar locations on both knees. Class activation mapping (CAM) was utilized to create saliency maps, which highlighted the regions most associated with knee pain. The MRI scans and the CAMs of each subject were reviewed by an expert radiologist to identify the presence of abnormalities within the model-predicted regions of high association. Results Using 10-fold cross-validation, our model achieved an area under curve (AUC) value of 0.808. When individuals whose knee WOMAC pain scores were not discordant were excluded, model performance increased to 0.853. The radiologist review revealed that about 86% of the cases that were predicted correctly had effusion-synovitis within the regions that were most associated with pain. Conclusions This study demonstrates a proof of principle that deep learning can be applied to assess knee pain from MRI scans. Key Points • Our article is the first to leverage a deep learning framework to associate MR images of the knee with knee pain. • We developed a convolutional Siamese network that had the ability to fuse information from multiple two-dimensional (2D) MRI slices from the knee with pain and the contralateral knee of the same individual without pain to predict unilateral knee pain. • Our model achieved an area under curve (AUC) value of 0.808. When individuals who had WOMAC pain scores that were not discordant for knees (pain discordance < 3) were excluded, model performance increased to 0.853. Keywords Knee . Osteoarthritis . Pain . Magnetic resonance imaging . Machine learning
Abbreviations AUC Area under curve
BMI BML
* Vijaya B. Kolachalama [email protected]
4
Department of Radiology, Boston University School of Medicine, Boston, MA 02118, USA
5
Department of Human Evolutionary Biology, Harvard University, Cambridge, MA 02138, USA
6
Broad Institute of MIT and Harvard, Cambridge, MA 02142, USA
7
Whitaker Cardiovascular I
Data Loading...
