Patterns 2022

Brain Metastases Classification

A Transformer-Based Deep-Learning Approach for Classifying Brain Metastases into Primary Organ Sites Using Clinical Whole-Brain MRI Images

Qing Lyu, Sanjeev V. Namjoshi, Emory McTyre, Umit Topaloglu, Richard Barcus, Michael D. Chan, Christina K. Cramer, Waldemar Debinski, Metin N. Gurcan, Glenn J. Lesser, Hui-Kuan Lin, Reginald F. Munden, Boris C. Pasche, Kiran K. S. Sai, Roy E. Strowd, Stephen B. Tatter, Kounosuke Watabe, Wei Zhang, Ge Wang, Christopher T. Whitlow

Current or former lab member. Select a name to see all of their projects.

Method overview of Brain Metastases Classification
Workflow of the approach and selection of the data, from the paper.

Abstract

Treatment decisions for brain metastases depend on the primary organ site, which today is identified by biopsy and histology. This work builds an end-to-end deep-learning workflow on clinical whole-brain MRI. It segments the tumors, transfers image modality, and classifies each case into one of five primary-site classes.

The workflow was evaluated on 1,582 preprocessed contrast-enhanced T1-weighted MRI exams. Tenfold cross-validation gave an overall AUC of 0.878 (95% CI 0.873 to 0.883), suggesting the approach could become a non-invasive tool for identifying primary cancer sites.

What’s in the repository

  • The segmentation network
  • A CycleGAN for modality transfer
  • The classification network

Citation

@article{lyu2022transformer,
  title   = {A Transformer-Based Deep-Learning Approach for Classifying Brain Metastases into Primary Organ Sites Using Clinical Whole-Brain MRI Images},
  author  = {Lyu, Qing and Namjoshi, Sanjeev V. and McTyre, Emory and Topaloglu, Umit and Barcus, Richard and Chan, Michael D. and Cramer, Christina K. and Debinski, Waldemar and Gurcan, Metin N. and Lesser, Glenn J. and Lin, Hui-Kuan and Munden, Reginald F. and Pasche, Boris C. and Sai, Kiran K. S. and Strowd, Roy E. and Tatter, Stephen B. and Watabe, Kounosuke and Zhang, Wei and Wang, Ge and Whitlow, Christopher T.},
  journal = {Patterns},
  volume  = {3},
  number  = {11},
  pages   = {100613},
  year    = {2022},
  doi     = {10.1016/j.patter.2022.100613}
}
Back to projects