Spatial Transcriptome Reveals Histology-Correlated Immune Signature Learnt by Deep Learning Attention Mechanism on H&E-stained Images for Ovarian Cancer Prognosis

Authors

Chun Wai Ng
Kwong-Kwok Wong
Barrett C Lawson
Sammy Ferri-Borgogno
Samuel C Mok

Publication Date

1-24-2025

Journal

Journal of Translational Medicine

Abstract

Background: The ability to predict the prognosis of patients with ovarian cancer can greatly improve disease management. However, the knowledge on the mechanism of the prediction is limited. We sought to deconvolute the attention feature learnt by a deep learning convolutional neural networks trained with whole-slide images (WSIs) of hematoxylin-and-eosin (H&E)-stained tumor samples using spatial transcriptomic data.

Methods: In this study, 773 WSIs of H&E-stained tumor sections from 335 patients with treatment naïve high-grade serous ovarian cancer who were included in The Cancer Genome Atlas (TCGA) Pan-Cancer study were used to train, and validate, and to test a ResNet101 CNN model modified with attention mechanism. WSIs from patients in an independent cohort were used to further evaluate the model.

Results: The prognostic value of the predicted H&E-based survival scores from the trained model on patient survival was evaluated. The attention signals learnt by the model were then examined their correlation with immune signatures using spatial transcriptome. After validating the model with the testing datasets, pathway enrichment analysis showed that the H&E-based survival score significantly correlated with certain immune signatures and this was validated spatially using spatial transcriptome data generated from ovarian cancer FFPE samples by correlating the selected signature and attention signal.

Conclusions: In conclusion, attention mechanism might be useful to identify regions for their specific immune activities. This could guide future pathological study for the useful immunological features that are important in modulating the prognosis of ovarian cancer patients.

Keywords

Humans, Female, Ovarian Neoplasms, Deep Learning, Prognosis, Transcriptome, Eosine Yellowish-(YS), Staining and Labeling, Hematoxylin, Reproducibility of Results, Attention, Deep learning, H&E, Immune signature, Ovarian cancer, Prognosis, Spatial transcriptome

DOI

10.1186/s12967-024-06007-8

PMID

39856778

PMCID

PMC11761186

PubMedCentral® Posted Date

1-24-2025

PubMedCentral® Full Text Version

Post-print

Published Open-Access

yes