ARMO: Automated and Reliable Multi-Objective Model for Lymph Node Metastasis Prediction in Head and Neck Cancer

Authors

Zhiguo Zhou
Liyuan Chen
Michael Dohopolski
David Sher
Jing Wang

Language

English

Publication Date

4-25-2023

Journal

Physics in Medicine and Biology

DOI

10.1088/1361-6560/acca5b

PMID

37017082

PMCID

PMC11034768

PubMedCentral® Posted Date

4-25-2024

PubMedCentral® Full Text Version

Author MSS

Abstract

Objective:

Accurate diagnosis of lymph node metastasis (LNM) is critical in treatment management for patients with head & neck cancer. Positron emission tomography (PET) and computed tomography (CT) are routinely used for identifying LNM status. However, for small or less fluorodeoxyglucose (FDG) avid nodes, there are always uncertainties in LNM diagnosis. We are aiming to develop a reliable prediction model is for identifying LNM.

Approach:

In this study, a new automated and reliable multi-objective learning model (ARMO) is proposed. In ARMO, a multi-objective model is introduced to obtain balanced sensitivity and specificity. Meanwhile, confidence is calibrated by introducing individual reliability, whilst the model uncertainty is estimated by a newly defined overall reliability in ARMO. In the training stage, a Pareto-optimal model set is generated. Then all the Pareto-optimal models are used, and a reliable fusion strategy that introduces individual reliability is developed for calibrating the confidence of each output. The overall reliability is calculated to estimate the model uncertainty for each test sample.

Main Results:

The experimental results demonstrated that ARMO obtained more promising results, which the area under the curve (AUC), accuracy, sensitivity and specificity can achieve 0.97, 0.93, 0.88 and 0.94, respectively. Meanwhile, based on calibrated confidence and overall reliability, clinicians could pay particular attention to highly uncertain predictions.

Significance:

In this study, we developed a unified model that can achieve balanced prediction, confidence calibration and uncertainty estimation simultaneously. The experimental results demonstrated that ARMO can obtain accurate and reliable prediction performance.

Keywords

Humans, Positron Emission Tomography Computed Tomography, Lymphatic Metastasis, Reproducibility of Results, Lymph Nodes, Head and Neck Neoplasms, Retrospective Studies, Lymph node metastasis, Confidence calibration, Uncertainty estimation, Balanced sensitivity and specificity, Reliability, Evidential reasoning rule

Published Open-Access

yes

Recommended Citation

Zhou, Zhiguo; Chen, Liyuan; Dohopolski, Michael; et al., "ARMO: Automated and Reliable Multi-Objective Model for Lymph Node Metastasis Prediction in Head and Neck Cancer" (2023). Faculty, Staff and Student Publications. 6680.
https://digitalcommons.library.tmc.edu/uthgsbs_docs/6680