Validation of two models to estimate the probability of malignancy in patients with solitary pulmonary nodules

Background: Effective strategies for managing patients with solitary pulmonary nodules (SPN) depend critically on the pre-test probability of malignancy. Objective: To validate two previously developed models that estimate the probability that an indeterminate SPN is malignant, based on clinical characteristics and radiographic findings. Methods: Data on age, smoking and cancer history, nodule size, location and spiculation were collected retrospectively from the medical records of 151 veterans (145 men, 6 women; age range 39-87 years) with an SPN measuring 7-30 mm (inclusive) and a final diagnosis established by histopathology or 2-year follow-up. Each patient's final diagnosis was compared with the probability of malignancy predicted by two models: one developed by investigators at the Mayo Clinic and the other developed from patients enrolled in a VA Cooperative Study. The accuracy of each model was assessed by calculating areas under the receiver operating characteristic (ROC) curve and the models were calibrated by comparing predicted and observed rates of malignancy. Results: The area under the ROC curve for the Mayo Clinic model (0.80; 95% CI 0.72 to 0.88) was higher than that of the VA model (0.73; 95% CI 0.64 to 0.82), but this difference was not statistically significant (Delta=0.07; 95% CI -0.03 to 0.16). Calibration curves showed that the probability of malignancy was underestimated by the Mayo Clinic model and overestimated by the VA model. Conclusions: Two existing prediction models are sufficiently accurate to guide decisions about the selection and interpretation of subsequent diagnostic tests in patients with SPNs, although clinicians should also consider the prevalence of malignancy in their practice setting when choosing a model.