Meta-analysis of predictive models to assess the clinical validity and utility for patient-centered medical decision making: application to the CAncer of the Prostate Risk Assessment (CAPRA)

Abstract : BACKGROUND: The Cancer of the Prostate Risk Assessment (CAPRA) score was designed and validated several times to predict the biochemical recurrence-free survival after a radical prostatectomy. Our objectives were, first, to study the clinical validity of the CAPRA score, and, second, to assess its clinical utility for stratified medicine from an original patient-centered approach. METHODS: We proposed a meta-analysis based on a literature search using MEDLINE. Observed and predicted biochemical-recurrence-free survivals were compared to assess the calibration of the CAPRA score. Discriminative capacities were evaluated by estimating the summary time-dependent ROC curve. The clinical utility of the CAPRA score was evaluated according to the following stratified decisions: active monitoring for low-risk patients, prostatectomy for intermediate-risk patients, or radio-hormonal therapy for high risk patients. For this purpose, we assessed CAPRA's clinical utility in terms of its ability to maximize time-dependent utility functions (i.e. Quality-Adjusted Life-Years - QALYs). RESULTS: We identified 683 manuscripts and finally retained 9 studies. We reported good discriminative capacities with an area under the SROCt curve at 0.73 [95%CI from 0.67 to 0.79], while graphical calibration seemed acceptable. Nevertheless, we also described that the CAPRA score was unable to discriminate between the three medical alternatives, i.e. it did not allow an increase in the number of life years in perfect health (QALYs) of patients with prostate cancer. CONCLUSIONS: We confirmed the prognostic capacities of the CAPRA score. In contrast, we were not able to demonstrate its clinical usefulness for stratified medicine from a patient-centered perspective. Our results also highlighted the confusion between clinical validity and utility. This distinction should be better considered in order to develop predictive tools useful in practice.
Complete list of metadatas

Cited literature [60 references]  Display  Hide  Download

https://www.hal.inserm.fr/inserm-02306977
Contributor : Myriam Bodescot <>
Submitted on : Monday, October 7, 2019 - 11:11:53 AM
Last modification on : Wednesday, October 9, 2019 - 1:35:48 AM

File

s12911-018-0727-2.pdf
Publication funded by an institution

Identifiers

Collections

Citation

Marine Lorent, Haïfa Maalmi, Philippe Tessier, Stéphane Supiot, Etienne Dantan, et al.. Meta-analysis of predictive models to assess the clinical validity and utility for patient-centered medical decision making: application to the CAncer of the Prostate Risk Assessment (CAPRA). BMC Medical Informatics and Decision Making, BioMed Central, 2019, 19 (1), pp.2. ⟨10.1186/s12911-018-0727-2⟩. ⟨inserm-02306977⟩

Share

Metrics

Record views

36

Files downloads

11