Skip to main content
SearchLoginLogin or Signup

Review 1: "Personalised Risk Prediction Tools for Cryptococcal Meningitis Mortality to Guide Treatment Stratification; A Pooled Analysis of Two Randomised-controlled Trials"

The reviewer commented on the robustness of the statistical analysis providing credibility to the model's performance and its conclusions which can be informative in future clinical trials to further validate this type of predictive model for this illness.

Published onNov 12, 2024
Review 1: "Personalised Risk Prediction Tools for Cryptococcal Meningitis Mortality to Guide Treatment Stratification; A Pooled Analysis of Two Randomised-controlled Trials"
1 of 2
key-enterThis Pub is a Review of
Personalised risk prediction tools for cryptococcal meningitis mortality to guide treatment stratification; a pooled analysis of two randomised-controlled trials
Personalised risk prediction tools for cryptococcal meningitis mortality to guide treatment stratification; a pooled analysis of two randomised-controlled trials
Description

ABSTRACT Background Cryptococcal meningitis is a leading cause of adult community-acquired meningitis in sub-Saharan Africa with high mortality rates in the first 10 weeks post diagnosis. Practical tools to stratify mortality risk may help to tailor effective treatment strategies.Methods We pooled individual-level data from two randomised-controlled trials of HIV-associated cryptococcal meningitis across eight sub-Saharan African countries (ACTA, ISRCTN45035509; Ambition-cm, ISRCTN72509687). We used this pooled dataset to develop and validate multivariable logistic regression models for 2-week and 10-week mortality. Candidate predictor variables were specified a priori. ‘Basic’ models were developed using only predictors available in resource-limited settings; ‘Research’ models were developed from all available predictors. We used internal-external cross-validation to evaluate performance across countries within the development cohort, before validation of discrimination, calibration and net benefit in held-out data from Malawi (Ambition-cm trial). We also evaluated whether treatment effects in the trials were heterogenous by predicted mortality risk.Findings We included 1488 participants, of whom 236 (15.9%) and 469 (31.5%) met the 2-week and 10-week mortality outcomes, respectively. In the development cohort (n=1263), five variables were selected into the basic model (haemoglobin, neutrophil count, Eastern Cooperative Oncology Group performance status, Glasgow coma scale and treatment regimen), with two additional variables in the research model (cerebrospinal fluid quantitative culture and opening pressure) for 2-week mortality. During internal-external cross-validation, both models showed consistent discrimination across countries (pooled areas under the receiver operating characteristic curves (AUROCs) 0.75 (95% CI 0.68-0.82) and 0.78 (0.75-0.82) for the ‘Basic’ and ‘Research’ 2-week mortality models, respectively), with some variation in calibration between sites. Performance was similar in held-out validation (n=225), with the models demonstrating higher net benefit to inform decision-making than alternative approaches including a pre-existing comparator model. In exploratory analyses, treatment effects varied by predicted mortality risk, with a trend towards lower absolute and relative mortality for a single high-dose liposomal Amphotericin B-based regimen (in comparison to 1-week Amphotericin B deoxycholate plus flucytosine) among lower risk participants in the Ambition-cm trial.Interpretation Both models accurately predict mortality, were generalisable across African trial settings, and have potential to be incorporated into future treatment stratification approaches in low and middle-income settings.Funding MRC, United Kingdom (100504); ANRS, France (ANRS12275); SIDA, Sweden (TRIA2015-1092); Wellcome/MRC/UKAID Joint Global Health Trials (MR/P006922/1); European DCCT Partnership; NIHR, United Kingdom through a Global Health Research Professorship to JNJ (RP-2017-08-ST2-012) and a personal Fellowship to RKG (NIHR302829).RESEARCH IN CONTEXT Evidence before this study There is an urgent need to improve clinical management for HIV-associated cryptococcal meningitis in resource limited settings across Africa. Cryptococcal meningitis accounts for ∼112,000 AIDS-related deaths per year globally, with over 75% in Africa, despite widespread antiretroviral therapy roll-out. The development of practical tools to identify patients at highest risk of death could help to tailor management strategies and stratify therapy. We searched PubMed for studies published between database inception and Jan 12, 2024, using the terms “cryptococcal meningitis”, “HIV”, “human immunodeficiency virus”, “immunocompromised”, “predict*”, and “model*”, with no language restrictions. Three previous studies, all conducted in China, have developed prognostic models for cryptococcal meningitis mortality. Of these, two used statistical methods while the third used machine learning but focused on persons without HIV only. No studies conducted in Africa, specifically targeting people living with HIV, or using both statistical and machine learning approaches in parallel, were identified. Well-developed and validated tools to predict risk of cryptococcal meningitis mortality and guide treatment stratification are thus lacking for resource limited settings in Africa.Added value of this study To our knowledge, this is the largest study to date to develop and validate prediction models for HIV-associated cryptococcal meningitis mortality. We combined high-quality data from the two largest randomised-controlled clinical trials conducted to date for cryptococcal meningitis treatment, with a total sample size of 1488 participants of whom 236 (15.9%) and 469 (31.5%) met the 2-week and 10-week mortality outcomes, respectively. We developed two models, ‘basic’ and ‘research’, to enable use in both resource-limited and research settings (where additional prognostic markers such as measurements of cerebrospinal fluid (CSF) opening pressure and CSF fungal burden may also be available). In the 2-week mortality models, five variables were included in the ‘basic’ model, with two additional variables included in the ‘research’ model. Both models predicted risk of mortality with consistent discrimination and calibration across sub-Saharan African settings. Head-to-head statistical (logistic regression) and machine learning (XGBoost) methods revealed no added value of the machine learning approach. In exploratory analyses, treatment effects varied by predicted 2-week mortality risk, thus providing proof-of-concept for future treatment stratification approaches. Specifically, there was a trend towards lower mortality for a single high-dose liposomal Amphotericin B-based regimen (in comparison to 1-week Amphotericin B deoxycholate plus flucytosine) among lower risk participants in the Ambition-cm trial.Implications of all the available evidence The personalised risk predictor for cryptococcal meningitis (PERISKOPE-CM) models accurately predicted mortality risk among patients with HIV-associated cryptococcal meningitis and demonstrated generalisable performance across trial settings in Africa. Predictions from the models could be utilised to direct treatment stratification approaches in future clinical trials, with patients at lowest predicted risk receiving less intensive and less toxic therapy. The models have been made available for future research use on an open access online interface.

RR\ID Evidence Scale rating by reviewer:

  • Strong. The main study claims are very well-justified by the data and analytic methods used. There is little room for doubt that the study produced has very similar results and conclusions as compared with the hypothetical ideal study. The study’s main claims should be considered conclusive and actionable without reservation.

***************************************

Review: The authors have undertaken a robust statistical analysis of pooled individual-level data from two large clinical trials of HIV-associated cryptococcal meningitis conducted in sub-Saharan Africa (by their teams) to validate a priori identified prognostic variables for 2- and 10-week mortality and examine their potential for treatment stratification.

The study is the first and most comprehensive of its kind for this disease in the population most affected by it- and in whom future trials are likely to be performed. The manuscript is clearly written and logically structured. A dataset (n=1263 participants) was developed using both basic and research variables (identified from a priori studies) and comprehensively analyzed using imputation for missing data and exploring non-linear relationships for continuous data, using conventional and machine learning methods. The model was also comprehensively validated using internal-external cross validation as well as validation in a second cohort (n=225), and compared to performance of a single existing published model.

The study methodology is strong, innovative and transparent, and findings and main claims are well-justified and main claims should be considered conclusive and actionable.

Comments
0
comment
No comments here
Why not start the discussion?