- Open Access
Development of multivariable prediction models for institutionalization and mortality in the full spectrum of Alzheimer’s disease
Alzheimer's Research & Therapy volume 14, Article number: 110 (2022)
Patients and caregivers express a desire for accurate prognostic information about time to institutionalization and mortality. Previous studies predicting institutionalization and mortality focused on the dementia stage. However, Alzheimer’s disease (AD) is characterized by a long pre-dementia stage. Therefore, we developed prediction models to predict institutionalization and mortality along the AD continuum of cognitively normal to dementia.
This study included SCD/MCI patients (subjective cognitive decline (SCD) or mild cognitive impairment (MCI)) and patients with AD dementia from the Amsterdam Dementia Cohort. We developed internally and externally validated prediction models with biomarkers and without biomarkers, stratified by dementia status. Determinants were selected using backward selection (p<0.10). All models included age and sex. Discriminative performance of the models was assessed with Harrell’s C statistics.
We included n=1418 SCD/MCI patients (n=123 died, n=74 were institutionalized) and n=1179 patients with AD dementia (n=413 died, n=453 were institutionalized). For both SCD/MCI and dementia stages, the models for institutionalization and mortality included after backward selection clinical characteristics, imaging, and cerebrospinal fluid (CSF) biomarkers. In SCD/MCI, the Harrell’s C-statistics of the models were 0.81 (model without biomarkers: 0.76) for institutionalization and 0.79 (model without biomarker: 0.76) for mortality. In AD-dementia, the Harrell’s C-statistics of the models were 0.68 (model without biomarkers: 0.67) for institutionalization and 0.65 (model without biomarker: 0.65) for mortality. Models based on data from amyloid-positive patients only had similar discrimination.
We constructed prediction models to predict institutionalization and mortality with good accuracy for SCD/MCI patients and moderate accuracy for patients with AD dementia. The developed prediction models can be used to provide patients and their caregivers with prognostic information on time to institutionalization and mortality along the cognitive continuum of AD.
Alzheimer’s disease (AD) clinically progresses from cognitively normal to mild cognitive impairment (MCI) and ultimately, dementia . Further disease progression is characterized by more severe cognitive and functional impairment, which leads to increased caregiver burden and eventually necessitates institutionalization. The variation in clinical course of individual patients renders the establishment of an individual prognosis challenging. We previously found that time to institutionalization and mortality are important outcomes from the perspective of patients and their caregivers, in both dementia and pre-dementia stages . Providing patients and caregivers with accurate prognostic information on time to nursing home placement (NHP) and mortality can support further care-related decision making and (health-care) planning.
Previous studies on risk factors for institutionalization and mortality have mainly focused on patients with dementia. Factors that reportedly predict institutionalization are older age [3,4,5], female sex [4,5,6,7], Caucasian background [3, 5], living alone [3, 5, 7], more severe functional and cognitive impairment [4, 7,8,9,10], and behavioral and psychological symptoms [3, 8, 10]. Shorter survival time in AD dementia has been associated with older age [5, 11,12,13], male sex [5, 11,12,13], higher burden of morbidity , and lower functional and cognitive abilities [11,12,13]. The largest part of the AD disease process takes place before the stage of dementia, but studies on prognosis in terms of institutionalization and mortality in pre-dementia stages are hardly available .
Few studies have evaluated AD biomarkers as putative markers of institutionalization and mortality. Two studies suggested that cerebrospinal fluid (CSF) biomarkers are not predictive of institutionalization in AD dementia [15, 16]. By contrast, one study observes that extremely high levels of CSF total tau (t-tau) are associated with a higher risk of institutionalization in patients with MCI due to AD . When it comes to mortality, low levels of CSF amyloid-ß1-42 (Aβ42) [15, 18] and high levels of phosphorylated tau (p-tau) [12, 18, 19] and t-tau [18, 19] have been found to be associated with an increased risk of mortality in AD dementia. Other studies have shown that white matter hyperintensities (WMH)  and global and hippocampal atrophy [12, 21] on magnetic resonance imaging (MRI) were determinants of mortality in AD dementia.
Biomarkers enable the diagnosis of AD before the stage of dementia. However, since curative treatments are not yet available, an early diagnosis of AD may result in more uncertainty for patients and raise questions regarding the disease prognosis. One of these questions pertains to the amount of time left till institutionalization and death. Therefore, it is relevant to develop prognostic models that can provide patients in different stages of the disease information on their prognosis. In the current study, we aimed to predict institutionalization and mortality, based on demographic, clinical, and AD biomarkers (MRI and CSF) information models, in patients with subjective cognitive decline (SCD), mild cognitive impairment (MCI), and AD dementia.
We included n=2597 patients from the Amsterdam Dementia Cohort [22, 23]. All patients had their baseline visit between 2009 and 2020. Inclusion criteria were (1) a baseline diagnosis of Alzheimer’s disease dementia (AD, n=1179), mild cognitive impairment (MCI, n=582), or subjective cognitive decline (SCD, n=836) and (2) availability of baseline MRI and/or CSF biomarkers. Mean follow-up was 3.8±2.9 years for institutionalization and 4.7±2.9 years for mortality in SCD/MCI patients (SCD and MCI). In AD dementia, mean follow-up was 2.9±2.4 years for institutionalization and 4.2±2.4 years for mortality.
All patients received a standardized dementia diagnostic work-up, which consisted of medical history; neurological, physical and neuropsychological evaluation; MRI; laboratory tests; and lumbar puncture for CSF measurement [22, 23]. Subsequently, clinical diagnosis (i.e., SCD, MCI, or AD dementia) was made in a multi-disciplinary meeting. Patients were diagnosed with AD dementia or MCI according to the National Institute on Aging-Alzheimer’s Association (NIA-AA) criteria [24, 25]. Patients were labeled SCD when they presented with cognitive complaints, had normal clinical and cognitive test results, and did not meet the criteria for MCI, dementia, or other neurologic or psychiatric conditions .
We obtained written informed consent from all patients. The study was approved by the Medical Ethics Review Committee of the VU University Medical Center. This study is reported in accordance with the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) guideline .
Variables considered for the model were age, sex, Mini-Mental State Examination (MMSE) , Charlson Comorbidity Index (CCI), Neuropsychiatric Inventory (NPI) , APOE e4 status, MRI medial temporal lobe atrophy (MTA), global cortical atrophy (GCA), white matter hyperintensities (WMH), CSF Aβ42 and CSF p-tau. All candidate predictors were measured at the first recorded diagnosis in the memory clinic. Comorbidity was defined using CCI, which was calculated based on medical history and medication use . As part of the CCI, we used renal function (MDRD; Modified Diet in Renal Disease study) to score for the presence of moderate to chronic kidney disease [31, 32].
MRI scans were available in n=2074 (80%) patients. MRI of the brain was performed on 1.0 or 1.5 Tesla (T) MRIs (Siemens Magnetom Avanto, Vision, Impact and Sonata, GE Healthcare Signa HDXT) and after 2008 on 3T MRI (MR750, GE Medical Systems, Milwaukee, WI, USA; Ingenuity TF PET/MR, Philips Medical Systems, Best, The Netherlands; Titan, Toshiba Medical Systems, Japan). MRI scans were performed according to a standardize protocol and reviewed by experienced neuroradiologists. Visual rating scales were used to rate atrophy: Medial temporal lobe atrophy (MTA, 0–4)  and Global cortical atrophy (GCA, 0–3) . White matter hyperintensities (WMH) were rated with the Fazekas scale (0–3) .
CSF was available in n=2057 (79%) patients. CSF was obtained by lumbar puncture, collected in polypropylene tubes (Sarstedt Nurnberg, Germany), and processed according to international guidelines . Before 2018, amyloid beta (Aβ42), total tau (t-tau), and phosphorylated threonine 181 (p-tau) were measured using sandwich ELISA’s (Innotest, Fujirebio, Gent, Belgium) (n=1653) . Amyloid beta values were drift corrected . After 2018, CSF was analyzed using Elecsys (n=404). All CSF values were transformed to Elecsys values using a previously published bridging equation .
We performed a subgroup analysis in the subgroup of amyloid-positive patients only. We used amyloid-PET and CSF Aβ42 to determine whether a patient was amyloid-positive or amyloid-negative. Patients were categorized in the amyloid-positive group if they had a positive amyloid-PET scan and/or CSF Aβ42<1000 pg/ml. Amyloid-PET scans were performed using 3-Tesla Philips Ingenuity TF PET/MR, Philips Ingenuity TF PET/CT, and Philips Gemini TF PET/CT scanners. PET scans were visually rated as positive or negative by a trained nuclear medical physician. The amyloid PET procedure using 18F-florbetaben, 18F-Florbetapir, 18F-flutemetamol, or 11C-Pittsburgh compound B (PiB) has been described in detail elsewhere .
Institutionalization and mortality
Data on institutionalization and mortality were derived from administrative data sources made available by Statistic Netherlands (in Dutch: Centraal Bureau voor de Statistiek) . Statistics Netherlands collects data on every registered person in the Netherlands. All included patients of the ADC cohort were linked with the Statistic Netherlands data based on the unique combination of date of birth, sex, postal code, and house number. Institutionalization was defined as permanent admission to a nursing home. Mortality was defined as all-cause mortality. Date on admission to a nursing home originated from the Dutch long-term care insurance scheme and the date of death from the municipal personal records database. Time to institutionalization and time to death were measured in years from the first recorded diagnosis in the memory clinic to the date of institutionalization (between 1 January 2009 and 31 December 2019) and the date of death (between 1 January 2009 and 31 December 2020).
All analyses were performed in STATA SE version 16.0. We constructed univariable and multivariable cox regression models, stratified by dementia status, to predict 1) institutionalization and 2) all-cause mortality. In the multivariable models, we first entered age and sex, and then selected other candidate variables using the backward selection procedure if p-value <0.10. Missing data on candidate predictors (NPI, MTA, GCA, WMH, CSF Aβ42 and CSF p-tau) were imputed via Multiple Imputation using Chained Equations (MICE) (Additional file 1) . Model 1 is an univariable model adjusted for age and sex. Model 2 is a multivariable model consisting of a model built with all candidate predictors and backward selection. In addition, we developed two submodels of model 2; a model without CSF biomarkers (model 2a) and a model without MRI and CSF biomarkers (model 2b). Discriminative performance of the multivariable models was assessed with Harrell’s C statistics . Accuracy of the models was assessed with the 3-year Brier scores [44, 45]. In an additional analysis, we performed a subgroup analysis, restricted to amyloid-positive patients (i.e., AD continuum).
Fivefold cross-validation was performed to evaluate the models. Data was randomly split in 80% for training and 20% for testing. Each time, models were constructed from the training set using backward selection. Harrell’s C and hazard ratios were calculated on the test set. Subsequently, we calculated the average of the hazard ratios and Harrell’s C-statistics of the five different models and compared this with the hazard ratios and Harrell’s C-statistics of the main models.
The concordance between the predicted and observed outcomes was assessed by comparing the probabilities of institutionalization and mortality for each time point as estimated by the Cox model to those obtained by the Kaplan-Meier method, respectively . For this purpose, the prognostic index was calculated based on the models (model 2; constructed with all candidate predictors) for each test set in the five-fold cross-validation based on the linear predictor from the corresponding training set and we categorized the prognostic index into four risk groups: good prognosis (<16th percentile), fairly good prognosis (16–50th percentile), fairly poor prognosis (50–84th percentile), and poor prognosis (>84th percentile). For each of these groups, we compared the average survival curve based on Cox regression with the Kaplan-Meier curve. The proportional hazards assumption was evaluated by comparing the Kaplan-Meier curves across the four risk groups. Crossing curves indicate that the proportional hazards assumption is classified as violated.
For the model predicting institutionalization in AD dementia, the curves showed that this model discriminates well between subjects and that calibration is good for the first 6 years of follow-up and weaker after 6 years of follow-up. Therefore, for this model, we evaluated the proportional hazard assumption of each covariate within the Cox model using the Schoenfeld residuals . For the variables with a statistically significant Schoenfeld residuals test, we additionally estimated time-varying coefficients to demonstrate how the prognostic power of the significant variables of the Schoenfeld residuals changes over time.
External validation was performed in the Memento cohort . This is a multi-center cohort of participants consulting French memory clinics and presenting with cognitive complaints or MCI. At memory clinics, baseline data collection included demographic, social, clinical data, neuroimaging (MRI, FDG PET), and fluid (blood, CSF). The brain parenchymal fraction (white plus grey matter volumes divided by intracranial volume) was used as a measure for GCA and then standardized (converted to a z-score) in the Cox models. CSF biomarkers were obtained from Fuijrebio kits and then converted to Elecsys. We fitted the regression coefficients from the ADC model in Memento and evaluated the resulting Harrell’s C.
AD dementia vs. SCD/MCI patients
We included n=1418 SCD/MCI patients and n=1179 patients with AD dementia. Baseline characteristics are shown in Table 1. Mean age of SCD/MCI patients was 63±7 years, n=532 (38%) were female, and the mean MMSE score was 27±2. AD dementia patients were 65±7 years, n=624 (53%) were female and the MMSE score was 20±5. In SCD/MCI patients, n=123 (9%) died and n=74 (5%) were institutionalized. In AD dementia, n=413 (35%) patients died and n=453 (38%) patients were institutionalized.
Univariable analysis (Tables 2 and 3) shows that older age, lower MMSE, higher NPI scores, higher burden of morbidity (CCI), more abnormal MRI scores (GCA and MTA), lower CSF Aβ42, and higher CSF p-tau increased the risk of both mortality and institutionalization in both strata. Of note, more severe WMH significantly increased the risk of institutionalization in SCD/MCI patients but decreased the risk of institutionalization in AD dementia.
Subsequently, we used backward elimination to select determinants for the multivariable model. Tables 2 and 3 show the multivariable models for the prediction of institutionalization and mortality stratified by dementia status. Discriminative performance was higher in SCD/MCI patients than in patients with AD dementia for both institutionalization (Harrell’s C (95%CI): 0.81 (0.76; 0.86) vs 0.68 (0.65; 0.70)) and mortality (Harrell’s C (95%CI): 0.79 (0.75; 0.83) vs 0.65 (0.62; 0.68)).
The model in SCD/MCI patients included clinical characteristics (age, sex, MMSE, NPI) combined with imaging (GCA) and CSF biomarkers (Aβ42 and p-tau) for institutionalization (Harrell’s C=0.81(0.76; 0.86)). Compared to this model, the model for mortality included CCI and MTA, but not MMSE (Harrell’s C (95% CI)=0.79 (0.75; 0.83)). Cross-validation showed a Harrell’s C in the same range for both institutionalization (Harrell’s C (95% CI)=0.76 (0.64–0.87)) and mortality (Harrell’s C (95%)=0.75 (0.66–0.85)) (Additional file 2). Additional models constructed under the assumption that MRI and/or CSF were not available, resulted in somewhat lower Harrell’s C, although Harrell’s C remained within the same range compared to the model built with all candidate predictors (Table 2).
In AD dementia, the model for institutionalization included clinical characteristics (age, sex, MMSE, NPI), imaging (MTA, WMH) and CSF p-tau (Harrell’s C (95%CI)=0.68 (0.65; 0.70)). Compared to this model, the model for mortality included GCA, but not MTA and p-tau (Harrell’s C (95%CI)=0.65 (0.62; 0.68)). Of note, more severe WMH decreased the risk of institutionalization, but increased the risk of mortality in AD patients. Cross-validation showed a Harrell’s C in the same range for both institutionalization (Harrell’s C (95%CI)= 0.66 (0.59–0.72)) and mortality (Harrell’s C (95%CI)=0.63 (0.56–0.70)) (Additional file 3). Models constructed without biomarkers had similar discriminative values compared to the model built with all candidate predictors.
The 3-year Brier scores of the models were 0.015 (0.008; 0.021) for predicting institutionalization in SCD/MCI, 0.024 (0.016; 0.032) for predicting mortality in SCD/MCI, 0.174 (0.161; 0.187) for predicting institutionalization in AD dementia and 0.091 (0.077; 0.105) for predicting mortality in AD dementia (Tables 2 and 3).
Figure 1 shows the comparison between the probabilities estimated by the Cox model and those obtained by the Kaplan-Meier method for each of the four prognosis groups based on the prognostic index. The curves for the prognosis groups were more widely separated in SCD/MCI patients for mortality compared to AD dementia, indicating better discrimination for SCD/MCI patients. SCD/MCI patients generally had similar probabilities obtained by Cox and Kaplan-Meier method, until at least five years of follow-up (Fig. 1A and B). For the fairly poor prognosis group in AD dementia, similar probabilities were obtained by the Cox model and Kaplan-Meier model for institutionalization (Fig. 1C). In the fairly good prognosis group in AD dementia, there is an underestimation for institutionalization in the first four years, while in the poor prognosis group in AD there is an overestimation for institutionalization in the first years. In all four prognosis groups in AD, dementia mortality was accurately predicted by the Cox model up to 3 years follow-up (Fig. 1D).
For the model predicting institutionalization in AD dementia, the curves in Fig. 1 showed that the model discriminates well between subjects and that calibration is good for the first 6 years of follow-up and weaker after 6 years of follow-up (Fig. 1C). The Schoenfeld residuals showed that the proportional hazard assumption was violated for the covariates MMSE and NPI in the model for institutionalization (Additional file 4). To demonstrate how the prognostic power of MMSE and NPI changes over time, we reported time-varying effects of MMSE and NPI on the hazard ratio to Additional file 5. The results indicate that the effect of MMSE and NPI on the hazard ratio is weaker after 6 years of follow-up than in the first 6 years.
In an additional set of analyses, we restricted our multivariable models for the prediction of institutionalization and mortality in amyloid-positive patients (Additional files 6 and 7). There were n=372 SCD/MCI and n=1039 dementia AD patients, based on positive amyloid PET and/or CSF Aβ42. In SCD/MCI, n=44 (12%) died and n=39 (10%) were institutionalized. In AD dementia, n=350 (34%) patients died and n=374 (36%) patients were institutionalized. The model in SCD/MCI patients included clinical characteristics (age, sex, MMSE) combined with imaging (GCA, MTA, WMH) and CSF p-tau for institutionalization (Harrell’s C (95%CI)=0.72 (0.66; 0.84)). Compared to this model, the model for mortality did not include MMSE, GCA, and WMH (Harrell’s C (95%)=0.74 (0.66; 0.83)). In AD dementia patients, the model for institutionalization included clinical characteristics (age, sex, MMSE, NPI) combined with imaging (MTA, WMH) and CSF p-tau (Harrell’s C=0.68 (0.64; 0.71)). Compared to this model, the model for mortality did not include CSF p-tau (Harrell’s C (95% CI)=0.65 (0.62; 0.68)).
For external validation, we included n=2308 SCD/MCI patients (n=1943 MCI, n=365 SCD) from the memento cohort (Additional file 8). Of these patients, n=95 (4%) died and n=66 (3%) were institutionalized. Mean follow-up was 4±2 years for both outcomes. In n=404 patients CSF data was available and in n=2153 patients MRI data was available. External validation shows similar discrimination for the models to predict institutionalization (Harrell’s C (95%CI)=0.79 (0.65; 0.93)) and mortality (Harrell’s C (95%CI)=0.72 (0.60; 0.85)) in SCD/MCI patients (Additional file 9).
We developed validated models to predict institutionalization and mortality along the AD continuum. Models for institutionalization and mortality included clinical characteristics, imaging and CSF biomarkers in both SCD/MCI patients and AD dementia patients. Discriminative performance was better in SCD/MCI patients than in patients with AD dementia. Models based on amyloid-positive patients only had a similar discriminative performance.
Extending on previous studies on the prediction of institutionalization and mortality in AD, we included biomarkers as pathophysiological indicators of the disease in the models. From earlier studies, we know that these biomarkers are strongly related to cognitive decline over time and the progression from pre-dementia to dementia stages . Abnormal CSF biomarkers were associated with rapid cognitive decline , which lead to functional impairment and eventually necessitates institutionalization and increases the risk of death. Furthermore, we not only predicted mortality and institutionalization in AD dementia, but also in patients with SCD and MCI. It is relevant to develop prognostic models that can provide patients with different levels of cognitive impairment information on their prognosis. Whereas most prediction models in the literature focus on dementia as the endpoint , patients may be looking for more practical information. In our previous study, patients and caregivers reported the time to institutionalization and mortality as important outcomes . Taking this need as expressed by patients and families as a starting point, in this study, we developed models to predict time to institutionalization and mortality for patients with and without dementia. Information derived from such models can support clinicians and patients in the timing of advance care planning and shared decision-making.
The few available models that predict mortality have been developed for patients with dementia, and they did not contain any information on biomarkers. A former study that predicted survival in dementia, included age, sex, setting of care, and CCI . A study from the Swedish Dementia registry included age, sex, CCI, MMSE, and dementia type in the model . Similar to our study, male sex increased the risk of mortality. Compared to these previous models, we observed a lower discriminative performance in the model for mortality in AD dementia patients. Possible explanations for the difference in the discriminative performance are our models are based on a smaller cohort, a younger population, and a lower burden of morbidity. In contrast with the previously reported models, CCI as a measure of comorbidity was not retained in our model, perhaps due to the relatively young age of our sample. However, CCI added predictive value in the models predicting survival in SCD/MCI patients. A potential explanation for this finding is that the SCD/MCI patients who died during follow-up had a cause of death other than Alzheimer’s disease.
Most previous studies on predictors for institutionalization have been performed in patients with dementia, contain no biomarkers, and did not assess discrimination. One study in patients with dementia showed that living alone, dependency in activities of daily living (ADL), lower MMSE, higher NPI score, and black/Hispanic ethnicity increased the risk of institutionalization . Our model for AD dementia also includes MMSE and NPI and shows similar discriminative performance. Another study showed that MMSE, NPI, instrumental ADL, and non-spousal informal caregiver were determinants of time to institutionalization . This study has not assessed the discrimination of the models. We add biomarkers to the institutionalization models and evaluated the discrimination of models in dementia and pre-dementia stages.
Strengths and limitations
A strength of our study is that we included a large sample of patients with diagnoses ranging from SCD, MCI to AD dementia. All SCD/MCI patients visited the memory clinic, being worried about their cognitive complaints. Prognostic information about mortality and institutionalization is also relevant to them. However, since we intended to provide prognostic information along the AD continuum and not all patients with SCD or MCI had underlying AD. We performed an additional analysis restricted to amyloid-positive patients only. The resulting model was very comparable in terms of determinants and prognostic performance. Another strength is that we evaluated three different models with and without biomarkers, using fivefold cross-validation and we validated the models externally. We observed good discriminative performance, indicating that the models are robust and may have value in clinical practice.
A limitation of this study is that many variables are included in the models. In practice, information may not always be available on all these variables for each patient. Therefore, we constructed additional models under the assumption that CSF and/or MRI were not available. These models had approximately the same discriminative performance. Therefore, mortality and institutionalization can still be accurately predicted in the absence of biomarker information. However, when MRI and/or CSF were available then the inclusion of this information in the model improves the accuracy of the prediction of mortality and institutionalization. Another potential limitation is that only a small percentage of patients were institutionalized or died in the group with SCD/MCI patients. This may explain the higher discriminative performance in the models for SCD/MCI patients, and further illustrates the need for truly longitudinal data to derive meaningful models in this highly relevant population. Another limitation is the violation of the proportional hazards assumption after 6 years of follow-up in the model predicting institutionalization for the good and fairly good prognosis groups in AD patients. The Schoenfeld residuals showed that the proportional hazards assumption is violated for MMSE and NPI in the model predicting institutionalization in AD dementia. This suggests that MMSE and NPI measured at the time of diagnosis lose their predictive power over time, probably because of disease progression. Therefore, we recommend to update the cognitive tests regularly in the model for accurate long-term prediction. Finally, the statistical power is too low to do a subgroup analysis based on the cause of death. However, the classification of AD-related mortality is a complex procedure, because patients with AD die due to the complications of dementia such as dehydration, malnutrition, or infection. For example, swallowing problems in an AD patient can lead to aspiration pneumonia which results in death, or an AD patient with cancer as comorbidity forgets to visit a doctor and subsequently dies as a result of advanced-stage cancer . Therefore, it is more relevant to predict all-cause mortality instead of AD-related mortality.
In conclusion, we constructed prediction models to predict institutionalization and mortality in patients with diagnoses ranging from SCD and MCI to AD dementia. The model for institutionalization and mortality included clinical characteristics, imaging, and CSF biomarkers for both SCD/MCI and AD dementia patients. The models can be used to provide patients in both pre-dementia and dementia stages and their caregivers’ prognostic information on the time to institutionalization and mortality.
Availability of data and materials
The datasets used and/or analyzed during the present study are available from the corresponding author on reasonable request.
Tau phosphorylated at threonine 181
95% confidence interval
Mini-Mental State Examination
Charlson Comorbidity Index
Magnetic resonance imaging
Global cortical atrophy
Medial temporal lobe atrophy
White matter hyperintensities
Scheltens P, Blennow K, Breteler MM, de Strooper B, Frisoni GB, Salloway S, et al. Alzheimer's disease. Lancet (London, England). 2016;388(10043):505–17.
Mank A, van Maurik IS, Bakker ED, van de Glind EMM, Jönsson L, Kramberger MG, et al. Prognosis of Alzheimer's disease; what do patients and care partners want to know? Transl Res Clin Intervent. 2021;7(1):e12189.
Cepoiu-Martin M, Tam-Tham H, Patten S, Maxwell CJ, Hogan DB. Predictors of long-term care placement in persons with dementia: a systematic review and meta-analysis. Int J Geriatr Psychiatry. 2016;31(11):1151–71.
Hatoum HT, Thomas SK, Lin SJ, Lane R, Bullock R. Predicting time to nursing home placement based on activities of daily living scores--a modelling analysis using data on Alzheimer's disease patients receiving rivastigmine or donepezil. J Med Econ. 2009;12(2):98–103.
Joling KJ, Janssen O, Francke AL, Verheij RA, Lissenberg-Witte BI, Visser PJ, et al. Time from diagnosis to institutionalization and death in people with dementia. Alzheimer's Dement. 2020;16(4):662–71.
Haaksma ML, Rizzuto D, Ramakers I, Garcia-Ptacek S, Marengoni A, van der Flier WM, et al. The impact of frailty and comorbidity on institutionalization and mortality in persons with dementia: a prospective cohort study. J Am Med Dir Assoc. 2019;20(2):165–70.e2.
Wattmo C, Wallin AK, Londos E, Minthon L. Risk factors for nursing home placement in Alzheimer's disease: a longitudinal study of cognition, ADL, service utilization, and cholinesterase inhibitor treatment. The Gerontologist. 2011;51(1):17–27.
Gaugler JE, Yu F, Krichbaum K, Wyman JF. Predictors of nursing home admission for persons with dementia. Med Care. 2009;47(2):191–8.
Luppa M, Riedel-Heller SG, Stein J, Leicht H, König HH, van den Bussche H, et al. Predictors of institutionalisation in incident dementia--results of the German study on ageing, cognition and dementia in primary care patients (AgeCoDe study). Dement Geriatr Cogn Disord. 2012;33(4):282–8.
Brodaty H, Connors MH, Xu J, Woodward M, Ames D. Predictors of institutionalization in dementia: a three year longitudinal study. J Alzheimer's Dis. 2014;40(1):221–6.
Haaksma ML, Eriksdotter M, Rizzuto D, Leoutsakos JS, Olde Rikkert MGM, Melis RJF, et al. Survival time tool to guide care planning in people with dementia. Neurology. 2020;94(5):e538–e48.
Rhodius-Meester HFM, Liedes H, Koene T, Lemstra AW, Teunissen CE, Barkhof F, et al. Disease-related determinants are associated with mortality in dementia due to Alzheimer's disease. Alzheimers Res Ther. 2018;10(1):23.
Rountree SD, Chan W, Pavlik VN, Darby EJ, Doody RS. Factors that influence survival in a probable Alzheimer disease cohort. Alzheimers Res Ther. 2012;4(3):16.
Vermunt L, Sikkes SAM, van den Hout A, Handels R, Bos I, van der Flier WM, et al. Duration of preclinical, prodromal, and dementia stages of Alzheimer's disease in relation to age, sex, and APOE genotype. Alzheimer's Dement. 2019;15(7):888–98.
Boumenir A, Cognat E, Sabia S, Hourregue C, Lilamand M, Dugravot A, et al. CSF level of β-amyloid peptide predicts mortality in Alzheimer's disease. Alzheimers Res Ther. 2019;11(1):29.
Wallin AK, Blennow K, Andreasen N, Minthon L. CSF biomarkers for Alzheimer's disease: levels of beta-amyloid, tau, phosphorylated tau relate to clinical symptoms and survival. Dement Geriatr Cogn Disord. 2006;21(3):131–8.
Degerman Gunnarsson M, Ingelsson M, Blennow K, Basun H, Lannfelt L, Kilander L. High tau levels in cerebrospinal fluid predict nursing home placement and rapid progression in Alzheimer's disease. Alzheimers Res Ther. 2016;8(1):22.
Wallin AK, Blennow K, Zetterberg H, Londos E, Minthon L, Hansson O. CSF biomarkers predict a more malignant outcome in Alzheimer disease. Neurology. 2010;74(19):1531–7.
Degerman Gunnarsson M, Lannfelt L, Ingelsson M, Basun H, Kilander L. High tau levels in cerebrospinal fluid predict rapid decline and increased dementia mortality in Alzheimer's disease. Dement Geriatr Cogn Disord. 2014;37(3-4):196–206.
Henneman WJ, Sluimer JD, Cordonnier C, Baak MM, Scheltens P, Barkhof F, et al. MRI biomarkers of vascular damage and atrophy predicting mortality in a memory clinic population. Stroke. 2009;40(2):492–8.
Nägga K, Wattmo C, Zhang Y, Wahlund LO, Palmqvist S. Cerebral inflammation is an underlying mechanism of early death in Alzheimer's disease: a 13-year cause-specific multivariate mortality study. Alzheimers Res Ther. 2014;6(4):41.
van der Flier WM, Pijnenburg YA, Prins N, Lemstra AW, Bouwman FH, Teunissen CE, et al. Optimizing patient care and research: the Amsterdam dementia cohort. J Alzheimer's Dis. 2014;41(1):313–27.
van der Flier WM, Scheltens P. Amsterdam dementia cohort: performing research to optimize care. J Alzheimer's Dis. 2018;62(3):1091–111.
Albert MS, DeKosky ST, Dickson D, Dubois B, Feldman HH, Fox NC, et al. The diagnosis of mild cognitive impairment due to Alzheimer's disease: recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease. Alzheimer's Dement. 2011;7(3):270–9.
Petersen RC, Smith GE, Waring SC, Ivnik RJ, Tangalos EG, Kokmen E. Mild cognitive impairment: clinical characterization and outcome. Arch Neurol. 1999;56(3):303–8.
Jessen F. Subjective and objective cognitive decline at the pre-dementia stage of Alzheimer's disease. Eur Arch Psychiatry Clin Neurosci. 2014;264 Suppl 1:S3–7.
Collins GS, Reitsma JB, Altman DG, Moons KG. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. BMJ (Clinical research ed). 2015;350:g7594.
Folstein MF, Folstein SE, McHugh PR. “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12(3):189–98.
Cummings JL. The neuropsychiatric inventory: assessing psychopathology in dementia patients. Neurology. 1997;48(5 Suppl 6):S10–6.
Charlson M, Szatrowski TP, Peterson J, Gold J. Validation of a combined comorbidity index. J Clin Epidemiol. 1994;47(11):1245–51.
Levey AS, Bosch JP, Lewis JB, Greene T, Rogers N, Roth D. A more accurate method to estimate glomerular filtration rate from serum creatinine: a new prediction equation. Modification of diet in renal disease study group. Ann Intern Med. 1999;130(6):461–70.
Levey AS, Stevens LA, Schmid CH, Zhang YL, Castro AF 3rd, Feldman HI, et al. A new equation to estimate glomerular filtration rate. Ann Intern Med. 2009;150(9):604–12.
Scheltens P, Launer LJ, Barkhof F, Weinstein HC, van Gool WA. Visual assessment of medial temporal lobe atrophy on magnetic resonance imaging: interobserver reliability. J Neurol. 1995;242(9):557–60.
Pasquier F, Leys D, Weerts JG, Mounier-Vehier F, Barkhof F, Scheltens P. Inter- and intraobserver reproducibility of cerebral atrophy assessment on MRI scans with hemispheric infarcts. Eur Neurol. 1996;36(5):268–72.
Fazekas F, Chawluk JB, Alavi A, Hurtig HI, Zimmerman RA. MR signal abnormalities at 1.5 T in Alzheimer's dementia and normal aging. AJR Am J Roentgenol. 1987;149(2):351–6.
Teunissen CE, Petzold A, Bennett JL, Berven FS, Brundin L, Comabella M, et al. A consensus protocol for the standardization of cerebrospinal fluid collection and biobanking. Neurology. 2009;73(22):1914–22.
Duits FH, Prins ND, Lemstra AW, Pijnenburg YA, Bouwman FH, Teunissen CE, et al. Diagnostic impact of CSF biomarkers for Alzheimer's disease in a tertiary memory clinic. Alzheimer's Dement. 2015;11(5):523–32.
Tijms BM, Willemse EAJ, Zwan MD, Mulder SD, Visser PJ, van Berckel BNM, et al. Unbiased approach to counteract upward drift in cerebrospinal fluid amyloid-β 1-42 analysis results. Clin Chem. 2018;64(3):576–85.
Willemse EAJ, van Maurik IS, Tijms BM, Bouwman FH, Franke A, Hubeek I, et al. Diagnostic performance of Elecsys immunoassays for cerebrospinal fluid Alzheimer's disease biomarkers in a nonacademic, multicenter memory clinic cohort: the ABIDE project. Alzheimer's Dement (Amsterdam, Netherlands). 2018;10:563–72.
de Wilde A, van der Flier WM, Pelkmans W, Bouwman F, Verwer J, Groot C, et al. Association of Amyloid Positron Emission Tomography with Changes in diagnosis and patient treatment in an unselected memory clinic cohort: the ABIDE project. JAMA Neurol. 2018;75(9):1062–70.
Statistics Netherlands (CBS) Microdata. https://www.cbs.nl/nl-nl/onze-diensten/maatwerk-en-microdata/microdata-zelf-onderzoek-doen. Acccessed 17 Dec 2019.
van Buuren S, Boshuizen HC, Knook DL. Multiple imputation of missing blood pressure covariates in survival analysis. Stat Med. 1999;18(6):681–94.
Newson RB. Comparing the predictive powers of survival models using Harrell's C or Somers'D. Stata J. 2010;10(3):339–58.
Gerds TA, Schumacher M. Consistent estimation of the expected brier score in general survival models with right-censored event times. Biom J. 2006;48(6):1029–40.
Graf E, Schmoor C, Sauerbrei W, Schumacher M. Assessment and comparison of prognostic classification schemes for survival data. Stat Med. 1999;18(17-18):2529–45.
Royston P, Altman DG. External validation of a cox prognostic model: principles and methods. BMC Med Res Methodol. 2013;13:33.
Schoenfeld D. Partial residuals for the proportional hazards regression model. Biometrika. 1982;1(69):239–41.
Dufouil C, Dubois B, Vellas B, Pasquier F, Blanc F, Hugon J, et al. Cognitive and imaging markers in non-demented subjects attending a memory clinic: study design and baseline findings of the MEMENTO cohort. Alzheimers Res Ther. 2017;9(1):67.
van Maurik IS, Vos SJ, Bos I, Bouwman FH, Teunissen CE, Scheltens P, et al. Biomarker-based prognosis for people with mild cognitive impairment (ABIDE): a modelling study. Lancet Neurol. 2019;18(11):1034–44.
Kester MI, van der Vlies AE, Blankenstein MA, Pijnenburg YA, van Elk EJ, Scheltens P, et al. CSF biomarkers predict rate of cognitive decline in Alzheimer disease. Neurology. 2009;73(17):1353–8.
van de Vorst IE, Golüke NMS, Vaartjes I, Bots ML, Koek HL. A prediction model for one- and three-year mortality in dementia: results from a nationwide hospital-based cohort of 50,993 patients in the Netherlands. Age Ageing. 2020;49(3):361–7.
Yaffe K, Fox P, Newcomer R, Sands L, Lindquist K, Dane K, et al. Patient and caregiver characteristics and nursing home placement in patients with dementia. Jama. 2002;287(16):2090–7.
Belger M, Haro JM, Reed C, Happich M, Argimon JM, Bruno G, et al. Determinants of time to institutionalisation and related healthcare and societal costs in a community-based cohort of patients with Alzheimer's disease dementia. Eur J Health Econ. 2019;20(3):343–55.
2021 Alzheimer's disease facts and figures. Alzheimer's Dement. 2021;17(3):327–406. https://doi.org/10.1002/alz.12328.
Research of Alzheimer center Amsterdam is part of the neurodegeneration research program of Amsterdam Neuroscience. Alzheimer Center Amsterdam is supported by Stichting Alzheimer Nederland and Stichting VUmc fonds. The chair of W.M. van der Flier is supported by the Pasman stichting.
A. Mank is appointed at the EU Joint Programme- Neurodegenerative Disease Research (JPND) ADDITION project (ZonMW no. 733051083). W.M. and I.S. van Maurik are recipients of the collaboration project ABIDE-clinical utility, which is co-funded by the PPP Allowance made available by health-Holland, Top Sector Life Sciences & Health, to stimulate public-private partnerships and Life Molecular Imaging GmbH (grant no.: LSHM18075). W.M. van der Flier, J. Berkhof, C.E. Teunissen, and P. Scheltens are recipients of ABOARD, which is a public-private partnership receiving funding from ZonMW (#73305095007) and Health~Holland, Topsector Life Sciences & Health (PPP-allowance; #LSHM20106).
Ethics approval and consent to participate
The study was approved by the local Medical Ethical Committee. All patients provided written informed consent for their clinical data to be used for research purposes.
Consent for publication
Arenda Mank, Ingrid S. van Maurik, Els D. Bakker, Vincent Bouteloup, Lisa Le Scouarnec, and Johannes Berkhof report no financial disclosures or conflicts of interest.
Judith J.M. Rijnhart received a grant from the Amsterdam Public Health Research Institute, which was paid to the Amsterdam UMC.
Charlotte E. Teunissen was supported by funding from the European Commission (Marie Curie International Training Network, grant agreement No 860197 (MIRIADE), and JPND), Health Holland, the Dutch Research Council (ZonMW), Alzheimer Drug Discovery Foundation, The Selfridges Group Foundation, Alzheimer Netherlands, Alzheimer Association. C.E. Teunissen has a collaboration contract with ADx Neurosciences, Quanterix, and Eli Lilly, performed contract research, or received grants from AC-Immune, Axon Neurosciences, Biogen, Brainstorm Therapeutics, Celgene, EIP Pharma, Eisai, PeopleBio, Roche, Toyama, and Vivoryon. C.E. Teunissen serves on editorial boards of Medidact Neurologie/Springer, Alzheimer Research and Therapy, and Neurology: Neuroimmunology & Neuroinflammation and is editor of a Neuromethods book Springer.
Frederik Barkhof is a steering committee or iDMC member for Biogen, Merck, Roche, EISAI, and Prothena. FB is a consultant for Roche, Biogen, Merck, IXICO, Jansen, and Combinostics. Research agreements with Merck, Biogen, GE Healthcare, Roche. Co-founder and shareholder of Queen Square Analytics LTD. FB is supported by the NIHR biomedical research centre at UCLH.
Philip Scheltens has received consultancy fees (paid to the university) from Alzheon, Brainstorm Cell, and Green Valley. Within his university affiliation, he is global PI of the phase 1b study of AC Immune, phase 2b study with FUJI-film/Toyama, phase 2 study of UCB, and phase 1 study with ImmunoBrain Checkpoint. He is chair of the EU steering committee of the phase 2b program of Vivoryon, the phase 2b study of Novartis Cardiology, and co-chair of the phase 3 study with NOVO-Nordisk. He is also an employee of EQT Life Sciences (formerly LSP).
Wiesje M. van der Flier: Research programs of W.M. van der Flier have been funded by ZonMW, NWO, EU-FP7, EU-JPND, Alzheimer Nederland, Hersenstichting CardioVascular Onderzoek Nederland, Health~Holland, Topsector Life Sciences & Health, stichting Dioraphte, Gieskes-Strijbis fonds, stichting Equilibrio, Edwin Bouw fonds, Pasman stichting, stichting Alzheimer & Neuropsychiatrie Foundation, Philips, Biogen MA Inc, Novartis-NL, Life-MI, AVID, Roche BV, Fujifilm, Combinostics. WF holds the Pasman chair. WF is a recipient of ABOARD, which is a public-private partnership receiving funding from ZonMW (#73305095007) and Health~Holland, Topsector Life Sciences & Health (PPP-allowance; #LSHM20106). WF has performed contract research for Biogen MA Inc, and Boehringer Ingelheim. WF has been an invited speaker at Boehringer Ingelheim, Biogen MA Inc, Danone, Eisai, WebMD Neurology (Medscape), and Springer Healthcare. WF is a consultant to Oxford Health Policy Forum CIC, Roche, and Biogen MA Inc. WF participated in advisory boards of Biogen MA Inc and Roche. All funding is paid to her institution. WF was associate editor of Alzheimer, Research & Therapy in 2020/2021. WF is an associate editor at Brain.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Multiple Imputation using Chained Equations (MICE).
Five-fold cross-validation of the prediction models in SCD/MCI patients.
Five-fold cross-validation of the prediction models in AD dementia.
Schoenfeld residuals for the model (model 2) predicting institutionalization in AD dementia.
Time-varying hazard ratios of MMSE and NPI after six years of follow-up for the model (model 2) predicting institutionalization in AD dementia.
Univariable and multivariable cox regression models for the prediction of institutionalization and mortality in SCD/MCI amyloid-positive patients.
Univariable and multivariable cox regression models for the prediction of institutionalization and mortality in amyloid-positive patients with AD dementia.
Baseline characteristics Memento cohort.
Harrell’s C Memento cohort based on regression variables of the Amsterdam Dementia Cohort (ADC) models.
About this article
Cite this article
Mank, A., van Maurik, I.S., Rijnhart, J.J.M. et al. Development of multivariable prediction models for institutionalization and mortality in the full spectrum of Alzheimer’s disease. Alz Res Therapy 14, 110 (2022). https://doi.org/10.1186/s13195-022-01053-0
- Alzheimer’s disease
- Mild cognitive impairment
- Subjective cognitive decline