- Open Access
Personalized predictive modeling for patients with Alzheimer’s disease using an extension of Sullivan’s life table model
Alzheimer's Research & Therapy volume 9, Article number: 75 (2017)
Alzheimer’s disease (AD) progression varies substantially among patients, hindering calculation of residual total life expectancy (TLE) and its decomposition into disability-free life expectancy (DFLE) and disabled life expectancy (DLE) for individual patients with AD. The objective of the present study was to assess the accuracy of a new synthesis of Sullivan’s life table (SLT) and longitudinal Grade of Membership (L-GoM) models that estimates individualized TLEs, DFLEs, and DLEs for patients with AD. If sufficiently accurate, such information could enhance the quality of important decisions in AD treatment and patient care.
We estimated a new SLT/L-GoM model of the natural history of AD over 10 years in the Predictors 2 Study cohort: N = 229 with 6 fixed and 73 time-varying covariates over 21 examinations covering 11 measurement domains including cognitive, functional, behavioral, psychiatric, and other symptoms/signs. Total remaining life expectancy was censored at 10 years. Disability was defined as need for full-time care (FTC), the outcome most strongly associated with AD progression. All parameters were estimated via weighted maximum likelihood using data-dependent weights designed to ensure that the estimates of the prognostic subtypes were of high quality. Goodness of fit was tested/confirmed for survival and FTC disability for five relatively homogeneous subgroups defined to cover the range of patient outcomes over the 21 examinations.
The substantial heterogeneity in initial patient presentation and AD progression was captured using three clinically meaningful prognostic subtypes and one terminal subtype exhibiting highly differentiated symptom severity on 7 of the 11 measurement domains. Comparisons of the observed and estimated survival and FTC disability probabilities demonstrated that the estimates were accurate for all five subgroups, supporting their use in AD life expectancy calculations. Mean 10-year TLE differed widely across subgroups: range 3.6–8.0 years, average 6.1 years. Mean 10-year DFLE differed relatively even more widely across subgroups: range 1.2–6.5 years, average 4.0 years. Mean 10-year DLE was relatively much closer: range 1.5–2.3 years, average 2.1 years.
The SLT/L-GoM model yields accurate maximum likelihood estimates of TLE, DFLE, and DLE for patients with AD; it provides a realistic, comprehensive modeling framework for endpoint and resource use/cost calculations.
The rate of progression of Alzheimer’s disease (AD) varies across patients, making it difficult to generate accurate estimates of the course of disease or time until specific disease endpoints for individual patients . Moreover, differences in group-specific rates of progression and treatment efficacies in therapeutic trials may be confounded by individual variation in rates of progression, making it difficult to evaluate the effectiveness of randomization . All of these difficulties are exacerbated by two additional factors: (1) the clinical presentation at diagnosis is highly variable over individual patients with AD—involving cognitive, functional, behavioral, psychiatric, and other symptoms; and (2) the neuropathological substrates of AD—involving neuronal dysfunction, neurodegeneration, synaptic dysfunction, cerebral atrophy, and other pathologies—differentially influence the clinical course of AD in ways that are poorly understood . For example, there are no known biomarkers that closely track the progression of AD clinical signs/symptoms or uniquely identify their presence . Thus, the development of a realistic, comprehensive, multidomain model of the progression of AD clinical signs/symptoms and outcomes in a well-defined cohort of patients with AD dementia could yield new insights into the process and accelerate the development of disease-modifying therapies. The need for such development was recognized in the call for new models of AD progression/outcomes in the recommendations from the 2015 National Institutes of Health AD Research Summit . The model reported in this paper is intended to advance this development.
Our prior work in this area was focused on maximum likelihood estimation and cross-validation of a longitudinal Grade of Membership (L-GoM) model of AD clinical signs/symptoms [6,7,8]. L-GoM is a latent-variable model that resolves the difficult problem of extending multivariate latent-variable analysis from cross-sectional to longitudinal data [9, 10]. Under our prior L-GoM model, the maximum likelihood estimates of the basic parameters (i.e., the individual-specific “GoM scores”) were treated as data-based computational phenotypes [11, 12] that quantified the underlying neuropathophysiological processes giving rise to the clinical manifestations of AD recorded in the longitudinal data. In effect, the GoM scores were assumed to model the entire disease process, capturing individual differences in presentation and progression over time. The challenge in estimation was to find the optimal mapping from the data to the GoM scores.
In the present study, we modified and extended L-GoM to directly map the GoM scores to individual-specific values of residual total life expectancy (TLE) and its decomposition into disability-free life expectancy (DFLE) and disabled life expectancy (DLE), thereby obtaining a composite mapping from the data to an important set of AD timing estimates with direct clinical interpretability. To construct this composite mapping, we respecified L-GoM as an extension of Sullivan’s life table (SLT) .
The combined SLT/L-GoM model has four advantages over existing alternatives. First, the standard Cox model  assumes that covariates are fixed at baseline and hazard rates are proportional over follow-up time. Neither assumption holds for AD (e.g., see  and Fig. 4 below). Second, the time-dependent Cox model  resolves the first problem but introduces a new problem: temporal changes in covariates are not modeled, implying that another model (e.g., a general linear mixed model [16,17,18]) is needed to represent those changes. Third, cognitive, functional, behavioral, psychiatric, and other measures and their changes are correlated for patients with AD, presenting formidable technical challenges for modeling AD progression under existing approaches [2, 19]. L-GoM meets these challenges by using latent variables (GoM scores) to generate the correlations between the observed covariates . Fourth, L-GoM incorporates the SLT without making any assumptions about the transitions between healthy and morbidity/disability states, a difficult task in AD modeling [19, 20].
Our prior L-GoM model used one of two separate study cohorts, Predictors 1 (N = 252), for estimation and the second, Predictors 2 (N = 254), for cross-validation [7, 8]. Several technical refinements have since been developed to meet the SLT assumptions, to incorporate fixed genetic and other data, and to optimize the model for personalized predictive applications. In the remainder of this paper, we present and apply the newly developed SLT/L-GoM model to the Predictors 2 data; characterize the most salient clinical features of the resulting subtypes; present estimates of TLE, DFLE, and DLE for the associated subgroups; and discuss how the model can be used in future research and clinical applications, including situations where the input data come from just one examination concurrent with or shortly after AD diagnosis .
We used L-GoM to characterize the natural history of AD in a cohort of 229 participants (91 men, 138 women) over 21 semiannual examinations (spanning 10 years) in the Predictors 2 Study cohort (1997–2011),Footnote 1 the second of two highly coordinated cohort studies designed to investigate the natural history of AD and to develop improved prediction models . The Predictors 2 Study cohort was representative of patients with AD with mild disease severity at the time of enrollment at three specific study sites specializing in AD—Columbia University College of Physicians and Surgeons, Johns Hopkins University School of Medicine, and Massachusetts General Hospital—but was not necessarily representative of the general AD population. An essential requirement for the present analysis was that the data adequately covered the full range of patient outcomes over the 21 examinations, and this was met by selecting study sites with different disciplinary specializations: neurology at Columbia, psychiatry at Johns Hopkins, and geriatric neurobehavior at Massachusetts General Hospital. All subjects were diagnosed with “probable AD” on the basis of 1984 National Institute of Neurological and Communicative Disorders and Stroke-Alzheimer’s Disease and Related Disorders Association criteria, equivalent to “probable AD dementia” on the basis of 2011 National Institute on Aging-Alzheimer’s Association criteria [22, 23]. Date of death was reported for 186 of the 229 participants, and AD was confirmed in 96% of available postmortem diagnostic evaluations . Almost all participants had mild dementia at the time of recruitment into the study. Of 226 participants with complete Clinical Dementia Rating (CDR) data [25, 26], only 9 scored > 1; of 219 participants with complete Mini Mental State Examination (MMSE)  results, only 4 scored < 16; and of 217 participants with complete CDR and MMSE scores, only 1 crossed both of the indicated thresholds.
A total of 119,115 distinct data points (i.e., responses) for the 229 participants were available for model fitting for the 79 covariates listed in Table 1; 6 were fixed at the intake examination, and 73 were time-varying. All 79 covariates had p < 0.05 based on Wilks’ chi-square test ; 19 others (including education) with nonsignificant p values were excluded from the model. The 73 time-varying covariates spanned 11 measurement domains: (1) behavior, (2) cognition, (3) functioning, (4) dependence, (5) eyesight/hearing problems, (6) acute medical treatments/conditions, (7) psychiatric/psychotic symptoms, (8) alcohol use, (9) motor signs/symptoms, (10) depression/agitation, and (11) dementia with Lewy body symptoms.
Because the SLT/L-GoM model is a new synthesis of the SLT  and L-GoM [7, 8, 29] models, this section provides a self-contained nontechnical explanation for readers interested in understanding the model and interpreting its results. The mathematics underlying this synthesis are provided separately in Additional file 1 at a level of detail sufficient to reproduce our results and apply the model to similar data.
GoM scores and disease subtypes
L-GoM is actually a family of AD models distinguished by differing numbers of prognostic subtypes. For each such model, L-GoM defines one additional endpoint or terminal subtype of AD that can be approached gradually over time as disease severity increases. The progressive nature of disease severity leads to consideration of a continuum of severity scores that, in turn, give rise to the mixed membership structure  of the L-GoM model. Here we consider three variants of L-GoM with increasing complexity and applicability. The terms subtype scores and GoM scores are used interchangeably hereinafter.
The most basic model represents two ordered subtypes of AD: (1) mild subtype 1 (prognostic) and (2) severe subtype 2 (terminal). Under this model, a patient exhibits mild AD at the time of disease onset; some years later, the patient progresses to severe AD. In between, the patient exhibits intermediate levels of AD that can be characterized by a continuum of severity scores in the range 0–100% or, equivalently, mildness scores in the range 100–0%. Fractional scores are allowed; the sum of the scores must be held fixed at 100%. Because intake into the Predictors 2 Study necessarily occurs sometime after disease onset, the initial mildness score of a patient with AD may be < 100%, and this is the sole source of heterogeneity in initial AD presentation. AD progression occurs along this same continuum: Any two patients with the same initial mildness score have the same prognosis; alternatively, if one patient has greater initial severity than the other, then his/her prognosis is worse.
A more realistic model relaxes these assumptions using three ordered subtypes of AD: (1) mild subtype 1 (prognostic), (2) moderate subtype 2 (prognostic), and (3) severe subtype 3 (terminal). This model assigns corresponding sets of three subtype scores to patients with AD at the intake examination; the scores can be any set of three values in the range 0–100% whose sum is fixed at 100%. This model introduces an important new requirement: The ordering of the subtypes must be nonlinear in the sense that subtype 2 cannot be represented as an intermediate point between subtypes 1 and 3; if it can, then subtype 2 can be represented as a weighted mixture of subtypes 1 and 3, and the model structure will revert to the first variant. Hence, the labeling of subtype 2 as moderate implies only that its overall severity is greater than for subtype 1; no specific order is assumed for the severities of the individual covariates (i.e., clinical signs/symptoms). Equivalently, subtype 2 reflects additional heterogeneity in initial AD severity that cannot be represented in the more basic model; this heterogeneity is expressed most strongly at or near the time of study intake and is reflected in the measurements made at examination 1. AD progression rates differ between the prognostic subtypes, as described below.
The provisions for initial heterogeneity can be further extended using four nonlinearly ordered subtypes of AD: (1) mild subtype 1 (prognostic), (2) mild-moderate subtype 2 (prognostic), (3) moderate subtype 3 (prognostic), and (4) severe subtype 4 (terminal). Their corresponding sets of subtype scores are in the range 0–100% whose sum is fixed at 100%. The requirement for nonlinear ordering means that no subtype can be represented as an intermediate point between any other pair of subtypes; if it can, then that subtype can be represented as a weighted mixture of the other pair of subtypes, and the model structure will revert to one of the simpler variants. As above, the labeling of subtypes 1–3 as mild, mild-moderate, and moderate implies only that the overall severities are in increasing order; no specific order is assumed for the severities of the individual covariates.
Maximum likelihood estimation requires that the study sample be (1) sufficiently heterogeneous at initial intake to fully span the range of the initial prognostic subtypes and (2) followed sufficiently long (i.e., until death for most subjects) to identify different rates and types of progression from the initial presentation to severe AD. The Predictors 1 and 2 studies met these requirements. Our previous analysis of the Predictors 1 Study overwhelmingly supported a model with four subtypes , so this model was used for the present analysis of the Predictors 2 Study.
AD progression is represented in L-GoM as irreversible movement in the GoM score continuum away from the prognostic subtypes toward the terminal subtype, which is implemented by allowing the GoM scores to change from one examination to the next (while always summing to 100%). The simplest type of AD progression is movement away from a specific prognostic subtype toward the terminal subtype. The assumed ordering of the subtypes prohibits any movement from a higher-numbered to a lower-numbered subtype. For our model, which incorporates four subtypes, the progression away from subtype 1 may include movement toward subtypes 2 and/or 3 before ultimately heading toward subtype 4. The cumulative transitions from the prognostic subtypes to the terminal subtype may be incomplete in the sense that the terminal subtype score for the last examination may be < 100%.
L-GoM assumes that the paths or trajectories in the GoM score continuum extending from each prognostic subtype toward the terminal subtype are deterministic and are fundamental properties of the AD subtypes. If a given patient scores 100% on a given prognostic subtype, then the patient’s AD trajectory is fully determined. We refer to these as the pure-subtype trajectories.
L-GoM uses the pure-subtype trajectories as the basis of its model of AD progression among patients with mixed GoM scores at the initial examination (i.e., sets of subtype scores for which no individual score equals 100%). For each such patient, the corresponding trajectory is modeled as a weighted combination of the pure-subtype trajectories using his/her initial GoM scores as weights. Each GoM score weighted combination of the pure-subtype trajectories defines a unique deterministic trajectory from the initial point in the GoM score continuum toward the terminal subtype, generating a deterministic sequence of time-varying GoM scores in one-to-one correspondence with the study examinations. We refer to these as the GoM score trajectories.
This model of AD progression ensures that the range of the time-varying GoM scores contracts over time as patients move away from the prognostic subtypes toward the terminal subtype. Hence, the data from examination 1 should be given greater weight in the maximum likelihood estimation procedure because that is the only examination for which the GoM scores can fully span the range of the prognostic subtypes. The weighting procedure for examination 1 in the present study ensured that the L-GoM estimates for all examinations were consistent with the corresponding cross-sectional GoM estimates for examination 1 alone (see Additional file 1: Appendix).
Outcome probabilities and λ parameters
Application of maximum likelihood to longitudinal data such as that in the Predictors 2 Study requires that all variables used in the analysis be coded as discrete categorical variables (e.g., 0 or 1 for binary responses). For each AD subtype, the probability of each possible response for each measured variable was estimated under the assumption that the probability was constant over all examinations. These probabilities are referred to as the pure-subtype probabilities or λ parameters (because they are denoted using the symbol λ in the mathematical formulas). For each subject, the probability of each given response for each measured variable was determined at each examination as a time-varying GoM score weighted combination of the corresponding pure-subtype probabilities.
Sullivan’s life table
Because the L-GoM model can effectively predict the probability of any event occurring at any time during follow-up, it is ideal for constructing life table survival models where death is the endpoint event and TLE is the statistic of interest. Here, we extended L-GoM to allow DFLE and DLE to be estimated using the SLT method . Sullivan  showed that the overall time of survival (i.e., TLE) could be decomposed into the time spent in healthy (i.e., DFLE) and morbidity/disability (i.e., DLE) states by multiplying the overall survival function value at each examination by the respective morbidity/disability prevalence rate, summarizing the results using standard life table calculations. Imai and Soneji  showed that (1) the SLT method was statistically optimal in applications to longitudinal cohort data, justifying its use in medical follow-up studies; and (2) DFLE and DLE can be estimated without making any assumptions about the underlying transition rates.
In the present study, the L-GoM model allowed an overall survival function to be generated for each subject as the product of the conditional survival probabilities defined for each 6-month interval between adjacent examinations. Disability was defined as the need for full-time care (FTC), a major disability endpoint in AD research [32,33,34] and the highest outcome category for the equivalent institutional care variable. TLE was generated as the area under the subject’s overall survival function. DFLE and DLE were generated as the area under the subject’s disability-free and disabled survival functions, using the SLT method to apply his/her estimated FTC disability-free and FTC disability probabilities to the overall survival function at each examination to generate the component survival functions.
Goodness of fit
Although the SLT calculations were conducted separately for each individual subject in the study, it was not feasible to assess the goodness of fit of the model at the individual level. Instead, we divided the 229 study participants into five relatively homogeneous subgroups (i.e., so-called rational subgroups ) on the basis of their GoM scores on the four AD subtypes identified by the L-GoM model. The five subgroups comprised those individuals predominantly expressing one subtype at the initial examination (i.e., with exactly one GoM score > 50%) plus a residual “subgroup 0” (i.e., with no GoM score > 50%). We employed the SLT/L-GoM model to estimate total, disabled, and disability-free 10-year survival functions and life expectancies, overall and by subgroup, using FTC to define disability. We assessed the goodness of fit of model-based to observed values by subgroup for the 21 examinations using pointwise and simultaneous confidence bands  for the overall survival curves and pointwise confidence bands for the FTC probabilities.
Characterization of subtypes
The four disease subtypes and their trajectories were determined using procedures detailed in Additional file 1: Table A.2 (see Additional file 1: Appendix) displays the Kullback-Leibler information statistics  used to assess the relative importance of each covariate for each of the four AD subtypes. Additional file 1: Table A.3 displays the corresponding λ parameters. Additional file 1: Table A.5 displays the corresponding pure-subtype trajectories. The statistics in Additional file 1: Tables A.2 and A.3 are summarized in Table 2 below in a form that characterizes the four subtypes according to the size and direction of the effects exhibited by the 35 most salient covariates in the model. Each combination of subtype and covariate was coded as exhibiting low (L), medium (M), or high (H) severity, but only if the associated λ parameters exhibited relatively large differences from the corresponding marginal probabilities for randomly selected patients with AD (i.e., computed by averaging over all completed examinations, not just examination 1). Operationally, the L-M-H designation was made only if the Kullback-Leibler information statistic  was > 0.50 (see Additional file 1: Appendix); otherwise, the covariate severity remained unclassified for the subtype. The M designation was used only for covariates with three or more severity levels, and only if an unambiguous H or L designation could not be made.
The severity patterns in Table 2 show that the subtypes are quite distinct. Subtype 1 had the largest number of covariates exhibiting low severity (n = 17). Subtype 2 had low severity for 5 of the same 17 covariates. Subtype 3 showed no overlap in severity designations with subtype 1 or 2. Subtypes 3 and 4 had high severity on 11 and 17 covariates, respectively, but the high-severity designations did not overlap. Subtypes 3 and 4 had medium and high severity, respectively, on the equivalent institutional care variable (number 53, the only covariate for which both subtypes had severity codes), on the basis of their respective use of adult home care vs. FTC. Equivalent institutional care was the top-ranked covariate (based on p values).
Subtype 4, representing the terminal endpoint of the AD process, had high patient dependence, moderate extrapyramidal symptoms, poor cognition, and highly impaired functioning. Subtype 3 was the only subtype with any severity designations on items within domains 1, 7, and 10 (behavior, psychiatric/psychotic symptoms, and depression/agitation), and it was the only subtype with high severity on the personality items within domain 3 (Blessed Dementia Rating Scale [BDRS]). Hence, psychiatric and behavioral symptoms, personality changes, and depression were strongly exhibited only by subtype 3. Subtype 1 had low initial severity on 17 items, slow AD progression (Additional file 1: Table A.5), and the best prognosis. Subtype 2 had low initial severity on five items, fast AD progression (Additional file 1: Table A.5), and the worst prognosis. Compared with subtype 1, subtype 2 was more likely to be female, be older, score lower on the MMSE, and be homozygous for the apolipoprotein E (ApoE) ε4 allele.
We evaluated the assumption that overall severity increased over subtypes by applying the LMH severity coding procedure to five summary measures: CDR , MMSE score , BDRS score [38, 39], Dependence Scale score , and psychiatric symptoms [41, 42] (Table 2). The severity codes for subtypes 1 and 2 were indistinguishable on four of the five summary measures, the exception being MMSE, with subtype 1 coded low (L) and subtype 2 unclassified. The severity for subtype 3 was higher than for subtype 1 on all five summary measures and higher than for subtype 2 for all but MMSE. Thus, the results for the summary measures exhibited monotonic severity patterns, which confirmed the assumed overall ordering of the subtypes; moreover, taken as a set, the severity codes were consistent with the labeling of the subtypes as mild, mild-moderate, moderate, and severe.
A finding of great prognostic significance was that the rate of AD progression was substantially faster for subtype 2 than for subtype 3, which, in turn, was substantially faster than for subtype 1 (Additional file 1: Table A.5). The ordering reversal between subtypes 2 and 3 was maintained throughout the 10-year study period, with the fourth component of the pure-subtype trajectories reaching final values of 0.58, 0.99, and 0.93, respectively, for subtypes 1–3.
The relationships between the three prognostic subtypes and the five subgroups can be visualized using the scatterplot on the left side of Fig. 1. Except for ten subjects located at the subtype 1 vertex and three subjects at the subtype 2 vertex, the scatterplot shows no evidence of clustering of the subjects. The subtype 3 vertex was unoccupied (because the highest GoM score for subtype 3 was 0.89); moreover, the nearby regions were thinly populated. The five subgroups are color-coded in Fig. 1; they were constructed to be cleanly separated and substantially more homogeneous than the overall sample (see Additional file 1: Table A.7). In contrast, the scatterplot on the right side of Fig. 1 shows that, although the sex effect was highly significant (p = 0.00007) (Additional file 1: Table A.2), males and females were distributed throughout the plot with no clean separation. Females, however, had their highest relative concentrations near subtype 2 and between subtypes 1 and 2. Males had their highest relative concentrations between subtypes 1 and 3 and between subtypes 2 and 3; seven males were located at the subtype 1 vertex.
Observed vs. estimated survival
The basic 6-month mortality probabilities (λ parameters) were 0.6% and 16.0% for subtypes 1 and 4, respectively, and zero for subtypes 2 and 3 (Additional file 1: Table A.3), indicating that individual mortality was determined by subtypes 1 and 4 alone, constrained to the range 0–16.0%, with the rate at time t primarily determined by an individual’s time-varying GoM score on subtype 4 (maximum 16.0%). Figure 2 displays the observed vs. estimated survival curves for all participants, males and females, and subgroups 0–4. The estimates were almost all within the simultaneous 95% confidence bands around the observed values, the sole exceptions being subgroup 2 at 3.5–4.5 years.
Observed vs. estimated need for full-time care
FTC represents “around-the-clock supervision of personal care, safety, or medical care” , as measured by the top-ranked covariate, equivalent institutional care. The basic disability probability (λ parameter) was 83.2% for subtype 4 and zero for subtypes 1–3 (Additional file 1: Table A.3), with the rate at time t fully determined by an individual’s time-varying GoM score on subtype 4. Figure 3 displays the observed vs. estimated FTC rates for all participants, males and females, and subgroups 0–4. The estimated FTC rates increased over time for both sexes and all subgroups. The fits to the observed FTC rates were excellent; all but three estimated values (both sexes and females at 6 years and subgroup 2 at 6.5 years) were within the pointwise 95% confidence bands around the observed values.
Survival functions and life expectancies
Figure 4 displays the overall survival curves (left side) and the corresponding FTC disability-free survival curves (right side) for all participants and subgroups 0–4. Both sets of survival curves decreased monotonically over time and were strongly separated by subgroup. Subgroup 2 crossed over subgroup 0 at 2.5 and 1.5 years, respectively, implying that the underlying hazards were not proportional.
Table 3 displays the means, 95% CIs, and ranges of the 10-year TLEs, DFLEs, and DLEs for all participants and subgroups 0–4, assuming that survival beyond year 10 (examination 21) was censored. The TLEs and DFLEs are the areas under the respective plots in Fig. 3. Whereas the DFLEs varied widely across subgroups, the DLEs did not; the relative variation of the TLEs was intermediate between that of the DFLEs and DLEs. Mean 10-year TLE differed widely across subgroups: range 3.57–7.98 years, average 6.09 years. Mean 10-year DFLE differed relatively even more widely across subgroups: range 1.23–6.47 years, average 4.03 years. Mean 10-year DLE was relatively much closer: range 1.51–2.34 years, average 2.06 years. Subgroup 4 was distinguished by its relatively short DFLE (1.23 years) and subgroup 1 by its relatively long DFLE (6.47 years). Among the subgroups most closely related to the prognostic subtypes (1–3), subgroup 2 had the shortest DFLE and the longest DLE at 2.85 and 2.33 years, respectively.
This study provides the first published estimates of the L-GoM extension of the SLT model. Our motivation for this extension was fourfold. First, our analysis supports the hypothesis that patients with AD are heterogeneous in initial presentation and in rates of progression , implying that adequate characterization of the clinical course of AD requires a parsimonious multivariate latent-variable model such as L-GoM . Second, the ability to directly map the GoM scores to TLE, DFLE, and DLE focuses attention on these readily understood, familiar metrics. This contrasts with existing factor analytic models  that cannot incorporate the SLT model and cannot extract TLE, DFLE, and DLE from patient-level longitudinal data [10, 19]. Third, predictions of TLE, DFLE, DLE, and associated survival curves for many types of disability, especially FTC, are central to important decisions in AD treatment and patient care; they represent information that patients with AD, their families, and caregivers want to know. Fourth, the L-GoM extension of the SLT model can be used to assess the effects of treatment on disability-free and disabled survival. Lifetime costs can be calculated by combining estimated survival curves and cost functions for selected disability measures, implying that the SLT/L-GoM model can be used as a realistic, comprehensive modeling framework for endpoint and resource use/cost calculations for individual patients with AD and subgroups. The appendix in Additional file 1 provides all parametric estimates needed for hypothesis generation and further exploration of AD using the SLT/L-GoM model (Additional file 1: Tables A.3–A.6).
Our prior L-GOM model was based on longitudinal data from the Predictors 1 Study cohort . Subsequently, we forward-applied that model to baseline data from the Predictors 2 Study cohort and showed that it accurately predicted times to FTC, nursing home care, and death . Although that model was a major advancement, we updated the L-GoM model in this study for four reasons, described below.
First, several advances were made to the L-GoM estimation software, including more accurate representations of the effects of fixed covariates such as sex, race, age, occupation, and ApoE status, using only information from examination 1, which satisfies Drachman’s  call for prognostic covariates that are independent of initial severity. Race was dichotomized as white vs. nonwhite because of an insufficient sample size to support further stratification. Only 17 of the 229 subjects were nonwhite. Education was evaluated as a potential covariate, but it did not contribute significantly to the model (p = 0.30). Only 8 of the 229 subjects had less than 9 years of education. Another advance was the weighted maximum likelihood estimation procedure, which took into account the unique status of examination 1 as the only examination that spans the full range of the prognostic subtypes (Fig. 1). The algorithm for generating the excess weight for examination 1 used the Akaike information criterion procedure  to limit the loss of fit for examinations 2–21 and maintain the accuracy of the estimated pure-subtype trajectories extending from the prognostic subtypes to the terminal subtype (Additional file 1: Table A.5).
Second, the Predictors 2 Study had several advantages over Predictors 1, including the availability of ApoE genotype at examination 1. The updated model used pooled male/female data; the prior model used sex-specific data. The pooled data yielded more accurate parametric estimates, which revealed significant sex and ApoE genotype differences.
Third, the updated model incorporated several new covariates and refined versions of others, including individual items from the BDRS [38, 39] and MMSE , individual motor signs, and depression measures. These changes contributed significantly to the characterization of prognostic subtype 3, allowing the clinical presentation of this subtype to be clearly distinguished from that of subtype 2 (Table 2). Six summary measures were processed using conditional maximum likelihood estimation procedures that did not impact the estimated GoM scores. They were ranked as follows (based on p values) (Additional file 1: Table A.2): dependence scale score , BDRS score [38, 39], CDR rating , MMSE score , psychiatric symptoms [41, 42], and total weekly alcohol consumption ; the top five were included in Table 2.
Fourth, the updated model generated maximum likelihood estimates of the TLEs, DFLEs, and DLEs for individual patients with AD and for the aggregates of individual patients in subgroups 0–4 . We assessed the validity of the updated model by showing that the GoM subgroups all had very accurate predictions of FTC and mortality at or following each of the 21 examinations (Figs. 2 and 3). This assessment is new; it was not done for the prior model. It follows that the updated model generates even more accurate, valid, and informative representations of AD progression than the prior model. The updated model also explains why our prior Cox analyses [14, 32] were successful in predicting FTC and mortality. Both endpoints were strongly associated with subtype 4, the terminal subtype of the L-GoM process. Hence, any covariate strongly associated with subtype 4 should work well as a predictor in the Cox model  (e.g., those with high severity for subtype 4 in Table 2).
By creating relatively homogeneous rational subgroups  of patients, such as subgroups 0–4 in Predictors 2, we could demonstrate that the estimated survival closely matched the actual survival for any homogeneous subgroup. The goodness-of-fit plots in Figs. 2 and 3 showed that the survival and disability (need for FTC) variables were well-estimated for all subgroups and observation times. These variables were but 2 of the 80 variables in the final model; they were treated like the other 78 variables so that the results could be representative of the entire AD process. Alternative measures of disability could be incorporated into these calculations on the basis of any of the disability-related covariates included in the study. Zehna’s theorem  ensures that the resulting individual-specific TLEs, DFLEs, and DLEs are maximum likelihood estimates (see Additional file 1). Forward application of the model to other prospective datasets will be required to further validate its statistical optimality and general applicability; these analyses are underway.
The weighted maximum likelihood estimation procedure ensures that the GoM score estimates from examination 1 alone are of high quality. It follows that maximum likelihood estimates of patient-specific GoM scores and survival curves can be generated conditionally on the parameters presented in Additional file 1: Tables A.3 and A.4 using input data from just one examination concurrent with or shortly after AD diagnosis . Hence, the SLT/L-GoM model could be used for personalized predictive modeling for new patients with AD—with important caveats. Accurate estimation of the individual survival curves and associated TLEs, DFLEs, and DLEs is not equivalent to precise estimation of observed times to specific disease endpoints; the timing is inherently stochastic. This stochasticity could be handled if, in addition to the mean estimates, individual patients with AD, or their physicians, families, and caregivers, were supplied with estimates of key quantiles (e.g., 10th, 25th, 75th, and 90th percentiles) of the individualized survival curves. Our findings in the present study indicate that the DFLEs differed widely as a function of GoM subgroup at the initial visit, whereas the DLEs were relatively much closer (Table 3). Hence, the variability of the TLEs is attributable primarily to the variability of the DFLEs, underscoring the importance of DFLE in prognostic applications.
Our analyses have several important limitations. First, the Predictors 2 Study cohort was a nonrandom collection of participants enrolled at three specific study sites specializing in AD, which may limit the generalizability of our results . Second, the full SLT/L-GoM model can only be estimated using longitudinal data with extensive sets of time-varying covariates at each examination. However, if such data have already been assembled, then SLT/L-GoM provides a highly efficient mode of analysis. Third, the assumed form and temporal structure of L-GoM may be oversimplified, reflecting the limited sample size available in the Predictors 2 Study, which required just two nonzero λ parameters to generate the entire ensemble of individual survival curves and just one λ parameter for the corresponding FTC curves. Subsequent applications may require additional λ parameters or more subtypes.
There are several other potential applications of L-GoM and its SLT extension. One would use L-GoM to determine expected progression in drug and placebo groups in clinical trials evaluating the effectiveness of randomization prior to the trial and comparing modeled vs. actual progression in the drug group after the trial . Alternatively, L-GoM could be used to explore how the clinical symptoms/signs captured by it correlate with measured AD biomarkers, such as by testing concurrent and lagged associations of biomarkers and time-varying GoM scores, associations that could elucidate the connections between DFLE/DLE and the neuropathology of AD [48, 49]. With such applications, the model and its results have the potential to stimulate rapid progress in the fight against AD.
The objective of the present study was to assess the accuracy of the estimates produced by the SLT/L-GoM model. This required that we generate for the first time a comprehensive, individualized multidomain model of AD progression covering the first 10 years following study intake and incorporating a composite mapping leading directly from the longitudinal data to the individual-specific TLEs, DFLEs, and DLEs. The substantial heterogeneity in initial patient presentation and AD progression was captured using three clinically meaningful prognostic subtypes (subtypes 1–3) and one terminal subtype (subtype 4) exhibiting highly differentiated symptom severity on 7 of the 11 measurement domains in the model (Table 2). The rates of progression for subtype 2 (mild-moderate severity at examination 1) were found to be substantially faster than for subtype 3 (moderate severity at examination 1), underscoring the need to distinguish these subtypes in clinical prognostication. The mixed membership property of the model was used to define five relatively homogeneous but diverse patient subgroups, four of which (1–4) had high GoM scores on the respective prognostic/terminal subtypes, with the fifth defined as a residual subgroup. The model yielded accurate maximum likelihood estimates of TLE, DFLE, and DLE and associated survival and disability probabilities for all five subgroups. Thus, the model provides a realistic, comprehensive framework for endpoint and resource use/cost calculations for patients with AD.
Our prior analysis of Predictors 2 had N = 254 , but the study was ongoing. The final sample size was 267; of these, 38 were diagnosed as having Lewy body dementia at the intake examination and were excluded from the present analysis.
Basic activities of daily living
Blessed Dementia Rating Scale
Clinical Dementia Rating
Columbia University Scale for Psychopathology in Alzheimer’s Disease
Disability-free life expectancy
Dementia with Lewy bodies
Disabled life expectancy
Instrumental activities of daily living
Longitudinal Grade of Membership
Low, medium, or high severity
Mini Mental State Examination
Sullivan’s life table
Total life expectancy
Unified Parkinson’s Disease Rating Scale
Mayeux R, Stern Y, Spanton S. Heterogeneity in dementia of the Alzheimer type: evidence of subgroups. Neurology. 1985;35:453–61.
Cohen JT, Neumann PJ. Decision analytic models for Alzheimer’s disease: state of the art and future directions. Alzheimers Dement. 2008;4:212–22.
Jack Jr CR, Knopman DS, Jagust WJ, Shaw LM, Aisen PS, Weiner MW, Petersen RC, Trojanowski JQ. Hypothetical model of dynamic biomarkers of the Alzheimer’s pathological cascade. Lancet Neurol. 2010;9:119–28.
Novel approaches to diagnosing Alzheimer’s disease & predicting progression (R01). http://grants.nih.gov/grants/guide/pa-files/PAR-15-359.html. Accessed 31 May 2017.
National Institute on Aging. Recommendations from the NIH AD Research Summit 2015. https://www.nia.nih.gov/research/recommendations-nih-ad-research-summit-2015. Accessed 31 May 2017.
Kinosian BP, Stallard E, Lee JH, Woodbury MA, Zbrozek AS, Glick HA. Predicting 10-year care requirements for older people with suspected Alzheimer’s disease. J Am Geriatr Soc. 2000;48:631–8.
Stallard E, Kinosian B, Zbrozek AS, Yashin AI, Glick HA, Stern Y. Estimation and validation of a multiattribute model of Alzheimer disease progression. Med Decis Making. 2010;30:625–38.
Razlighi QR, Stallard E, Brandt J, Blacker D, Albert M, Scarmeas N, Kinosian B, Yashin AI, Stern Y. A new algorithm for predicting time to disease endpoints in Alzheimer’s disease patients. J Alzheimers Dis. 2014;38:661–8.
Tractenberg RE, Aisen PS, Weiner MF, Cummings JL, Hancock GR. Independent contributions of neural and “higher-order” deficits to symptoms in Alzheimer’s disease: a latent variable modeling approach. Alzheimers Dement. 2006;2:303–13.
Green C, Shearer J, Ritchie CW, Zajicek JP. Model-based economic evaluation in Alzheimer’s disease: a review of the methods available to model Alzheimer’s disease progression. Value Health. 2011;14:621–30.
Lasko TA, Denny JC, Levy MA. Computational phenotype discovery using unsupervised feature learning over noisy, sparse, and irregular clinical data. PLoS One. 2013;8:e66341.
Ho JC. Clinically Interpretable Models for Healthcare Data [dissertation]. Austin: University of Texas at Austin, Department of Electrical and Computer Engineering; 2015.
Sullivan DF. A single index of mortality and morbidity. HSMHA Health Rep. 1971;86:347–54.
Cox DR. Regression models and life-tables. J R Stat Soc Series B Stat Methodol. 1972;34:187–220.
Therneau TM, Grambsch PM. Modeling survival data: extending the Cox model. New York: Springer; 2000.
Cnaan A, Laird N, Slasor P. Tutorial in biostatistics: using the general linear mixed model to analyse unbalanced repeated measures and longitudinal data. Stat Med. 1997;16:2349–80.
Jutkowitz E, MacLehose RF, Gaugler JE, Dowd B, Kuntz KM, Kane RL. Risk factors associated with cognitive, functional, and behavioral trajectories of newly diagnosed dementia patients. J Gerontol A Biol Sci Med Sci. 2017;72:251–8.
Doody RS, Pavlik V, Massman P, Rountree S, Darby E, Chan W. Predicting progression of Alzheimer’s disease [published erratum appears in Alzheimers Res Ther. 2010;2:14]. Alzheimers Res Ther. 2010;2:2.
Green C, Zhang S. Predicting the progression of Alzheimer’s disease dementia: a multidomain health policy model. Alzheimers Dement. 2016;12:776–85.
Neumann P, Araki S, Arcelus A, Longo A, Papadopoulos G, Kosik KA, Kuntz K, Bhattacharjya A. Measuring Alzheimer’s disease progression with transition probabilities: estimates from CERAD. Neurology. 2001;57:957–64.
Stern Y, Folstein M, Albert M, Richards M, Miller L, Bylsma F, Lafleche G, Marder K, Bell K, Sano M. Multicenter study of predictors of disease course in Alzheimer disease (the “Predictors Study”). I. Study design, cohort description, and intersite comparisons. Alzheimer Dis Assoc Disord. 1993;7:3–21.
McKhann G, Drachman D, Folstein M, Katzman R, Price D, Stadlan EM. Clinical diagnosis of Alzheimer’s disease: report of the NINCDS-ADRDA Work Group under the auspices of Department of Health and Human Services Task Force on Alzheimer’s Disease. Neurology. 1984;34:939–44.
McKhann GM, Knopman DS, Chertkow H, Hyman BT, Jack CR, Kawas CH, Klunk WE, Koroshetz WJ, Manly JJ, Mayeux R. The diagnosis of dementia due to Alzheimer’s disease: recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimers Dement. 2011;7:263–9.
Zhu C, Scarmeas N, Torgan R, Albert M, Brandt J, Blacker D, Sano M, Stern Y. Clinical features associated with costs in early AD: baseline data from the Predictors Study. Neurology. 2006;66:1021–8.
Hughes CP, Berg L, Danziger WL, Coben LA, Martin RL. A new clinical scale for the staging of dementia. Br J Psychiatry. 1982;140:566–72.
Dooneief G, Marder K, Tang MX, Stern Y. The Clinical Dementia Rating scale: community-based validation of “profound” and “terminal” stages. Neurology. 1996;46:1746–9.
Folstein MF, Folstein SE, McHugh PR. “Mini-mental state”: a practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12:189–98.
Wilks SS. The large-sample distribution of the likelihood ratio for testing composite hypotheses. Ann Math Stat. 1938;9:60–2.
Stallard E, Sloan FA. Analysis of the natural history of dementia using longitudinal Grade of Membership models. In: Yashin AI, Stallard E, Land KC, editors. Biodemography of aging: determinants of healthy life span and longevity. Dordrecht, The Netherlands: Springer Netherlands; 2016. p. 353–418.
Airoldi EM, Blei DM, Erosheva EA, Fienberg SE, editors. Handbook of mixed membership models and their applications. Boca Raton, FL: Chapman & Hall/CRC Press; 2015.
Imai K, Soneji S. On the estimation of disability-free life expectancy: Sullivan’s method and its extension. J Am Stat Assoc. 2007;102:1199–211.
Stern Y, Tang MX, Albert MS, Brandt J, Jacobs DM, Bell K, Marder K, Sano M, Devanand D, Albert SM, et al. Predicting time to nursing home care and death in individuals with Alzheimer disease. JAMA. 1997;277:806–12.
Caro JJ, Getsios D, Migliaccio-Walle K, Raggio G, Ward A, Group AS. Assessment of health economics in Alzheimer’s disease (AHEAD) based on need for full-time care. Neurology. 2001;57:964–71.
Rive B, Le Reun C, Grishchenko M, Cochran J, Katona C, Livingston G, Lamure M, Toumi M, François C. Predicting time to full-time care in AD: a new model. J Med Econ. 2010;13:362–70.
Sefik M. Importance of the rational subgroups in designing control charts. Comput Ind Eng. 1998;35:205–8.
Nair VN. Confidence bands for survival functions with censored data: a comparative study. Technometrics. 1984;26:265–75.
Kullback S, Leibler RA. On information and sufficiency. Ann Math Stat. 1951;22:79–86.
Blessed G, Tomlinson BE, Roth M. The association between quantitative measures of dementia and of senile change in the cerebral grey matter of elderly subjects. Br J Psychiatry. 1968;114:797–811.
Stern Y, Hesdorffer D, Sano M, Mayeux R. Measurement and prediction of functional capacity in Alzheimer’s disease. Neurology. 1990;40:8–14.
Stern Y, Albert SM, Sano M, Richards M, Miller L, Folstein M, Albert M, Bylsma FW, Lafleche G. Assessing patient dependence in Alzheimer’s disease. J Gerontol. 1994;49:M216–22.
Devanand D, Miller L, Richards M, Marder K, Bell K, Mayeux R, Stern Y. The Columbia University Scale for Psychopathology in Alzheimer’s Disease. Arch Neurol. 1992;49:371–6.
Scarmeas N, Brandt J, Albert M, Hadjigeorgiou G, Papadimitriou A, Dubois B, Sarazin M, Devanand D, Honig L, Marder K. Delusions and hallucinations are associated with worse outcome in Alzheimer disease. Arch Neurol. 2005;62:1601–8.
Drachman DA, O’Donnell BF, Lew RA, Swearer JM. The prognosis in Alzheimer’s disease: ‘how far’ rather than ‘how fast’ best predicts the course. Arch Neurol. 1990;47:851–6.
Akaike H. Information theory and an extension of the maximum likelihood principle. In: Petrov BN, Csaki F, editors. Proceedings of the Second International Symposium on Information Theory. Budapest, Hungary: Akadémiai Kiadó; 1973. p. 267–81.
Gu Y, Scarmeas N, Short EE, Luchsinger JA, DeCarli C, Stern Y, Manly JJ, Schupf N, Mayeux R, Brickman AM. Alcohol intake and brain structure in a multiethnic elderly cohort. Clin Nutr. 2014;33:662–7.
Zehna PW. Invariance of maximum likelihood estimators. Ann Math Stat. 1966;37:744.
Spiegel R, Berres M, Miserez AR, Monsch AU. Alzheimer’s Disease Neuroimaging Initiative. For debate: substituting placebo controls in long-term Alzheimer’s prevention trials. Alzheimers Res Ther. 2011;3(9).
Zhang X, Mormino EC, Sun N, Sperling RA, Sabuncu MR, Yeo BTT, Weiner MW, Aisen P, Weiner M, Petersen R. Bayesian model reveals latent atrophy factors with dissociable cognitive trajectories in Alzheimer’s disease. Proc Natl Acad Sci U S A. 2016;113:E6535–44.
Karlawish J, Jack Jr CR, Rocca WA, Snyder HM, Carrillo MC. Alzheimer’s disease: the next frontier—Special Report 2017. Alzheimers Dement. 2017;13:374–80.
ES gratefully acknowledges use of services and facilities of the Center for Population Health and Aging at Duke University, funded by NIA Center Grant P30-AG034424. David L. Straley provided programming support at Duke University.
Financial support for this study was provided entirely by a grant from the National Institute on Aging (grant R01-AG007370). The funding agreement ensured the authors’ independence in designing the study, collecting and interpreting the data, and writing and publishing the article.
Availability of data and materials
All parameters of the SLT/L-GoM model estimated from the Predictors 2 Study cohort are included in Tables A.3–A.6 in Additional file 1: Appendix. These parameters are sufficient to reproduce all 229 GoM score trajectories, the associated survival and life expectancy statistics, and the trajectories of predicted outcomes on all 73 time-varying covariates. The Predictors 2 Study dataset is not publicly available, owing to privacy and confidentiality restrictions; access to the data is available through the corresponding author on reasonable request.
Ethics approval and consent to participate
The present study was conducted as part of protocol 7258R, which was approved by the New York State Psychiatric Institute Institutional Review Board, 1051 Riverside Drive, Box 10, New York, NY 10032, USA; email: email@example.com. Informed consent was obtained from all participants in the study.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This file has two sections and an Appendix. Section 1 presents a high-level overview of the mathematics of the L-GoM extension of the Sullivan life table model. Section 2 presents an associated irreversible disability model with two supplementary tables (Tables S1 and S2) and one figure (Figure S1). The appendix expands on the technical details of the mathematics for both sections and contains Tables A.1–A.7. (PDF 935 kb)
About this article
Cite this article
Stallard, E., Kinosian, B. & Stern, Y. Personalized predictive modeling for patients with Alzheimer’s disease using an extension of Sullivan’s life table model. Alz Res Therapy 9, 75 (2017). https://doi.org/10.1186/s13195-017-0302-6
- Alzheimer’s disease
- Grade of Membership
- Multidomain model
- Longitudinal data analysis
- Full-time care
- Disability-free life expectancy
- Disabled life expectancy
- Prognostic subtype