- Open Access
Comparing recruitment, retention, and safety reporting among geographic regions in multinational Alzheimer’s disease clinical trials
Alzheimer's Research & Therapy volume 7, Article number: 39 (2015)
Most Alzheimer’s disease (AD) clinical trials enroll participants multinationally. Yet, few data exist to guide investigators and sponsors regarding the types of patients enrolled in these studies and whether participant characteristics vary by region.
We used data derived from four multinational phase III trials in mild to moderate AD to examine whether regional differences exist with regard to participant demographics, safety reporting, and baseline scores on the Mini Mental State Examination (MMSE), the 11-item Alzheimer’s Disease Assessment Scale–Cognitive subscale (ADAS-cog11), the Clinical Dementia Rating scale Sum of Boxes (CDR-SB), the Alzheimer’s Disease Cooperative Study–Activities of Daily Living Inventory (ADCS-ADL), and the Neuropsychiatric Inventory (NPI). We assigned 31 participating nations to 7 geographic regions: North America, South America/Mexico, Western Europe/Israel, Eastern Europe/Russia, Australia/South Africa, Asia, and Japan.
North America, Western Europe/Israel, and Australia/South Africa enrolled similar proportions of men, apolipoprotein E ε4 carriers, and participants with spouse study partners, whereas Asia, Eastern Europe/Russia, and South America/Mexico had lower proportions for these variables. North America and South America/Mexico enrolled older subjects, whereas Asia and South America/Mexico enrolled less-educated participants than the remaining regions. Approved AD therapy use differed among regions (range: 73% to 92%) and was highest in North America, Western Europe/Israel, and Japan. Dual therapy was most frequent in North America (48%). On the MMSE, North America, Western Europe/Israel, Japan, and Australia/South Africa had higher (better) scores, and Asia, South America/Mexico, and Eastern Europe/Russia had lower scores. Eastern Europe/Russia had more impaired ADAS-cog11 scores than all other regions. Eastern Europe/Russia and South America/Mexico had more impaired scores for the ADCS-ADL and the CDR-SB. Mean scores for the CDR-SB in Asia were milder than all regions except Japan. NPI scores were lower in Asia and Japan than in all other regions. Participants in North America and Western Europe/Israel reported more adverse events than those in Eastern Europe/Russia and Japan.
These findings suggest that trial populations differ across geographic regions on most baseline characteristics and that multinational enrollment is associated with sample heterogeneity. The data provide initial guidance with regard to the regional differences that contribute to this heterogeneity and are important to consider when planning global trials.
Alzheimer’s disease (AD) is a worldwide pandemic. Between 1990 and 2010, the global health care burden caused by AD increased 244% . The rapid increases in prevalence and cost have led several countries to develop national plans to address AD . A goal of these plans is to advance research toward improved therapies and, in particular, drugs capable of slowing the course of the disease and delaying its onset if their use is initiated early enough. Key to developing improved AD therapies will be the conduct of robust clinical trials. AD trials present many challenges, including slow recruitment.
Most AD trials are now multinational [3,4]. Multinational trials enable expedited recruitment and are necessary to secure multinational regulatory registration and eventual patient access . Yet, these trials may also bring ethical, logistical, and scientific challenges. Trials are usually conducted only in regions in which the drug, if approved, is available . Some countries have instituted laws intended to protect citizens that may impede research conduct, and sponsors must negotiate local regulatory issues . Translated study materials may introduce instructional and cultural inaccuracies, resulting in excess psychometric variance and reduced data integrity . Global and ethnic variation in drug pharmacokinetics or pharmacodynamics may impact drug safety or efficacy [9,10].
For AD trials specifically, local laws, ethical guidelines, or practices regarding surrogate consent may vary among geographic regions [11,12]. Regional or cultural differences may affect whether and when a diagnosis is made, who provides care, and the availability of approved therapeutic options . These and other factors could introduce heterogeneity into AD trial samples and should be considered when implementing multinational trials.
Despite the widespread dependence on multinational trials, there is little in the way of a “science of globalization” to inform decisions. To help address this information gap, we examined the baseline characteristics of trial participants across seven geographic regions in four multinational, phase III, industry-sponsored trials with patients with mild to moderate AD. We examined demographic as well as disease- and trial-related variables across geographic regions and compared regions for differences in the frequency of reported adverse events and participant study completion. For all outcomes, we tested the null hypothesis that geographic regions do not differ from each other in the setting of multinational AD trials. These exploratory analyses were conducted with the intention of generating data-based observations of participant characteristics and safety reporting across regions that may be helpful in trial planning. Measures of disease progression and the implications of these observations for trial planning and policy are reported separately.
These results describe a combined dataset from four multinational, phase III clinical trials conducted in mild to moderate AD. The results of the primary efficacy analyses from these trials have been reported elsewhere [14,15]. We analyzed data from two trials each of two investigational compounds, the γ-secretase inhibitor semagacestat [16-20] (the IDENTITY program: ClinicalTrials.gov identifiers NCT00762411 and NCT01035138) and the humanized monoclonal anti-amyloid-β (anti-Aβ) antibody solanezumab [21,22] (the EXPEDITION program: ClinicalTrials.gov identifiers NCT00905372 and NCT00904683). Each trial was sponsored by Eli Lilly & Company, and data were analyzed by the Alzheimer’s Disease Cooperative Study (ADCS) group members through its Data Analysis and Publication Committee. For each analysis, all available data were used.
Trial inclusion and exclusion criteria
The four trials used nearly identical inclusion and exclusion criteria, though they varied according to the type of therapy under investigation. The semagacestat trials required the ability to swallow oral medications, and the solanezumab trials required good venous access for delivery of intravenous therapy and excluded those with allergies to humanized monoclonal antibodies. The solanezumab, but not semagacestat, trials excluded patients with a history of repeated head trauma over the previous 5 years.
Participants were at least 55 years of age and met National Institute of Neurological and Communicative Disorders and Stroke-Alzheimer’s Disease and Related Disorders Association criteria for probable AD . Mild to moderate AD was defined as a score of 16 to 26 (inclusive) on the Mini Mental State Examination (MMSE) . Participants were permitted to receive background cholinesterase inhibitors and/or memantine if the treatment was initiated at least 4 months prior to screening and was stable in dose for at least 2 months. They had to have had magnetic resonance imaging (MRI) or computed tomography (CT) results within the previous 2 years that were not inconsistent with a diagnosis of AD. Those without imaging had MRI and/or CT at screening.
All participants had a reliable caregiver who was in frequent contact with them (defined as ≥10 hours per week), accompanied them to site visits or was available by telephone, and monitored administration of prescription medications during the trial.
Participants were excluded if they had a Geriatric Depression Scale score >6, if they had a Hachinski Ischemic Score >4, or if they met the National Institute of Neurological Disorders and Stroke/Association Internationale pour la Recherche et l’Enseignement en Neurosciences criteria for vascular dementia . Patients with serious or unstable medical conditions (including HIV) or a history within the last 5 years of serious central nervous system infection, primary or recurrent malignant disease (with the exception of resected cutaneous in situ squamous or basal cell carcinoma or in situ cervical or prostate cancer with normal prostate-specific antigen posttreatment), or chronic alcohol or drug abuse were excluded. Previous exposure to either the agent under study or an Aβ vaccine or monoclonal antibody was not permitted.
We examined the effect of geographic region on screening and baseline clinical outcome measures that are common to AD trials. A centralized company translated outcome measures into the appropriate language of the region of each site.
The MMSE is a global cognition measure that requires approximately 10 minutes to administer and is the most common tool for determining trial eligibility. Its items are used to assess short-term memory, orientation, calculation, language interpretation, naming, and praxis. The MMSE has a range of 0 to 30, with higher scores representing better performance. We investigated MMSE scores at screening and baseline.
The Alzheimer’s Disease Assessment Scale–Cognitive subscale (ADAS-cog) is the only cognitive outcome measure that has been used to successfully demonstrate drug efficacy in mild to moderate AD registration trials. It was one of the co-primary outcomes for each of the four trials included in our present analysis. The ADAS-cog typically includes 11 subtests that assess the patient’s memory, orientation, comprehension, naming, word finding, and ideational and constructional praxis . The range is 0 to 70, with higher scores representing greater cognitive impairment. We assessed baseline scores on the 11-item ADAS-cog (ADAS-cog11).
The Alzheimer’s Disease Cooperative Study Activities of Daily Living Inventory (ADCS-ADL) was the other co-primary outcome measure for the four trials. The scale is informant-based and is used to assess basic and instrumental activities of daily living. Scores range from 0 to 78, with higher scores representing greater functional independence . We examined ADCS-ADL scores at baseline.
The Clinical Dementia Rating scale Sum of Boxes (CDR-SB) was a secondary outcome measure in each trial. The CDR is a global instrument that includes separate interviews of the patient and the informant. The investigator uses the interviews to assign severity scores (0, not demented; 0.5, questionable dementia; 1.0, mild dementia; 2.0, moderate dementia; or 3.0, severe dementia) for each of six “boxes,” including memory, orientation, judgment and problem solving, community affairs, home and hobbies, and self-care . We examined the Sum of Boxes scores at baseline.
The Neuropsychiatric Inventory (NPI) is the most widely used scale for examining behavioral symptoms in the setting of AD trials. The study partner is asked to report the frequency and severity of 12 behavioral symptoms observed over the previous 4 weeks [29,30]. Each domain is assessed as present or absent. If present, the severity (1 to 3 points) and frequency (1 to 4 points) are scored. The severity and frequency are multiplied, and the scores across domains are summed for a total range of 0 to 144, with higher scores representing greater behavioral symptoms.
Raters who failed to meet minimum experience requirements for the outcome measures were required to participate in an enriched training program, including additional online and live training. All raters underwent live training on outcome measures at the principal investigator’s meeting and were required to pass qualification assessments on the co-primary outcome scales. As part of an in-study rating review program, screening MMSE in both study programs and ADAS-cog at baseline and 12 weeks (EXPEDITION program) or 52 weeks (IDENTITY program) were reviewed for scoring errors; raters underwent remedial training when indicated; and errors were subsequently corrected.
Patients were enrolled in 31 different countries. Investigative sites were chosen after a careful feasibility assessment of experience in caring for patients with AD, experience in running AD trials, and experience of raters in administering the trial outcome measures. On the basis of the country of enrollment, participants were categorized into one of seven geographic regions: North America (United States and Canada), South America/Mexico (Argentina, Brazil, Chile, and Mexico), Western Europe/Israel (Belgium, Denmark, Finland, France, Germany, Israel, Italy, Spain, Sweden, and United Kingdom), Eastern Europe/Russia (Bulgaria, Hungary, Poland, Romania, Russia, Serbia, Turkey, and Ukraine), Australia/South Africa, Asia (China, India, Korea, and Taiwan), and Japan. We based our regional assignments on the work of Glickman and colleagues , who grouped patients in parts of the world with shared culture, history, geography, and linguistic features. Definitions were modified to allow combination of some countries that contained small samples due to participation in only one study program.
Data for drug and placebo-assigned participants from all four trials were included in the baseline data analyses (demographic summaries and screening and baseline scores on outcome measures). Mean age and level of education were quantified in years. We also examined the proportion of each region with varying levels of education: <8 years, 8 to 12 years, and >12 years. Mean height in centimeters and weight in kilograms were assessed, and body mass index (BMI; weight divided by height squared) was calculated for each participant. Participants who carried one or more copies of the ε4 allele of the apolipoprotein E (APOE) genotype were categorized as ε4 carriers. Participant study partners were categorized as spouse, adult child, or other at baseline.
Study retention and treatment-emergent adverse event (TEAE) and serious adverse event (SAE) reporting were examined separately by study program (IDENTITY or EXPEDITION) and by treatment group assignment (semagacestat, solanezumab, or placebo).
Study retention was defined as fulfilling all eligible visits. In the IDENTITY program, semagacestat dosing was halted prior to study completion. The studies were amended to follow study participants for 7 months after discontinuing semagacestat, but these data are not included in the present analyses. Because of this amendment, however, some participants are included as “completers” (that is, retained for all eligible visits), despite participating for less than the protocol-defined 18-month study period.
TEAEs were defined as adverse events that first occurred or worsened in severity compared with their maximum severity during the baseline period (between screening and baseline visits). We examined TEAE reporting in each study program for the placebo groups and for the higher-dose arms of each active drug (semagacestat 140 mg by mouth daily and solanezumab 400 mg intravenously every 4 weeks). To account for differences in time to site startup and differences in the time for trial conduct (the IDENTITY trials were amended to stop semagacestat prior to completion), TEAEs were reported as per patient per month. We also examined the proportion of TEAEs reported as SAEs among the regions.
Descriptive statistics are presented as mean ± standard deviation for continuous variables and count (%) for categorical variables, unless otherwise stated. For continuous baseline variables in which assumptions of normality were met, analysis of variance (ANOVA) and Levene’s test were used to examine the overall impact of geographic region. If the assumptions were not met, the Kruskal-Wallis test was performed. Categorical baseline variables, TEAE reporting, and study retention were compared across geographical regions using a χ2 test for independence. For variables in which an overall significant effect of region was present, pairwise comparisons between regions were performed using Tukey’s honestly significant difference (HSD) test (with the ANOVA), the Wilcoxon rank-sum test with the Holm’s adjustment for multiple comparisons (with the Kruskal-Wallis test), and χ2 test using the Holm’s adjustment for multiple comparisons (with the χ2 test).
We report significant differences if they reached a conservative significance level of P < 0.01. Statistical analysis was conducted using R version 2.14.0 statistical software .
For each trial, informed consent was provided by the participant or a legally authorized representative, in accordance with local regulations, and only after approval by the site’s institutional review board of record. The present study analyzing data collected across these clinical trials was reviewed by the University of California, Los Angeles Medical Institutional Review Board 3 and was deemed as not meeting the definition of human subjects research.
Demographics of participants
In total, data from 4,694 participants were included in these analyses. Forty percent of all participants were enrolled in North America. The next highest enrolling region was Western Europe/Israel, with 981 participants (21%) enrolled. No other region enrolled more than 10% of the overall sample across trials (Table 1). We observed regional differences for each demographic variable examined (age: P < 0.0001 by ANOVA; weight: P < 0.001 by Kruskal-Wallis test; height: P < 0.001 by Kruskal-Wallis test; body mass index: P < 0.001 by Kruskal-Wallis test; sex: P < 0.001 by χ2 test; education: P < 0.001 by Kruskal-Wallis test; APOE genotype: P < 0.001 by χ2 test; study partner type: P < 0.001 by χ2 test).
In pairwise comparisons, participants enrolled in North America and South America/Mexico were older than those enrolled in every other region (Table 1). Participants enrolled in Eastern Europe/Russia were the youngest (P < 0.001 for all comparisons except vs Australia/South Africa (P = 0.011), Western Europe/Israel (P = 0.09), and Asia (P = 0.20), all by Tukey’s HSD test).
North American participants were taller than participants from every other region (P < 0.001 by paired Wilcoxon rank-sum test with Holm’s adjustment) except Australia/South Africa and Western Europe/Israel and heavier than participants from every other region (P < 0.001) except Australia/South Africa (Table 1). Japanese participants were lighter, shorter, and had lower BMIs than participants from every other region (P < 0.001). Excluding Japan, Asian participants were lighter, shorter, and had lower BMIs than those in the remaining regions (P < 0.001 for all comparisons except vs South America/Mexico).
In every region, more women than men were enrolled. In South America/Mexico, 68% of participants were female, the highest proportion of any region (P < 0.01 vs Australia/South Africa, North America, and Western Europe/Israel and P = 0.02 vs Asia, both by χ2 test with Holm’s adjustment). Western Europe/Israel, North America, and Australia/South Africa enrolled the highest proportions of male participants.
The range of education among participants was 0 to 29 years, with an overall median education level of 12 years for the combined dataset. Participants from North America had higher education than participants from all other regions, with 60% of participants having >12 years and <3% of participants having <8 years (data not shown). Japan had a similar low proportion of participants with <8 years of education (2.8%), but the majority of Japanese participants (74.7%) had <12 years. Participants from South America/Mexico (mean = 8.9 years) and Asia (mean = 9.5 years) had less education than all other regions (Table 1). These regions had substantially higher proportions of participants with <8 years of education (39% for Asia and 49% for South America/Mexico; data not shown) than all other regions.
Fifty-nine percent of all participants carried at least one copy of APOE ε4. The proportions of APOE ε4 carriers ranged from 48.4% (Asia) to 63.7% (Australia/South Africa). North America, Western Europe/Israel, and Australia/South Africa had the highest proportions of APOE ε4 carriers (P < 0.01 by χ2 test with Holm’s adjustment for all comparisons to North America and Western Europe/Israel) (Table 1).
In North America, Western Europe/Israel, and Australia/South Africa, >70% of participants were enrolled with a spouse study partner. In contrast, the majority of participants in Eastern Europe/Russia (60%) and South America/Mexico (57%) were enrolled with a nonspouse study partner. In Eastern Europe/Russia, 50% of participants were enrolled with an adult child, and in South America/Mexico, 18% of participants were enrolled with a study partner who was neither a spouse nor an adult child—higher proportions, respectively, than any other region.
Geographic regions differed in the time since symptom onset and time between diagnosis and trial enrollment (P < 0.001 for both variables by Kruskal-Wallis test). The overall mean duration of symptoms prior to enrollment was 4.5 ± 2.5 years. This duration was significantly shorter in Japan and Eastern Europe/Russia than all other regions except Asia (P < 0.01 for all comparisons except Eastern Europe/Russia vs Asia) (Table 1). North America had the longest duration of symptoms prior to enrollment, though the difference reached statistical significance only when compared with Japan, Eastern Europe/Russia, and Asia. The mean time from diagnosis to enrollment was approximately 2.0 to 2.5 years shorter than the time since symptom onset for each region, with a pattern of pairwise differences similar to that observed for time since symptom onset. Eastern Europe/Russia and Japan had the shortest duration of time since diagnosis (P < 0.01 for all comparisons except Japan vs Asia) (Table 1). North America had longer duration of time since diagnosis than all other regions except South America/Mexico.
Across geographic regions, a large majority (86.5%) of participants were taking at least one US Food and Drug Administration–approved anti-AD medication. Among AD medications, donepezil was most common; 52% of all participants were taking donepezil at the time of screening. Anti-AD drug use at screening varied significantly among geographic regions, however (χ2; P = 0.0001 by χ2 test). Anti-AD drug use was highest in Western Europe/Israel, North America, and Japan (P < 0.01 for comparisons to remaining regions except North America vs South America/Mexico (P = 0.019) and Japan vs Asia (P = 0.012)). Memantine use was less common than cholinesterase inhibitor therapy; 32% of participants were taking memantine and 27% were on dual therapy at the time of screening. Both memantine and dual therapy rates differed among the regions (P < 0.0001 by χ2 test). More participants in North America than in any other region were on dual therapy. Fewer participants in Japan than in any other region were on dual therapy.
Baseline outcome measure scores
Scores on cognitive, functional, and behavioral outcomes at screening and baseline visits differed among the regions (P < 0.0001 for each outcome measure by Kruskal-Wallis test). Despite the study inclusion criteria (MMSE score between 16 and 26), the range of MMSE scores observed at screening was 13 to 27. Only Japan and Western Europe/Israel did not enroll a participant with a screening MMSE score outside the inclusion criteria, though no region exceeded 1% of scores out of range at screening. Higher mean MMSE scores at screening were observed in North America, Western Europe/Israel, Australia/South Africa, and Japan relative to the remaining regions (Table 2). The mean MMSE scores and patterns of regional differences at baseline remained largely the same as at screening, but the variance increased in each region at baseline (Table 2). The range of MMSE scores at the baseline visit was from 6 to 30. Overall, 7.5% of all baseline visit scores were outside the screening range of 16 to 26. Eleven percent of baseline visit MMSE scores in North America and 9.5% in Asia were outside the screening entry criteria.
Baseline scores on the ADAS-cog11 ranged from 3 to 68. Mean scores in North America, Australia/South Africa, and Japan were significantly milder than those for all remaining regions (P < 0.01 for all comparisons except Australia/South Africa vs Western Europe/Israel (P = 0.09)). Eastern Europe/Russia demonstrated significantly higher scores than all remaining regions (P < 0.01 for all comparisons except vs South America/Mexico (P = 0.03)).
Participants from Eastern Europe/Russia and South America/Mexico performed worse (greater disease severity) than those from all other regions for both the ADCS-ADL and the CDR-SB (P < 0.01 for all comparisons by Wilcoxon rank-sum test). ADCS-ADL scores in North America were higher (less functional impairment) than in all other regions (P < 0.01 by Wilcoxon rank-sum test for all comparisons except Australia/South Africa (P = 0.015)). Mean CDR-SB scores in Asia were milder than in all regions except Japan (P < 0.01 for all comparisons by Wilcoxon rank-sum test).
Australia/South Africa and South America/Mexico had the highest NPI scores at baseline (greater neuropsychiatric symptomatology). Japan had significantly lower scores than all other regions except Asia (P < 0.01 for all comparisons by Wilcoxon Rank Sum test) (Table 2).
Treatment-emergent adverse event reporting
The overall reporting of TEAEs for the four examined datasets was 77% for the IDENTITY program placebo arms, 89% for the IDENTITY semagacestat arms, 84% for the EXPEDITION placebo arms, and 81% for the EXPEDITION solanezumab arms. TEAE reporting among regions ranged from 57% for Eastern Europe/Russia in the IDENTITY program placebo arms to 95% for North America in the IDENTITY 140-mg dose semagacestat arms. TEAE reporting normalized by time and participant differed among regions for each dataset (P < 0.0001 for all by χ2 test), and the observed geographic patterns were similar for both agents and both placebo datasets. North America and Western Europe/Israel performed similarly and had significantly more reported TEAEs than Eastern Europe/Russia and Japan in most datasets (Table 3). Asia and Eastern Europe/Russia performed similarly in most analyses and had fewer TEAEs. There were no differences between regions in TEAEs severe enough to lead to discontinuation (Table 4).
The overall reporting of SAEs was 12% for the IDENTITY program placebo arms, 21% for the IDENTITY semagacestat arms, 20% for the EXPEDITION placebo arms, and 18% for the EXPEDITION solanezumab arms. We found no regional differences in SAE reporting.
The proportions of participants discontinuing prior to trial completion were similar for the solanezumab (24%) and placebo datasets (25%) in the EXPEDITION program. In the IDENTITY program, discontinuation was 22% for the combined placebo arms but 46% for the combined semagacestat arms. In each study program (IDENTITY and EXPEDITION), the global regions differed in participant retention (P < 0.01 for each dataset by χ2 test). For each study program, the dropout rate was lowest in Japan (Table 5). The dropout rate was highest in Eastern Europe/Russia for each placebo dataset (39% in EXPEDITION and 41% in IDENTITY) and the semagacestat treatment arms (51%). The dropout rate was highest in North America for the solanezumab active treatment arms (32%). Figure 1 illustrates the results of a time to discontinuation model, in which Japan differed from at least one other region in placebo and active treatment arms of each study program.
Across study programs and trial arms, the regions appeared similar in the reasons for discontinuation. The most common reasons for discontinuation were adverse events, subject decision, and caregiver decision (Table 4). Adverse events were the most frequent cause of discontinuation and were consistently the most common cause of discontinuation for each region in the IDENTITY active treatment arms. In Eastern Europe/Russia and South America/Mexico, subject decision was a more common cause of discontinuation for the remaining study program arms (Table 4).
These results suggest that—despite strict protocols, ample site training, and substantial trial monitoring—significant heterogeneity should be expected among AD trial populations across geographic regions. Furthermore, we observed patterns of regional similarities and differences for participant demographics, scores on trial outcome measures at screening and baseline visits, TEAE reporting, and study completion.
North America, Western Europe/Israel, and Australia/South Africa were similar in their proportions of female participants, carriers of the APOE ε4 genotype, and participants enrolled with a spouse study partner. Proportions different from this group but similar to each other were observed for Asia, Eastern Europe/Russia, and South America/Mexico for the same variables. Similar regional patterns were observed when we compared scores on trial outcomes at screening and baseline. Though consistent patterns were evident, they seemed dependent upon whether the outcome measure was based on informant report. Participants from North America, Western Europe/Israel, Japan, and Australia/South Africa had milder scores for study partner–independent measures (that is, MMSE at screening and baseline and the ADAS-cog11), whereas participants from Asia, South America/Mexico, and Eastern Europe/Russia had more moderate severity for these outcomes. Eastern Europe/Russia had the most severe scores for the CDR-SB; the mildest CDR-SB scores were observed in Asia. Scores on informant-independent outcomes were generally mildest in Australia/South Africa; this region had the most severe scores on the NPI. Asia and Japan, in contrast, demonstrated substantially lower NPI scores than the remaining regions. Japan also had the lowest frequency of reporting TEAEs for three of the four datasets; Eastern Europe/Russia had lower reporting frequency for the solanezumab arms of the EXPEDITION program. The highest TEAE reporting was in North America and Australia/South Africa.
Potential explanations for the observed heterogeneity
We hypothesize that several factors that are not mutually exclusive contributed to the observed heterogeneity. First, the regions in which participants were recruited are different. Geographic regions differ in lifestyle factors, overall health, and causes of death and disability [32,33]. It is likely that access to medical care and the sophistication of that care differ among geographic regions. The populations recruited to these studies may accurately represent differences among the disease-suffering populations in different parts of the world. For example, North American participants had substantially higher levels of education than did those in South America/Mexico and Asia, as is the case for the countries in these regions . It is important to note, however, that in North America—and probably every other region—trials are subject to sample bias. In the United States, trial populations are consistently more educated than the general population. Thus, these findings may reflect regional differences in population demographics as well as regional differences in the degree of sample bias; that is, patient access to trials and willingness to participate may differ among regions.
Regional differences in AD diagnosis, care, and reimbursement may also have contributed to the observed heterogeneity. Until recently, the only AD therapy that had received regulatory approval in Japan was donepezil . This may explain or contribute to the low frequencies of memantine and dual therapy in Japan. Other regional differences in standard of care or physician reimbursements for diagnostic visits or procedures could similarly impact the stage of disease at which a formal diagnosis is made, and this could have an impact on variables such as time from symptom onset to trial screening and baseline disease severity. In fact, the regions with the shortest times from symptom onset and diagnosis to screening (Japan and Eastern Europe/Russia) did not have milder scores on baseline trial outcome measures than the regions with longer durations. Eastern Europe/Russia had the most severe scores at baseline. North America had the longest duration of symptoms and time since diagnosis to enrollment, but it had among the mildest scores on informant-independent baseline outcomes. Possible explanations for such discrepancies could be differing rates of disease progression among regions, differing access to medical care, or earlier detection in some regions, though this will require further study.
Regional variation in research infrastructure or the expertise of investigators could also have contributed to the observed heterogeneity. For example, the availability of experienced raters at sites varied across regions and such differences might impact mean scores or variability on trial outcomes at baseline. We cannot assume that differences in investigative teams explain the observed differences, however; it is possible that differences in patients, informants, outcomes (when translated, for example), and raters exist.
Translation of outcome measures does not guarantee equivalence among cultural groups or regions . Local customs and standards may necessitate adjustment  or replacement  of particular items. For example, one Chinese version of the ADAS-cog used pictures instead of words for assessing memory performance . Alternatively, findings from some studies suggest that differing cutoffs may be appropriate when applying common scales to differing geographic, ethnic, and cultural populations . Even within geographic regions, as defined in the present study, challenges related to harmonization and validation of outcome measures may occur, potentially further increasing trial data variance . In the studies examined here, scales were kept consistent to the greatest extent possible to facilitate combining study data; only in certain circumstances were sites permitted to alter scales for regional differences (for example, substituting region or burro for county, where counties were not present, on the MMSE).
Regional and cultural differences in family attitudes toward AD recognition, diagnosis, treatment, reporting of symptoms, and research participation may have contributed to the observed heterogeneity. In North America, Western Europe/Israel, and Australia/South Africa, patients with a spouse made up a majority of the participants and proportionately more men were enrolled. In contrast, the majority of participants in Eastern Europe/Russia and South America/Mexico enrolled with a nonspouse study partner. It is not clear whether regional differences exist in the proportions of caregiver types or if caregiver attitudes inhibit participation by nonspousal partners in some regions and enhance it in others. Cultural differences among caregivers may also have impacted informant reporting in the trials. TEAE reporting and scores on the CDR-SB and NPI were consistently lower for Asia and Japan, relative to the other regions, similar to previous observations .
Finally, regional ethnogenetic differences in disease may have contributed to the observed heterogeneity. This is most pertinent to the observed frequencies of APOE genotypes. The APOE ε4 genotype is the best replicated and most understood genetic risk factor for AD , but the impact of APOE (and other) genotypes on AD risk in different ethnic groups remains unclear . APOE ε4 prevalence may differ regionally, possibly accounting for the difference in ε4 proportions observed in these analyses. For example, fewer participants carried APOE ε4 in Asia than in other regions, a finding similar to that of previous studies of APOE prevalence [44,45]. Alternatively, epigenetic differences may result in altered genetic risk for disease . Here, APOE ε4 differences did not seem to predict differences in mean age between regions. North America had the highest rate of ε4 carriers and the oldest mean age, whereas Eastern Europe/Russia had the second-lowest proportion of ε4 carriers and a younger mean age than the other global regions. To the extent that drug interactions with genotype impact the safety  or efficacy of AD treatments [48-50], ethnogenetic differences within trial samples should be considered when implementing multinational trials. Differences in the proportions of ε4 carriers and noncarriers could also have specific implications for trials of antiamyloid therapies because noncarrier participants may more frequently fail to demonstrate amyloid burden when studied with amyloid imaging .
These data are among the first of their kind, and several limitations should be considered. Our observations do not provide evidence for why heterogeneity exists. Though we provide hypotheses related to factors that may contribute to the observed regional differences, these hypotheses require further research to better guide sponsors of multinational AD trials. Furthermore, because these study programs were not designed to evaluate regional differences, several data elements important to sponsors designing global trials were not sufficiently available to permit analysis, including regulatory startup variables such as time to institutional review board approval or contract negotiation, the type of sites and investigators within each global region, and participant data on socioeconomic status. The grouping of regions was based on geography, information in the published literature , and the experiences of the research team, and with data limitations in mind. Specifically, low numbers of participants in some countries or regions necessitated combinations to improve statistical power. This limitation may be minimized by the findings of significant regional differences. Were the data homogeneous, the assignment of regions, even if arbitrary, would not be expected to produce statistically significant differences among groups. The pattern of differences that we observed may not be the same in future datasets, however, so our results cannot be used to predict future findings in a specific region or country. Other strategies for assigning global regions, including ethnic or genetic groupings, might also be reasonable and could produce alternate findings.
Finally, although many of the differences between regions are statistically significant, it is unclear to what extent they are clinically meaningful or interfere with the ability to measure a drug effect. In the IDENTITY studies, for example, the cognitive worsening associated with semagacestat treatment was identified despite population heterogeneity.
We performed these analyses to provide sponsors with data to assist with planning and conducting trials in multiple geographic regions. The data indicate that study populations differ across regions from a demographic perspective. Similarly, APOE ε4 carrier status differed among regions in these trials, and this may bear on the number of non-AD patients entering trials that do not utilize AD biomarkers as entry criteria. Screening and baseline scores on the outcome measures we examined differed among regions, again indicating the heterogeneity of multinational trial populations. The difference in TEAE reporting and dropout among regions is consistent with findings from a previous analysis by country of the IDENTITY trial data . These data suggest that heterogeneity will be present and should be accounted for when developing multinational AD trials. Although researchers generally attempt to avoid heterogeneity in clinical trials to facilitate identifying a drug effect if one exists, heterogeneity may also provide confidence that an observed drug effect is real and that treatment will be effective in the general clinical population, where heterogeneity will be the norm.
To meet regulatory and enrollment needs, sponsors of studies in AD and other serious diseases are increasingly implementing multinational clinical trials. Our data suggest that this may contribute to sample heterogeneity. Because trial designs and sample sizes are dependent upon expected population variance, these results suggest that (1) sponsors may wish to limit the number of regions from which sites outside the United States recruit participants to reduce variance, (2) multinational trials may need to be large enough to account for potentially increased variance, and (3) sponsors must carefully consider which countries and regions to include when planning multinational trials. For example, trials of interventions to reduce or prevent neuropsychiatric symptoms may face additional challenges in Japan and Asia, given lower reporting of these symptoms in those regions. Sponsors may also consider balancing enrollment sites, based on the knowledge of which regions are likely to enroll similar patients in terms of age, body size, genotypes, and concomitant therapies.
Although differences in the proportion of participants receiving anti-AD medications among the regions were evident, more than 70% of patients in each region were taking at least one anti-AD medication. This suggests that trial designs that seek to enroll drug-naïve participants will have increasingly challenging recruitment, even when enrolling non-US populations . Moreover, to the extent that trial designs require patients to be on particular AD therapies, these data may instruct selection of regional sites.
To develop desperately needed new drugs for AD, high-quality clinical trials must be performed in a rapid manner. The conduct of multinational trials accelerates patient recruitment and enables broader registration and eventual patient access, but it introduces variables that have not been completely delineated and are incompletely understood. Trial sponsors must carefully consider potential effects on trial data and implement strategies to identify those factors that can be mitigated to reduce variability.
11-item Alzheimer’s Disease Assessment Scale–Cognitive subscale
Alzheimer’s Disease Cooperative Study
Alzheimer’s Disease Cooperative Study–Activities of Daily Living Inventory
Analysis of variance
Body mass index
Clinical Dementia Rating scale Sum of Boxes
Honestly significant difference
Mini Mental State Examination
Magnetic resonance imaging
Serious adverse event
Treatment-emergent adverse event
Lozano R, Naghavi M, Foreman K, Lim S, Shibuya K, Aboyans V, et al. Global and regional mortality from 235 causes of death for 20 age groups in 1990 and 2010: a systematic analysis for the Global Burden of Disease Study 2010. Lancet. 2012;380:2095–128.
Rosow K, Holzapfel A, Karlawish JH, Baumgart M, Bain LJ, Khachaturian AS. Countrywide strategic plans on Alzheimer’s disease: developing the framework for the international battle against Alzheimer’s disease. Alzheimers Dement. 2011;7:615–21.
Cummings J, Reynders R, Zhong K. Globalization of Alzheimer’s disease clinical trials. Alzheimers Res Ther. 2011;3:24.
Doody RS, Cole PE, Miller DS, Siemers E, Black R, Feldman H, et al. Global issues in drug development for Alzheimer’s disease. Alzheimers Dement. 2011;7:197–207.
Glickman SW, McHutchison JG, Peterson ED, Cairns CB, Harrington RA, Califf RM, et al. Ethical and scientific implications of the globalization of clinical research. N Engl J Med. 2009;360:816–23.
World Medical Association. Declaration of Helsinki. 1964. http://www.wma.net/en/30publications/10policies/b3/. Accessed 4 Apr 2015.
Nundy S, Gulhati CM. A new colonialism?—Conducting clinical trials in India. N Engl J Med. 2005;352:1633–6.
Schindler RJ. Study design considerations: conducting global clinical trials in early Alzheimer’s disease. J Nutr Health Aging. 2010;14:312–4.
Bjornsson TD, Wagner JA, Donahue SR, Harper D, Karim A, Khouri MS, et al. A review and assessment of potential sources of ethnic differences in drug responsiveness. J Clin Pharmacol. 2003;43:943–67.
Goldstein DB, Tate SK, Sisodiya SM. Pharmacogenetics goes genomic. Nat Rev Genet. 2003;4:937–47. A published erratum appears in. Nat Rev Genet. 2004;5:76.
Nagao N, Aulisio MP, Nukaga Y, Fujita M, Kosugi S, Youngner S, et al. Clinical ethics consultation: examining how American and Japanese experts analyze an Alzheimer’s case. BMC Med Ethics. 2008;9:2.
Brodaty H, Dresser R, Eisner M, Erkunjuntti T, Gauthier S, Graham N, et al. Alzheimer’s Disease International and International Working Group for Harmonization of Dementia Drug Guidelines for research involving human subjects with dementia. Alzheimer Dis Assoc Disord. 1999;13:71–9.
Kalaria RN, Maestre GE, Arizaga R, Friedland RP, Galasko D, Hall K, et al. Alzheimer’s disease and vascular dementia in developing countries: prevalence, management, and risk factors. Lancet Neurol. 2008;7:812–26. A published erratum appears in Lancet Neurol. 2008;7:867.
Doody RS, Raman R, Farlow M, Iwatsubo T, Vellas B, Joffe S, et al. A phase 3 trial of semagacestat for treatment of Alzheimer’s disease. N Engl J Med. 2013;369:341–50.
Doody RS, Thomas RG, Farlow M, Iwatsubo T, Vellas B, Joffe S, et al. Phase 3 trials of solanezumab for mild-to-moderate Alzheimer’s disease. N Engl J Med. 2014;370:311–21.
Bateman RJ, Siemers ER, Mawuenyega KG, Wen G, Browning KR, Sigurdson WC, et al. A γ-secretase inhibitor decreases amyloid-β production in the central nervous system. Ann Neurol. 2009;66:48–54.
Fleisher AS, Raman R, Siemers ER, Becerra L, Clark CM, Dean RA, et al. Phase 2 safety trial targeting amyloid β production with a γ-secretase inhibitor in Alzheimer disease. Arch Neurol. 2008;65:1031–8.
Siemers ER, Dean RA, Friedrich S, Ferguson-Sells L, Gonzales C, Farlow MR, et al. Safety, tolerability, and effects on plasma and cerebrospinal fluid amyloid-β after inhibition of γ-secretase. Clin Neuropharmacol. 2007;30:317–25.
Siemers ER, Quinn JF, Kaye J, Farlow MR, Porsteinsson A, Tariot P, et al. Effects of a γ-secretase inhibitor in a randomized study of patients with Alzheimer disease. Neurology. 2006;66:602–4.
Henley DB, May PC, Dean RA, Siemers ER. Development of semagacestat (LY450139), a functional γ-secretase inhibitor, for the treatment of Alzheimer’s disease. Expert Opin Pharmacother. 2009;10:1657–64.
Grundman M, Dibernardo A, Raghavan N, Krams M, Yuen E. 2012: a watershed year for Alzheimer’s disease research. J Nutr Health Aging. 2013;17:51–3.
Farlow M, Arnold SE, van Dyck CH, Aisen PS, Snider BJ, Porsteinsson AP, et al. Safety and biomarker effects of solanezumab in patients with Alzheimer’s disease. Alzheimers Dement. 2012;8:261–71.
McKhann G, Drachman D, Folstein M, Katzman R, Price D, Stadlan EM. Clinical diagnosis of Alzheimer’s disease: report of the NINCDS-ADRDA Work Group under the auspices of Department of Health and Human Services Task Force on Alzheimer’s Disease. Neurology. 1984;34:939–44.
Folstein MF, Folstein SE, McHugh PR. “Mini-mental state”: a practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12:189–98.
Román GC, Tatemichi TK, Erkinjuntti T, Cummings JL, Masdeu JC, Garcia JH, et al. Vascular dementia: diagnostic criteria for research studies. Report of the NINDS-AIREN International Workshop. Neurology. 1993;43:250–60.
Mohs RC, Knopman D, Petersen RC, Ferris SH, Ernesto C, Grundman M, et al. Development of cognitive instruments for use in clinical trials of antidementia drugs: additions to the Alzheimer’s Disease Assessment Scale that broaden its scope. Alzheimer Dis Assoc Disord. 1997;11 Suppl 2:S13–21.
Galasko D, Bennett D, Sano M, Ernesto C, Thomas R, Grundman M, et al. An inventory to assess activities of daily living for clinical trials in Alzheimer’s disease. Alzheimer Dis Assoc Disord. 1997;11 Suppl 2:S33–9.
Morris JC. The Clinical Dementia Rating (CDR): current version and scoring rules. Neurology. 1993;43:2412–4.
Cummings JL, Mega M, Gray K, Rosenberg-Thompson S, Carusi DA, Gornbein J. The Neuropsychiatric Inventory: comprehensive assessment of psychopathology in dementia. Neurology. 1994;44:2308–14.
Kaufer DI, Cummings JL, Ketchel P, Smith V, MacMillan A, Shelley T, et al. Validation of the NPI-Q, a brief clinical form of the Neuropsychiatric Inventory. J Neuropsychiatry Clin Neurosci. 2000;12:233–9.
The R Project for Statistical Computing. http://www.r-project.org/. Accessed 4 Apr 2015.
United Nations Development Programme. Human Development Report 2010: 20th anniversary edition. The real wealth of nations: pathways to human development. Basingstoke, UK: Palgrave Macmillan; 2010. http://hdr.undp.org/en/content/human-development-report-2010. Accessed 4 Apr 2015.
Murray CJ, Vos T, Lozano R, Naghavi M, Flaxman AD, Michaud C, et al. Disability-adjusted life years (DALYs) for 291 diseases and injuries in 21 regions, 1990–2010: a systematic analysis for the Global Burden of Disease Study 2010. Lancet. 2012;380:2197–223.
Takeda M, Tanaka T, Okochi M. New drugs for Alzheimer’s disease in Japan. Psychiatry Clin Neurosci. 2011;65:399–404.
Teng EL, Manly JJ. Neuropsychological testing: helpful or harmful? Alzheimer Dis Assoc Disord. 2005;19:267–71.
Ganguli M, Dube S, Johnston JM, Pandav R, Chandra V, Dodge HH. Depressive symptoms, cognitive impairment and functional impairment in a rural elderly population in India: a Hindi version of the Geriatric Depression Scale (GDS-H). Int J Geriatr Psychiatry. 1999;14:807–20.
Pandav R, Fillenbaum G, Ratcliff G, Dodge H, Ganguli M. Sensitivity and specificity of cognitive and functional screening instruments for dementia: the Indo-U.S. Dementia Epidemiology Study. J Am Geriatr Soc. 2002;50:554–61.
Liu HC, Teng EL, Chuang YY, Lin KN, Fuh JL, Wang PN. The Alzheimer’s Disease Assessment Scale: findings from a low-education population. Dement Geriatr Cogn Disord. 2002;13:21–6.
Chiu HFK, Lam LCW. Relevance of outcome measures in different cultural groups – does one size fit all? Int Psychogeriatr. 2007;19:457–66.
Verhey FR, Houx P, Van Lang N, Huppert F, Stoppe G, Saerens J, et al. Cross-national comparison and validation of the Alzheimer’s Disease Assessment Scale: results from the European Harmonization Project for Instruments in Dementia (EURO-HARPID). Int J Geriatr Psychiatry. 2004;19:41–50.
Pang FC, Chow TW, Cummings JL, Leung VP, Chiu HF, Lam LC, et al. Effect of neuropsychiatric symptoms of Alzheimer’s disease on Chinese and American caregivers. Int J Geriatr Psychiatry. 2002;17:29–34.
Verghese PB, Castellano JM, Holtzman DM. Apolipoprotein E in Alzheimer’s disease and other neurological disorders. Lancet Neurol. 2011;10:241–52.
Crean S, Ward A, Mercaldi CJ, Collins JM, Cook MN, Baker NL, et al. Apolipoprotein E ε4 prevalence in Alzheimer’s disease patients varies across global populations: a systematic literature review and meta-analysis. Dement Geriatr Cogn Disord. 2011;31:20–30.
Singh PP, Singh M, Mastana SS. APOE distribution in world populations with new data from India and the UK. Ann Hum Biol. 2006;33:279–308.
Corbo RM, Scacchi R. Apolipoprotein E (APOE) allele distribution in the world: Is APOE*4 a ‘thrifty’ allele? Ann Hum Genet. 1999;63:301–10.
Hendrie HC, Murrell J, Gao S, Unverzagt FW, Ogunniyi A, Hall KS. International studies in dementia with particular emphasis on populations of African origin. Alzheimer Dis Assoc Disord. 2006;20(3 Suppl 2):S42–6.
Sperling R, Salloway S, Brooks DJ, Tampieri D, Barakos J, Fox NC, et al. Amyloid-related imaging abnormalities in patients with Alzheimer’s disease treated with bapineuzumab: a retrospective analysis. Lancet Neurol. 2012;11:241–9.
Salloway S, Sperling R, Gilman S, Fox NC, Blennow K, Raskind M, et al. A phase 2 multiple ascending dose trial of bapineuzumab in mild to moderate Alzheimer disease. Neurology. 2009;73:2061–70.
Risner ME, Saunders AM, Altman JF, Ormandy GC, Craft S, Foley IM, et al. Efficacy of rosiglitazone in a genetically defined population with mild-to-moderate Alzheimer’s disease. Pharmacogenomics J. 2006;6:246–54.
Petersen RC, Thomas RG, Grundman M, Bennett D, Doody R, Ferris S, et al. Vitamin E and donepezil for the treatment of mild cognitive impairment. N Engl J Med. 2005;352:2379–88.
Selkoe DJ. The therapeutics of Alzheimer’s disease: where we stand and where we are heading. Ann Neurol. 2013;74:328–36.
Henley DB, Sundell KL, Sethuraman G, Schneider LS. Adverse events and dropouts in Alzheimer’s disease studies: what can we learn? Alzheimer Dement. 2015;11:24–31.
JDG is supported by NIA grant P50 AG016570, the Sidell-Kagan Scientific & Medical Research Foundation and the P Gene and Elaine Smith Term Chair in Alzheimer’s Disease Research. The ADCS is supported by NIA grant U01 AG10483. The authors thank the participants and investigators in these clinical trials.
JDG has been a trial investigator for the ADCS, Eli Lilly, Merck, Biogen Idec, Janssen Alzheimer Immunotherapy, Genentech and Avanir Pharmaceuticals (in the past 2 years). DBH, SAD, Y-FC, HL-S and AMH are full-time employees and minor stockholders of Eli Lilly. RSD has served as principal investigator (PI) for clinical trials for which her institution received payment from Accera, Avanir Pharmaceuticals, Genentech, Janssen Alzheimer Immunotherapy, Merck, Pfizer and Takeda Pharmaceuticals; has provided consultations to AbbVie, Accera, AC Immune, Avanir Pharmaceuticals, AZTherapies, Baxter, Biotie Therapies, CereSpir, Chiesi, GlaxoSmithKline, Hoffman-La Roche, Merck, Novartis, Nutricia, Suven Life Sciences, Targacept, Toyama Chemical and Transition Therapeutics; and holds stock options in AZTherapies, QR Pharma, Sonexa Therapeutics and Transition Therapeutics (in the past 2 years). DSM is a full-time employee of Bracket, Wayne, PA. JLC has received research support from Avid Radiopharmaceuticals and Teva Pharmaceuticals; has provided consultation to AbbVie, ACADIA Pharmaceuticals, Adamas Pharamaceuticals, Alzheon, Anavex Life Sciences, AstraZeneca, Avanir Pharmaceuticals, Biogen Idec, Biotie Therapies, Boehringer Ingelheim, Bristol-Myers Squibb, Chase Pharmaceuticals, Eisai, FORUM Pharmaceuticals, Genentech, Grifols, Intra-Cellular Therapies, Eli Lilly, Lundbeck, Merck, Neurotrope BioScience, Novartis, Nutricia, Otsuka, Pfizer, Prana Biotechnology, QR Pharma, Resverlogix, Roche, Sonexa Therapeutics, Suven Life Sciences, Takeda Pharmaceuticals and Toyama Chemical; has provided consultation to GE Healthcare and MedAvante; owns stock in Adamas Pharamaceuticals, Prana Biotechnology, Sonexa Therapeutics, MedAvante, NeuroTrax and Neurokos; and owns the copyright of the Neuropsychiatric Inventory. PA serves on a scientific advisory board for NeuroPhage Pharmaceuticals; has served as a consultant to Elan Pharmaceuticals, Wyeth, Eisai, Bristol-Myers Squibb, Eli Lilly, NeuroPhage Pharmaceuticals, Merck, Roche, Amgen, Genentech, Abbott, Pfizer, Novartis, Bayer, Astellas Pharma, Otsuka, Daiichi Sankyo, AstraZeneca, Janssen Pharmaceutica, Medivation, Ichor Therapeutics, Toyama Chemical, Lundbeck, Biogen Idec, iPierian, Probiodrug, Somaxon Pharmaceuticals, Biotie Therapies, Cardeus Pharmaceuticals, Anavex Life Sciences, Kyowa Hakko Kirin Pharma, Medtronic, AbbVie and CohBar; and receives research support from Eli Lilly and the National Institutes of Health (NIH) (National Institute on Aging (NIA) grant U01 AG10483 (PI), NIA grant U01 AG024904 (coordinating center director), NIA grant R01 AG030048 (PI) and NIA grant R01 AG16381 (co-PI)). RR and KE receive research support from the NIH (NIA grants U01 AG10483 and U01 AG024904 (coordinating center statisticians). The four clinical trials were sponsored by Eli Lilly & Co. Data were analyzed by the AD Cooperative Study (ADCS) through a Data Analysis and Publication Committee.
JDG, RR, KE, PA, SAD, Y-FC, HL-S, AMH, DSM, RSD, DBH and JLC were involved in designing the current secondary data analysis study. RR and KE performed the statistical analyses. JDG drafted the manuscript. All authors read and approved the final manuscript.
Rights and permissions
About this article
Cite this article
Grill, J.D., Raman, R., Ernstrom, K. et al. Comparing recruitment, retention, and safety reporting among geographic regions in multinational Alzheimer’s disease clinical trials. Alz Res Therapy 7, 39 (2015). https://doi.org/10.1186/s13195-015-0122-5
- Mini Mental State Examination
- Mini Mental State Examination Score
- Multinational Trial
- Study Partner