Skip to main content

Efficacy of the Ubiquitous Spaced Retrieval-based Memory Advancement and Rehabilitation Training (USMART) program among patients with mild cognitive impairment: a randomized controlled crossover trial



Spaced retrieval training (SRT) is a nonpharmacological intervention for mild cognitive impairment (MCI) and dementia that trains the learning and retention of target information by recalling it over increasingly long intervals. We recently developed the Ubiquitous Spaced Retrieval-based Memory Advancement and Rehabilitation Training (USMART) program as a convenient, self-administered tablet-based SRT program. We also demonstrated the utility of USMART for improving memory in individuals with MCI through an open-label uncontrolled trial.


This study had an open-label, single-blind, randomized, controlled, two-period crossover design. Fifty patients with MCI were randomized into USMART–usual care and usual care–USMART treatment sequences. USMART was completed or usual care was provided biweekly over a 4-week treatment period with a 2-week washout period between treatment periods. Primary outcome measures included the Word List Memory Test, Word List Recall Test (WLRT), and Word List Recognition Test. Outcomes were measured at baseline, week 5, and week 11 by raters who were blinded to intervention type. An intention-to-treat analysis and linear mixed modeling were used.


Of 50 randomized participants, 41 completed the study (18% dropout rate). The USMART group had larger improvements in WLRT score (effect size = 0.49, p = 0.031) than the usual care group. There were no significant differences in other primary or secondary measures between the USMART and usual care groups. Moreover, no USMART-related adverse events were reported.


The 4-week USMART modestly improved information retrieval in older people with MCI, and was well accepted with minimal technical support.

Trial registration NCT01688128. Registered 12 September 2012.


Mild cognitive impairment (MCI) represents an at-risk stage of cognitive decline between normal aging and dementia [1]. Given the absence of an approved pharmacological treatment for MCI [2], clinical research has advocated the use of several nonpharmacological interventions designed to optimize patient cognition, affect, and global functioning [3,4,5,6]. Spaced retrieval training (SRT) is one such intervention that trains the learning and retention of target information by recalling it over increasingly long intervals [7]. In previous research, SRT was found to improve prospective memory [8] and the capacity to learn face–name associations [9] in patients with MCI. SRT also improves semantic memory and behavioral strategies in patients with dementia [10, 11]. Studies have speculated that SRT improves learning through a combination of ecologically valid priming, spacing effect, conditioning, and errorless learning [11, 12]. In previous work by our group, we developed the 24-session Spaced Retrieval-based Memory Advancement and Rehabilitation Training (SMART) program and demonstrated its ability to improve memory retention spans in patients with very mild-to-mild Alzheimer’s disease (AD) through an open-label uncontrolled trial [13]. Expanded retention spans induced by the SMART program were maintained for different sets of target information, indicating that the effects of SMART on memory may be generalized [13, 14].

Information technologies are increasingly incorporated into therapeutic strategies to improve the accessibility and effectiveness of nonpharmacological interventions. Computer-based interventions enable the standardization and individualization of interventions, the unobtrusive real-time monitoring of cognitive performance, adjustment of the level of intervention, and reductions in personnel and implementation costs [15]. Computer-based cognitive training has been successfully delivered to old adults with normal cognition, MCI, and AD [15], and was effective in improving global cognition, selective cognitive domains, and psychosocial functioning of patients with MCI [16].

SRT was also delivered successfully to patients with dementia as a program on computers and tablets [17, 18]. A study of computer-assisted SRT for face–name associations in participants with mild to moderate dementia reported that 20 of 23 patients succeeded in learning novel and familiar names and biographical information over 32 minutes. Among these 20 participants, 17 patients showed transfer of familiar names from the training sessions to real-life interactions, and 19 patients retained the learned names until 6 weeks after the SRT [17]. In our previous work, we transformed the SMART program into a tablet-based application called the ubiquitous SMART (USMART) program. This program was self-administered by the patients with MCI or early dementia without the support of a trained therapist, and was effective in improving memory in patients with MCI in an open-label uncontrolled trial [14].

In the present study, we aimed to validate the efficacy of USMART on memory function in patients with MCI in a randomized controlled trial (RCT).



We enrolled a total of 50 patients with MCI (10 amnestic single domain type, 25 amnestic multiple domains type, 12 nonamnestic single domain type, and 3 nonamnestic multiple domains type). Patients were recruited from the dementia clinic of Seoul National University Bundang Hospital (SNUBH) (n = 28) and the Korean Longitudinal Study on Cognitive Aging and Dementia (KLOSCAD) [19] (n = 22) between August 2014 and October 2014. The KLOSCAD is a population-based prospective older people cohort study on cognitive aging and dementia that was launched in 2009.

Research geropsychiatrists with expertise in dementia research evaluated each patient using the Korean version of the Consortium to Establish a Registry for Alzheimer’s Disease (CERAD-K) [20]. Research neuropsychologists administered the Korean version of the CERAD Neuropsychological Assessment Battery (CERAD-K-N) [20], the Frontal Assessment Battery (FAB) [21] and the Digit Span Test (DST) [22]. The CERAD-K-N [23] consists of nine neuropsychological tests, including the Categorical Fluency Test (CFT), the Modified Boston Naming Test (mBNT), the Mini Mental Status Examination (MMSE), the Word List Memory Test (WLMT), the Constructional Praxis Test (CPT), the Word List Recall Test (WLRT), the Word List Recognition Test (WLRcT), the Constructional Recall Test (CRT), and the Trail Making Test A (TMT-A).

MCI was diagnosed according to the revised diagnostic criteria for MCI proposed by the International Working Group on MCI [24]. Cognitive concerns were confirmed by the clinicians, who referred to self-and/or informant-reported cognitive decline. We ascertained the presence of objective cognitive impairment if a participant had a score less than −1.0 standard deviation (SD) of the age-, gender-, and education-adjusted norm for elderly Koreans on any of the 11 neuropsychological tests (FAB, DST forward, DST backward, CFT, mBNT, WLMT, CPT, WLRT, WLRcT, CRT, and TMT-A). Amnestic-type MCI was defined by impairment in any of the four memory tests (WLMT, WLRT, WLRcT, and CRT). We required that basic activities of daily living were preserved, and that impairment in complex instrumental functions were insufficient for a diagnosis of dementia. This level of functional impairment was determined by the clinical judgment of research geropsychiatrists and confirmed in case conferences by research geropsychiatrists. Patients with dementia were diagnosed according to the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (DSM-IV) criteria [25] and excluded from the study. We also excluded patients with major psychiatric disorders listed in Axis I of the DSM-IV [25], any neurological disorders that could affect cognitive function, any physical condition that could preclude regular attendance and full intervention-program participation, and illiteracy. We did not exclude patients who were regularly taking stable doses of cognitive enhancers, sedatives, or antidepressants for at least 3 months before the study; these patients were instructed to maintain their medication regimens for the duration of the trial.

All participants were fully informed of the study protocol, and provided written informed consent, signed by the subjects or their legal guardians.

Study design

This study was an open-label, single-blind, randomized, controlled, two-period crossover trial ( NCT01688128) investigating the efficacy of USMART in patients with MCI. Randomization was performed by the Medical Research Collaborating Center at SNUBH, who had no contact with patients or caregivers. A random code table and permuted-block randomization with varying block sizes [26] were used in SAS software, version 9.2 (SAS Institute Inc., Cary, NC, USA). The allocation sequence was produced independently and concealed until patients had entered the trial. The trial consisted of two 4-week periods that were crossed over. During the first period, patients were randomized to receive either USMART (n = 25) or usual care (n = 25). After a 2-week washout period, the groups were crossed over to receive the alternative treatment for 4 weeks. Clinical and neuropsychological characteristics were assessed at the beginning (week 0), the end of the first treatment period (week 5), and the end of the second treatment period (week 11) by raters who were blinded to intervention type (Fig. 1). This study protocol was approved by the Institutional Review Board of SNUBH (no. E-1207/162-001).

Fig. 1
figure 1

Trial flow chart. n number of subjects, USMART Ubiquitous Spaced Retrieval-based Memory Advancement and Rehabilitation Training


The USMART program was developed by transforming SMART, an offline face-to-face spaced retrieval-based memory training program, into a self-administered application on an iPad tablet [14]. Participants self-administered the USMART program for 30 min per session, twice per week, over the 4-week intervention period. In each session, the retrieval interval was sequentially doubled from 0.75 to 12 min (i.e., 0.75, 1.5, 3, 6, and 12 min). If the participant succeeded in recalling a given set of words within 12 min in two consecutive sessions, the number of words to be memorized within a session was automatically sequentially increased in the following session from one to five words. All procedures during USMART were guided by automatic verbal messages from the application [14]. In order to adhere to the study protocol, an occupational therapist was assigned to each participant, visited the participant at every training session with a tablet that had USMART installed, and took the tablet back after each training session. In each session, the assigned occupational therapist encouraged the participant to practice USMART, but did not provide any assistance for using the USMART application. We gathered the training records of the participants automatically via a web portal service.

Outcome measures

The primary outcome measures were WLMT, WLRT, and WLRcT scores [20]. Secondary outcome measures included the Subjective Memory Complaint Questionnaire (SMCQ) which measures subjective memory complaints [27], the Geriatric Depression Scale (GDS) which measures the severity of depressive mood [28], and the MMSE which measures the level of global cognition [29]. All outcome measures were evaluated at weeks 0, 5, and 11 by trained research psychologists who were blinded to allocation information (Fig. 1).

Sample size and statistical analyses

Assuming an attrition rate of 20%, a sample size of 50 patients (25 per treatment arm) would provide more than 80% power to detect a 2.5-point mean difference in WLRT with a SD of 2.53 (as in the Korean validation study [20]) at a two-sided type-I error of 0.05.

The intent-to-treat (ITT) population was defined as all randomized patients who provided at least one baseline efficacy assessment and attended at least one treatment session; this population was used for our primary efficacy evaluation. Five-week and 11-week last-observation-carried-forward analyses were performed for missing values. Baseline characteristics were summarized according to treatment sequence and compared using unpaired t tests for continuous variables and chi-squared tests for categorical variables. The effects of USMART on memory function, global cognition, and depressive mood were assessed using a linear mixed model for a repeated-measures covariance pattern model with compound symmetry within subjects. Period and treatment were included in the model as fixed effects, and patients were included in the model as a random effect. The models were adjusted for age, gender, education, and current cognitive-enhancer use. Effect sizes were calculated as described by Cohen [30]. For all analyses, two-sided p < 0.05 was considered statistically significant. All statistical analyses were performed using Predictive Analytics Software Statistics version 18.0.0 software (2009; SPSS, Inc., Chicago, IL, USA).



Of 50 randomized participants, 43 completed the first intervention period (Fig. 1). Two patients from the USMART–usual care sequence and five patients from the usual care–USMART sequence did not enter the first intervention period because they were no longer willing to participate (n = 2), had an acute medical condition (n = 1), or had a scheduling conflict (n = 4). There were no statistically significant differences in the demographic or clinical characteristics of participants in the USMART–usual care sequence (n = 23) vs those in the usual care–USMART sequence (n = 20) in the ITT population (Table 1). After study initiation, one participant in the USMART–usual care sequence dropped out after session 5 of the first period because of acute renal failure. In the second period, one participant from the USMART–usual care sequence dropped because they were no longer willing to participate after session 4. There were no adverse events related to USMART during the first and second periods, and there were no dropouts due to difficulty operating the USMART application.

Table 1 Baseline demographic and clinical characteristics of participants


Changes in WLMT, WLRT, WLRcT, SMCQ, GDS, and MMSE scores are presented in Table 2. USMART was more beneficial than usual care for improving measures of memory recall function (1.12 ± 1.56 vs 0.36 ± 1.56 points, respectively; effect size = 0.49; p = 0.031) for the WMRT. In the USMART period, 62.8% of participants showed improvement in WLRT score, whereas in the usual care period, only 35.7% of participants showed improvement (p = 0.013). Among secondary measures, there were no significant differences in changes in GDS, SMCQ, or MMSE scores between the USMART and usual care periods. Carryover effects of the first period were not significant for any primary or secondary outcome measures (p > 0.1).

Table 2 Efficacy of USMART vs usual care


In this study, we found that biweekly self-administration of USMART over a 4-week period was more effective than usual care for improving memory function in patients with MCI. Operation of the USMART application seemed to be simple and easy for patients with MCI, because no patients dropped out due to difficulty with the application. To our knowledge, this is the first RCT on the efficacy of self-administered computerized SRT.

Previous RCTs indicate that SRT is effective in improving training content-associated tests in various cognitive domains and functions such as personal information recall [31], name–face association [31], instrumental activities of daily living [32], and problematic behaviors such as eating difficulty [33]. However, these studies did not find a generalization of the SRT effects to neuropsychological tests independent of training content in the SRT [31, 32], except in a measure of attention [31].

In the current RCT, USMART improved performance in patients with MCI on the WLRT, which uses a set of words that are different from those in the training content of USMART. According to Valenzuela and Sachdev [34], generalization can happen at multiple levels. These include transfer to nontrained tasks in the same cognitive domain, transfer to nontrained tasks in other cognitive domains, transfer to global measures of general cognitive ability, and transfer to measures of general function. The transfer to nontrained tasks in the same cognitive domain is the lowest level and that to measures of general function is the highest level in the hierarchy of generalization [34]. Therefore, the current study directly shows that the efficacy of USMART can be transferred to other nontrained tasks in the same cognitive domain (i.e., WLRT), which is the lowest level of generalization. Furthermore, USMART could not improve MMSE (a measure of global cognition) and SMCQ (a measure of function) scores. This indicates that the efficacy of USMART cannot be transferred to general cognitive ability or function. Although we did not measure performance in other cognitive domains in the current study, the efficacy of USMART may not be transferred to nontrained measures of other cognitive domains. This is because these effects were not transferred to the WLMT and WLRcT, which are measures of memory function, although they test different processes of memory than the WLRT. However, the generalizability of USMART should be investigated in future research, because the duration of treatment in this study was short and the sample size was small. In addition, whether improvements due to SRT using different types of memory, such as stories or designs, can also be transferred to other nontrained tasks in the same cognitive domain warrants further research.

The effect size of USMART on the WLRT was modest [30]. One recent meta-analysis reported that the effect of computerized cognitive training on cognition in individuals with MCI is moderate [16]. Another systematic review reported that the effect sizes of memory strategy trainings ranged from –1.18 to 0.88 in individuals with MCI [35]. Although there have been no clinical trials to investigate the effect size of SRT in patients with MCI, a meta-analysis of the effects of SRT on semantic memory in patients with mild AD reported that the effect sizes varied substantially from 0.67 to 37.97 across studies [10]. The authors attributed the wide variation in the effect size of SRT between studies to differences in protocols for SRT, sizes of study samples, outcome measures, and quality of the clinical trials [10].

Several studies failed to show that the effects of SRT generalize to standardized neuropsychological tests of memory function in the patients with AD or dementia [13, 31]. Conventional neuropsychological tests for memory function require more cognitive effort and explicit memory than the new learning in SRT, which mainly uses implicit memory [36]. Patients with AD have more severe explicit memory impairments than those with MCI. Therefore, the efficacy of SRT is less likely to be transferred to neuropsychological tests in the same cognitive domain in patients with AD when compared to those with MCI.

Before USMART, SRTs were implemented in computers [17] or mobile devices [37]. Computerized cognitive training received significant attention as a more cost-effective and accessible option compared to traditional paper-and-pencil cognitive training [38]. Tablet computers in particular have more advantages in their portability and flexibility for delivering a variety of tasks [39]. Limited adaptability to new technology is a common concern for the application of computerized cognitive training in older patients and patients with cognitive impairment. However, two studies have already shown that cognitive training using iPads is effective in improving episodic memory and processing speed in older people [39, 40]. The older individuals with MCI successfully used USMART with minimal technical support in the current study, and those with early-stage AD, all of whom were first-time mobile device users, also successfully used the tablet-based SRT in a previous study [18]. Therefore, a well-designed mobile user interface may become quite applicable as a platform for delivering cognitive training, such as SRT, to older individuals or patients with cognitive impairment.

The present study had several limitations. First, this study was not double-blinded. Second, we employed usual care as a control instead of mock therapy. Third, our sample size was relatively small, but was notably consistent with most previous RCTs on SRT [9, 31, 32, 41]. Fourth, subtypes and causes of MCI were not adjusted for in the analysis. Fifth, the duration of treatment was too short to test the efficacy of USMART on general cognition or function. The efficacy of USMART increased with increasing numbers of training sessions in our previous uncontrolled trial [14]. In addition, the differences in outcome measures between the USMART group and the usual care group might have been attenuated due to learning effects, because the intervals between the outcome measurements were relatively short (Fig. 2). Sixth, we did not evaluate how long the improvement in the WLRT lasted.

Fig. 2
figure 2

WLRT scores during the trial according to the treatment sequence. Bar: 95% confidence interval. Week 0 the beginning (baseline), Week 5 the end of the first treatment period, Week 11 the end of the second treatment period, USMART Ubiquitous Spaced Retrieval-based Memory Advancement and Rehabilitation Training


The 4-week USMART modestly improved information retrieval in older people with MCI, and was well accepted with minimal technical support.



Alzheimer’s disease


Consortium to Establish a Registry for Alzheimer’s Disease


Korean version of the CERAD Neuropsychological Assessment Battery


Categorical Fluency test


Constructional Praxis Test


Constructional Recall Test


Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition


Digit Span Test


Frontal Assessment Battery


Geriatric Depression Scale




Korean Longitudinal Study on Cognitive Aging and Dementia


Modified Boston Naming Test


Mild cognitive impairment


Mini Mental Status Examination


Randomized controlled trial


Standard deviation


Spaced Retrieval-based Memory Advancement and Rehabilitation Training


Subjective Memory Complaint Questionnaire


Seoul National University Bundang Hospital


Spaced retrieval training


Trail Making Test A


Ubiquitous Spaced Retrieval-based Memory Advancement and Rehabilitation Training


Word List Memory Test


Word List Recognition Test


Word List Recall Test


  1. Petersen RC, Smith GE, Waring SC, Ivnik RJ, Tangalos EG, Kokmen E. Mild cognitive impairment: clinical characterization and outcome. Arch Neurol. 1999;56(3):303–8.

    Article  CAS  PubMed  Google Scholar 

  2. Strohle A, Schmidt DK, Schultz F, Fricke N, Staden T, Hellweg R, et al. Drug and exercise treatment of Alzheimer disease and mild cognitive impairment: a systematic review and meta-analysis of effects on cognition in randomized controlled trials. Am J Geriatr Psychiatry. 2015;23(12):1234–49. doi:10.1016/j.jagp.2015.07.007.

    Article  PubMed  Google Scholar 

  3. Wang C, Yu JT, Wang HF, Tan CC, Meng XF, Tan L. Non-pharmacological interventions for patients with mild cognitive impairment: a meta-analysis of randomized controlled trials of cognition-based and exercise interventions. J Alzheimers Dis. 2014;42(2):663–78. doi:10.3233/JAD-140660.

    PubMed  Google Scholar 

  4. Jean L, Bergeron ME, Thivierge S, Simard M. Cognitive intervention programs for individuals with mild cognitive impairment: systematic review of the literature. Am J Geriatr Psychiatry. 2010;18(4):281–96. doi:10.1097/JGP.0b013e3181c37ce9.

    Article  PubMed  Google Scholar 

  5. Tsolaki M, Kounti F, Agogiatou C, Poptsi E, Bakoglidou E, Zafeiropoulou M, et al. Effectiveness of nonpharmacological approaches in patients with mild cognitive impairment. Neurodegener Dis. 2011;8(3):138–45. doi:10.1159/000320575.

    Article  PubMed  Google Scholar 

  6. Teixeira CV, Gobbi LT, Corazza DI, Stella F, Costa JL, Gobbi S. Non-pharmacological interventions on cognitive functions in older people with mild cognitive impairment (MCI). Arch Gerontol Geriatr. 2012;54(1):175–80. doi:10.1016/j.archger.2011.02.014.

    Article  PubMed  Google Scholar 

  7. Camp CJ. Facilitation of new learning in Alzheimer's disease. New York: Springer; 1989.

    Google Scholar 

  8. Ozgis S, Rendell PG, Henry JD. Spaced retrieval significantly improves prospective memory performance of cognitively impaired older adults. Gerontology. 2009;55(2):229–32. doi:10.1159/000163446.

    Article  PubMed  Google Scholar 

  9. Jean L, Simard M, Wiederkehr S, Bergeron ME, Turgeon Y, Hudon C, et al. Efficacy of a cognitive training programme for mild cognitive impairment: results of a randomised controlled study. Neuropsychol Rehabil. 2010;20(3):377–405. doi:10.1080/09602010903343012.

    Article  PubMed  Google Scholar 

  10. Oren S, Willerton C, Small J. Effects of spaced retrieval training on semantic memory in Alzheimer's disease: a systematic review. J Speech Lang Hear Res. 2014;57(1):247–70. doi:10.1044/1092-4388(2013/12-0352).

    Article  PubMed  Google Scholar 

  11. Creighton AS, van der Ploeg ES, O'Connor DW. A literature review of spaced-retrieval interventions: a direct memory intervention for people with dementia. Int Psychogeriatr. 2013;25(11):1743–63. doi:10.1017/S1041610213001233.

    Article  PubMed  Google Scholar 

  12. Camp CJ. Spaced retrieval: a model for dissemination of a cognitive intervention for persons with dementia. In: Attix DK, Welsh-Bohmer KA, editors. Geriatric Neuropsychology: Assessment and Intervention. New York: The Guilford Press; 2006. p. 275–92.

    Google Scholar 

  13. Lee SB, Park CS, Jeong JW, Choe JY, Hwang YJ, Park CA, et al. Effects of spaced retrieval training (SRT) on cognitive function in Alzheimer's disease (AD) patients. Arch Gerontol Geriatr. 2009;49(2):289–93. doi:10.1016/j.archger.2008.10.005.

    Article  PubMed  Google Scholar 

  14. Han JW, Oh K, Yoo S, Kim E, Ahn KH, Son YJ, et al. Development of the ubiquitous spaced retrieval-based memory advancement and rehabilitation training program. Psychiatry Investig. 2014;11(1):52–8. doi:10.4306/pi.2014.11.1.52.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Gates N, Valenzuela M. Cognitive exercise and its role in cognitive function in older adults. Curr Psychiatry Rep. 2010;12(1):20–7. doi:10.1007/s11920-009-0085-y.

    Article  PubMed  Google Scholar 

  16. Hill NT, Mowszowski L, Naismith SL, Chadwick VL, Valenzuela M, Lampit A. Computerized cognitive training in older adults with mild cognitive impairment or dementia: a systematic review and meta-analysis. Am J Psychiatry. 2017;174(4):329-40. doi:10.1176/appi.ajp.2016.16030360.

  17. Mahendra N. Computer-assisted spaced retrieval training of faces and names for persons with dementia. Non-pharmacol Ther Dement. 2011;1(3):217–38.

    Google Scholar 

  18. Zmily A, Mowafi Y, Mashal E. Study of the usability of spaced retrieval exercise using mobile devices for Alzheimer's disease rehabilitation. JMIR Mhealth Uhealth. 2014;2(3):e31. doi:10.2196/mhealth.3136.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Kim TH, Park JH, Lee JJ, Jhoo JH, Kim BJ, Kim JL, et al. Overview of the Korean Longitudinal Study on Cognitive Aging and Dementia. Alzheimers Dement. 2013;9(4 suppl):626–7. doi:10.1016/j.jalz.2013.05.1268.

    Article  Google Scholar 

  20. Lee JH, Lee KU, Lee DY, Kim KW, Jhoo JH, Kim JH, et al. Development of the Korean version of the Consortium to Establish a Registry for Alzheimer's Disease Assessment Packet (CERAD-K): clinical and neuropsychological assessment batteries. J Gerontol B Psychol Sci Soc Sci. 2002;57(1):47–53.

    Article  Google Scholar 

  21. Kim TH, Huh Y, Choe JY, Jeong JW, Park JH, Lee SB, et al. Korean version of frontal assessment battery: psychometric properties and normative data. Dement Geriatr Cogn Disord. 2010;29(4):363–70. doi:10.1159/000297523.

    Article  PubMed  Google Scholar 

  22. Wechsler D. Wechsler Memory Scale-Revised. New York: Psychological Corporation; 1987.

    Google Scholar 

  23. Lee DY, Lee KU, Lee JH, Kim KW, Jhoo JH, Kim SY, et al. A normative study of the CERAD neuropsychological assessment battery in the Korean elderly. J Int Neuropsychol Soc. 2004;10(1):72–81. doi:10.1017/S1355617704101094.

    Article  PubMed  Google Scholar 

  24. Winblad B, Palmer K, Kivipelto M, Jelic V, Fratiglioni L, Wahlund LO, et al. Mild cognitive impairment—beyond controversies, towards a consensus: report of the International Working Group on Mild Cognitive Impairment. J Intern Med. 2004;256(3):240–6. doi:10.1111/j.1365-2796.2004.01380.x.

    Article  CAS  PubMed  Google Scholar 

  25. American Psychiatric Association. Diagnostic and statistical manual of mental disorders: DSM-IV. 4th ed. Washington, DC: American Psychiatric Association; 1994.

    Google Scholar 

  26. Matts JP, Lachin JM. Properties of permuted-block randomization in clinical trials. Control Clin Trials. 1988;9(4):327–44.

    Article  CAS  PubMed  Google Scholar 

  27. Youn JC, Kim KW, Lee DY, Jhoo JH, Lee SB, Park JH, et al. Development of the Subjective Memory Complaints Questionnaire. Dement Geriatr Cogn Disord. 2009;27(4):310–7. doi:10.1159/000205512.

    Article  PubMed  Google Scholar 

  28. Kim JY, Park JH, Lee JJ, Huh Y, Lee SB, Han SK, et al. Standardization of the Korean version of the geriatric depression scale: reliability, validity, and factor structure. Psychiatry Investig. 2008;5(4):232–8. doi:10.4306/pi.2008.5.4.232.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Kim TH, Jhoo JH, Park JH, Kim JL, Ryu SH, Moon SW, et al. Korean version of mini mental status examination for dementia screening and its' short form. Psychiatry Investig. 2010;7(2):102–8. doi:10.4306/pi.2010.7.2.102.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Cohen J. Statistical Power Analysis for the Behavioral Sciences. Orlando, FL: Academic Press Inc.; 1977.

    Google Scholar 

  31. Davis RN, Massman PJ, Doody RS. Cognitive intervention in Alzheimer disease: a randomized placebo-controlled study. Alzheimer Dis Assoc Disord. 2001;15(1):1–9.

    Article  CAS  PubMed  Google Scholar 

  32. Thivierge S, Jean L, Simard M. A randomized cross-over controlled study on cognitive rehabilitation of instrumental activities of daily living in Alzheimer disease. Am J Geriatr Psychiatry. 2014;22(11):1188–99. doi:10.1016/j.jagp.2013.03.008.

    Article  PubMed  Google Scholar 

  33. Lin LC, Huang YJ, Su SG, Watson R, Tsai BW, Wu SC. Using spaced retrieval and Montessori-based activities in improving eating ability for residents with dementia. Int J Geriatr Psychiatry. 2010;25(10):953–9. doi:10.1002/gps.2433.

    Article  PubMed  Google Scholar 

  34. Valenzuela M, Sachdev PS. Harnessing brain and cognitive reserve for the prevention of dementia. Indian J Psychiatry. 2009;51 Suppl 1:S16–21.

    PubMed  PubMed Central  Google Scholar 

  35. Gates NJ, Sachdev PS, Fiatarone Singh MA, Valenzuela M. Cognitive and memory training in adults at risk of dementia: a systematic review. BMC Geriatr. 2011;11:55. doi:10.1186/1471-2318-11-55.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Cherry KE, Simmons-D'Gerolamo SS. Long-term effectiveness of spaced-retrieval memory training for older adults with probable Alzheimer's disease. Exp Aging Res. 2005;31(3):261–89. doi:10.1080/03610730590948186.

    Article  PubMed  Google Scholar 

  37. Tactus Therapy Solutions Ltd. Accessed 19 Mar 2017.

  38. Kueider AM, Parisi JM, Gross AL, Rebok GW. Computerized cognitive training with older adults: a systematic review. PLoS One. 2012;7(7):e40588. doi:10.1371/journal.pone.0040588.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  39. Chan MY, Haber S, Drew LM, Park DC. Training older adults to use tablet computers: does it enhance cognitive function? Gerontologist. 2016;56(3):475–84. doi:10.1093/geront/gnu057.

    Article  PubMed  Google Scholar 

  40. Vaportzis E, Martin M, Gow AJ. A tablet for healthy ageing: the effect of a tablet computer training intervention on cognitive abilities in older adults. Am J Geriatr Psychiatry. 2016. doi:10.1016/j.jagp.2016.11.015. [Epub ahead of print].

  41. Hawley KS, Cherry KE, Boudreaux EO, Jackson EM. A comparison of adjusted spaced retrieval versus a uniform expanded retrieval schedule for learning a name-face association in older adults with probable Alzheimer's disease. J Clin Exp Neuropsychol. 2008;30(6):639–49. doi:10.1080/13803390701595495.

    Article  PubMed  Google Scholar 

Download references


Not applicable.


This study was supported by a grant from the Korean Health Technology R&D Project, Ministry of Health and Welfare, Republic of Korea (grant no. HI09C1379 (A092077)).

Availability of data and materials

The datasets used and/or analyzed during the current study available from the corresponding author on reasonable request.

Authors’ contributions

KWK and JWHan contributed to the study concept and design, analysis, and interpretation of data, and were major contributors in writing the manuscript. KLS, KK, JWHong, and THK participated in the acquisition of data, statistical analysis, and interpretation of data. HJB and JWK participated in the acquisition of data and interpretation of data. All authors read and approved the final manuscript.

Competing interests

The authors declare that they have no competing interests.

Consent for publication

Not applicable.

Ethics approval and consent to participate

The protocol and informed consent form were approved by the Institutional Review Board of Seoul National University Bundang Hospital (no. E-1207/162-001). Written informed consent was obtained from each participant or their legal guardian(s) prior to study participation.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Author information

Authors and Affiliations


Corresponding author

Correspondence to Ki Woong Kim.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Han, J.W., Son, K.L., Byun, H.J. et al. Efficacy of the Ubiquitous Spaced Retrieval-based Memory Advancement and Rehabilitation Training (USMART) program among patients with mild cognitive impairment: a randomized controlled crossover trial. Alz Res Therapy 9, 39 (2017).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: