Skip to main content

The need for harmonisation and innovation of neuropsychological assessment in neurodegenerative dementias in Europe: consensus document of the Joint Program for Neurodegenerative Diseases Working Group


Cognitive, behavioural, and functional assessment is crucial in longitudinal studies of neurodegenerative dementias (NDD). Central issues, such as the definition of the study population (asymptomatic, at risk, or individuals with dementia), the detection of change/decline, and the assessment of relevant outcomes depend on quantitative measures of cognitive, behavioural, and functional status.

Currently, we are far from having available reliable protocols and tools for the assessment of dementias in Europe. The main problems are the heterogeneity of the tools used across different European countries, the lack of standardisation of administration and scoring methods across centres, and the limited information available about the psychometric properties of many tests currently in widespread use. This situation makes it hard to compare results across studies carried out in different centres, thus hampering research progress, in particular towards the contribution to a “big data” common data set.

We present here the results of a project funded by the Joint Program for Neurodegenerative Diseases (JPND) and by the Italian Ministry of Health. The project aimed at providing a consensus framework for the harmonisation of assessment tools to be applied to research in neurodegenerative disorders affecting cognition across Europe. A panel of European experts reviewed the current methods of neuropsychological assessment, identified pending issues, and made recommendations for the harmonisation of neuropsychological assessment of neurodegenerative dementias in Europe.

A consensus was achieved on the general recommendations to be followed in developing procedures and tools for neuropsychological assessment, with the aim of harmonising tools and procedures to achieve more reliable data on the cognitive-behavioural examination. The results of this study should be considered as a first step to enhancing a common view and practise on NDD assessment across European countries.


The large-scale availability of cohorts at the European level is a prerequisite for the construction of platforms for prevention and intervention studies in neurodegenerative dementias (NDD). A necessary step for the successful linking of existing or planned cohort studies is the harmonisation of clinical and biomarker data. In particular, an urgent need is to develop a consensus on methodologies to define and measure cognitive, behavioural, and functional status in target populations. The role of cognitive, behavioural, and functional assessment is crucial in longitudinal studies for several central purposes. A quantitative assessment of cognitive, behavioural, and functional status is needed for the definition of the study population as asymptomatic (individuals who present risk factors, such as ageing, but do not manifest cognitive symptoms or signs), at risk (individuals with mild cognitive impairment or subtle cognitive changes not fulfilling the criteria for dementia), or individuals with dementia (i.e. fulfilling the criteria for dementia according to a standard definition such as cognitive impairment impacting on social function and activities of daily living). In addition, the same measures are used for the detection of change/decline and for the assessment of relevant outcomes of interventions.

Currently, we are far from having available reliable protocols and tools for the assessment of dementias in Europe (for a recent US perspective on this issue, see [1]). The tools used are heterogeneous across different European countries, within an individual country, and even across different clinical and research institutes. This situation makes it hard to compare results across studies carried out in different centres, thus hampering research progress, in particular towards the contribution to a “big data” common data set.

The requirement for harmonised assessment of cognitive, behavioural, and functional symptoms has been extensively discussed in the field of dementia research [2]. Harmonisation recommendations have been proposed in the case of vascular cognitive impairment [3]. In the case of NDD, surveys of assessment tools for the most common NDD, Alzheimer’s disease (AD), used across Europe have been published by the European AD consortium [4] and by a task force of the European Federation of Neurological Societies [5], demonstrating a wide variety in assessment tools. In the last few years, the development of new diagnostic criteria for AD [6, 7], posterior cortical atrophy [8], frontotemporal dementia - behavioural variant [9], and primary progressive aphasia [10] all include a consideration of recommended, disease-specific testing procedures aiming at early diagnosis—although precise details of specific tests are often lacking, meaning that test selection is open to interpretation and, therefore, to potential inconsistency.

We present the results of a Working Group (WG) supported by the Joint Program for Neurodegenerative Diseases (JPND) and by the Italian Ministry of Health. The aims of the WG were: 1) to provide a set of practical recommendations for effective harmonisation procedures allowing us to optimise the utilisation of cognitive, behavioural, and functional data from on-going longitudinal studies; and 2) to identify areas in which further research is needed in order to propose harmonised innovative assessments maximising the effectiveness of deep phenotyping, considering in particular the possible translational impact of cognitive neuroscience research in areas such as memory, language, spatial orientation, action organisation, and social cognition.

This paper is an extended version of the final report on the JPND website ( It is structured in two main sections. In the first section, we describe the methods. In the second section, we present the results, in separate sub-sections for each phenomenological dimension we reviewed, including both: 1) an analytical discussion of current evidence; and 2) recommendations for further developments of practice and research.


The flow chart shown in Fig. 1 synthetises the main steps of the project. The project was selected in a competitive call by the Joint Program for Neurodegenerative Diseases for “Working Groups to Inform Cohort Studies in Neurodegenerative Disease Research”. The recruitment of the group members was the responsibility of the proponent, who, during the pre-submission phase, contacted researchers (neurologists and neuropsychologists) with a specific competence in the diagnosis and psychometric assessment of dementia, as documented by their scientific publications in peer-reviewed international journals. Additional criteria were expertise in specific sub-fields of assessment, representation of main European research centres involved in longitudinal studies of NDD, and availability to participate in the working group programme (opening meeting, 6 months of at-distance work, final meeting). A total of 22 experts from eight European Union countries (Belgium, Denmark, France, Germany, Greece, Italy, the Netherlands, and the UK) and from Switzerland accepted the invitation to participate.

Fig. 1
figure 1

The flow chart that synthetises the main steps of the project

In a first workshop participants discussed the general organisation of the workplan: reviewing the available evidence on neuropsychological assessment of NDD in Europe. A general distinction was made between “global assessment”, referring to procedures used for the initial screening of the patient’s general cognitive status, and “detailed assessment”, encompassing target phenotypic dimensions of dementias, intended as the main phenomenological changes of NDD involving cognitive, behavioural, motor, and functional domains that are measurable by the administration of psychometric tools. These target dimensions were defined with plenary consensus and were identified taking into account both the clinical manifestations that are common to all NDD and signs that are specific to the early stages of the different syndromes. The following target dimensions were, thus, defined as follows: episodic memory (early involvement in the typical form of AD), language (early impairment in primary progressive aphasias), executive functions (early involvement in frontotemporal dementias), visual-spatial abilities (early impairment in posterior cortical atrophy and dementia with Lewy bodies), behavioural symptoms (early involvement in frontotemporal dementia – behavioural variant), motor (early involvement in corticobasal degeneration and in dementias with extrapyramidal symptoms), and functional status (common to the early phases of all NDD).

Small groups encompassing three to four researchers were then created, each dedicated to one target dimension. The task of the small groups was to review current methods used to investigate target phenotypic dimensions of dementia, identify critical issues, and provide a definite set of operational recommendations for harmonisation purposes: identifying un-met needs for each specific domain, taking into account, in particular, the need for adequate information about psychometric qualities (i.e. validity, reliability, sensitivity, specificity). Critical issues in each area were identified based on existing evidence as well as the participants’ knowledge and clinical expertise.

The initial indications proposed by these small groups were then discussed in web-based conferences involving the whole consortium. In these conferences, statements, procedures, and indications by the small groups were revised.

A consensus on the available evidence and un-met needs for each cognitive domain, identified as critical in the assessment and monitoring of NDD, was achieved in a final workshop, involving the entire consortium, either by physical participation or web-conference. The consensus on each specific issue was achieved with the agreement of all participants.


Global assessment

Discussion of current evidence

The Mini Mental State Examination (MMSE) is currently the most widely used test for cognitive screening in clinical practice [11], and is mentioned by several guidelines for the assessment of dementia and cognitive disorders. Indeed, it shows good sensitivity and reliability with Cronbach’s α = 0.91 [12]. Moreover, some MMSE items (i.e. intersecting-pentagon copy) were found to reliably discriminate between AD and dementia with Lewy bodies (DLB) [13] in an autopsy-verified population. Nevertheless, the MMSE suffers from some important limitations. It shows poor specificity for people with a low educational level, who may achieve low scores although healthy, and poor sensitivity for people with a high educational level who can obtain high scores even when impaired; it is highly sensitive to memory and language disorders but not to executive functioning [14].

The Montreal Cognitive Assessment (MoCA) is another brief screening measure for cognitive disorders [15] consisting of a 30-point test administered in 10 min, focusing on memory, visual-spatial, executive, and language function, and orientation to time and place. The MoCA has the advantage of being short and easy to administer with a good sensitivity (86%) for mild cognitive impairment (MCI) and AD (97%) and for the post-stroke cognitive screening [16]. It is easily available via a dedicated website providing free test forms in a number of languages, including parallel versions.

The Frontal Assessment Battery (FAB) [17] includes six sub-tests exploring conceptualisation, mental flexibility, motor programming, inhibitory control, and environmental autonomy, and is considered a reliable tool to investigate dysexecutive symptoms in frontal-related disorders. However, its usefulness to discriminate between the dysexecutive profiles of different NDD is controversial [18, 19]. In particular, the results of a study involving individuals with mild AD and mild frontotemporal dementia (FTD) documented that only the FAB sub-test “go/no-go” detected significant between-group differences, whereas performance on the other sub-tests was quite similar. However, the authors found good concurrent validity (i.e. significant correlation between FAB and individual executive test scores).

Test batteries such as the AD Assessment Scale-Cognition (ADAS-CoG) [20], Cambridge Cognitive Assessment-Revised (CAMCOG-R) [21], and Addenbrooke’s Cognitive Examination (ACE-R) [22] have the advantage of parallel forms but the assessment of executive functions is limited. ACE-R takes between 12 and 20 min (average 16 min) to administer (and score) and examines attention/orientation, memory, fluency, language, and visual-spatial functions. Future work is needed to establish the efficacy of a brief battery such as ACE-R in different types of dementia, even though it has been indicated to be effective in differential diagnosis of different forms of Parkinsonism [23].

The Mattis Dementia Rating Scale (MDRS) [24] is a battery that assesses attention, perseveration, construction ability, conceptualisation, and memory, and was recently recommended by the Movement Disorder Society for the assessment of dementia in individuals with extrapyramidal disorders [25]. However, administration may be considered too lengthy for a first global screening test.


The panel recommended a step-wise approach to be followed in the assessment of a person in whom dementia is suspected. As a first step, a short screening should be performed (less than 15 min for administration). The MMSE, MoCA, Mini-CoG [26], ACE or ACE-R, and the FAB are recommended for this purpose. In the case of clinical and psychometric evidence suggesting a cognitive impairment, a second-level examination should be performed. At this level, an examination by a specialist should confirm/verify the initial diagnostic hypotheses. For this purpose, the following tests could be used: ADAS-Cog, CAMCOG-R, and the MDRS.

The above two steps specifically refer to the examination of global cognitive functioning. The third step is the in-depth examination of the neuropsychological profile by means of tests specific to each cognitive domain.

Detailed assessment area

In this section, we report results on the phenotypic dimensions of dementia defined by the consortium. Recommendations for the assessment of episodic memory, language, executive functions, visual-spatial abilities, behavioural symptoms, and motor and functional status are summarised in Table 1.

Table 1 Synoptically report of the recommendations for further developments of clinical research in the field of neurodegenerative dementias (NDD)

Episodic memory functions

Discussion of current evidence

Episodic memory disorders are a key element of the cognitive decline that defines the clinical staging of AD. Memory disorders also occur in many other conditions, including depression and healthy ageing, leading to diagnostic uncertainty. Hence, memory tests are sensitive but may not be specific. Moreover, performance on such tests reaches a floor very early in the disease, making them a poor marker of disease severity and progression.

The most widely used episodic memory tests for the identification of the amnestic syndrome of AD are based on list learning and delayed recall. These tests include different versions of the paired-associate learning [27] and the Rey Auditory Verbal Learning tasks [28]. It has been proposed that tests that control for attention and effective encoding and that can facilitate retrieval are particularly suitable to identify an amnestic syndrome of the hippocampal type, typical of AD. Memory tests with cueing, either at the bedside (5-Word Test) [29] or administered by neuropsychologists (Free and Cued Selective Reminding Test (FCSRT)) [30], have shown good specificity for AD [31]. It should be taken into account that the above tools place heavy demands on verbal abilities. This significantly reduces their applicability in conditions characterised by severe language disorders (e.g. primary progressive aphasia (PPA)). Some neuropsychological tests with limited language demands have been proposed. Among these, the DMS48 [32] and the Visual Short-Term Memory Binding Test [33, 34], which tap long-term recognition memory and associative processes within short-term memory, respectively, showed good specificity for AD. They have the additional benefit of being unaffected by healthy ageing or low education levels. The recently proposed “5 Objects Test” has the advantage of being unaffected by low education levels and of having limited language demands (i.e. it requires locations of five everyday objects, immediately after placement, and after a brief period of time) [35].

A new area of research is represented by the study of prospective memory functioning and, in particular, by the potential contribution of prospective memory procedures to discriminate between different pathological conditions [36].


Additional information about the sensitivity, specificity, and positive and negative predictive value of each test proposed for clinical use in AD and in other dementias should be achieved [37, 38]. In this regard, it must be underlined that memory tests for dementia and earlier stages of impairment, such as MCI, have different requirements. The former must account for the distributed network dysfunction of manifest dementia, the latter need to be able to detect early and circumscribed deficits. Thus, the sensitivity of clinical tests is likely to benefit from incorporating the assessment of multiple memory processes, whereas sensitivity to early AD conditions is likely to benefit from process-specificity to the early stages of AD pathology involving sub-sectors of the medial temporal lobe. Other issues to consider include age effects, practice effects, ceiling and floor effects, repeatability, ease of administration, and correlation with biomarkers. Indeed, the distinction between neuropathological changes in healthy ageing and AD is disputed, making it challenging to define clear boundaries between the two.

Among extant tools, in order to discriminate between AD-related memory deficits and memory disorders occurring in other NDD, at the moment it is recommended to use more than one test. Among the most interesting candidates for high specificity in the very early stages of disease are the FCSRT and the Visual Short-Term Memory Binding Test.

Language abilities

Discussion of current evidence

Only a minority of tools have been developed to assess language impairments either in those NDD in which it is not a prominent feature (typical AD) or in NDD in which language disorders represent the main determinant of clinical presentation (PPA).

The most widely used naming test is the Boston Naming test [39, 40]. Originally developed for stroke aphasia, it has been adapted to wider applications with the development of several forms (60, 30, and 15 items). Extensive data are available about its sensitivity (individuals with AD vs. healthy controls). Two other tests currently used are the Graded Naming test [41] and the Aachener Aphasie Test (AAT) [42]. Important to evidence is that picture naming tasks are sensitive to AD [43] but they are less specific, as a naming disorder is a pervasive aspect of many NDD [44].

Word generation tests such as phonological and categorical fluency are widely used. However, due to the recruitment of various cognitive processes (e.g. working memory and executive processes) their specificity is relatively low [45]. The Pyramid and Palm Trees Test [46] assesses non-verbal semantics, and is highly specific for the semantic variant of PPA [47].

The assessment of sentence processing entails production and comprehension. To assess production abilities, the most used stimuli are the Cookie theft from the Boston Diagnostic Aphasia Examination (BDAE) and the picnic picture from the Western Aphasia Battery (WAB). A scoring system for PPA is also available [48]. Phrase construction tests have been proposed as a faster, quantitative way to assess production abilities (Northwestern Anagram Test (NAT)) [49].

The most widely used tool to assess sentence comprehension is the Token Test, originally developed as a sensitive test for auditory comprehension in stroke aphasia [50]. The Test for the reception of grammar (TROG) [51] or the Cycle-R [52] have been successfully applied in neurodegenerative diseases to identify specific grammatical deficits.

The assessment of language disorders should also include the evaluation of reading and spelling abilities. In this case, The National Adult Reading Test (NART) [53], or its adaptation into other languages, is often used and also represents a valid estimation of premorbid IQ in dementia. However, as the NART relies on the ability to read irregular words, its application in languages with regular orthography (e.g. Italian and Spanish) is problematic.

Only recently there has been an interest in the development of specific language batteries for NDD. These include the Cambridge Semantic Memory Test [54] and the Sydney Language Battery (SYDBAT) [55]. The latter two, however, concentrate on semantic processing rather than an attempt to cover all aspects of language. Furthermore, the Amsterdam-Nijmegen Everyday Language Test (ANELT) [56] is an example of a test focusing on communicative ability rather than grammatical competence. The clinical use of extensive language examinations is required only in the case of PPA.


The extent of language assessment should be closely linked to the aim of the investigation. In general, lexical semantic processes are more affected than syntactic or phonological processes in the early phase of most NDD. In most settings, picture naming is the test of choice. While many tests are in use, information about psychometric properties, as well as parallel and multi-lingual versions, is needed. In investigations of progressive language disorders, a more comprehensive evaluation including an analysis of extended speech production as well as sentence-level tasks is recommended. Indeed, impairment at the sentence level can occur also in individuals with intact single-word processing; accordingly, in this case, any language assessment not including sentence processing is incomplete and potentially misleading.

Executive functions

Discussion of current evidence

Executive disorders are reported in the early stages of different dementia syndromes, and their role in differential diagnosis is a matter of debate. Indeed, under the umbrella term of “executive functions” are included several mental operations that are partly differentiable. Accordingly, different models of the executive domain have been proposed [57]. This highlights one main difficulty in identifying suitable tests for assessment. In this regard, reduced performance on tests sensitive to controlled inhibition, set-shifting and updating, is mainly associated with dorsolateral frontal dysfunction, whereas performance on others tasks sensitive to emotional/social cognition is mainly associated with frontotemporal dysfunction [58].

As for tests sensitive to controlled inhibition, set-shifting and working memory, Stopford et al. [59] showed that they allowed detecting qualitatively distinct profiles between individuals with FTD and with AD. In fact, impairments in individuals with FTD reflected deficits in attention, set shifting, and response inhibition, while impairments in individuals with AD were influenced by information load and working memory capacity.

Among these tests, inhibition tests are the most sensitive to AD and, more particularly, controlled inhibition (as, for example, in the Stroop or Hayling tasks) [60]. However, these tasks do not allow us to easily distinguish between AD and the FTD-behavioural variant on a quantitative basis [61]; probably a better way to distinguish the two populations is to use qualitative measures [62]. Indeed, most of the clinical or conventional tests of executive functions may be limited by their low test/re-test reliability and by reduced ecological validity [63].

The FAB [17] and the Institute of Cognitive Neurology (INECO) frontal screening battery [64] are commonly used tools for the screening of these executive functions. However, the differential weight of their sub-items remains debatable.

Another applied approach to capture the variety of executive functions is to combine different tests, and look for the number of failed tests to assess executive dysfunction. The GREFEX battery [65] includes cognitive and behavioural tools that are standardised, validated, and normalised for a French-speaking population. The battery is composed of a questionnaire (Behavioural Dysexecutive Syndrome Inventory; Inventaire du Syndrome Dysexécutif Comportemental (ISDC)) and seven cognitive tasks (Stroop task, modified Six Elements Test, Trail-Making test, Adapted version of the Brixton task, a dual-task test, verbal fluency, and modified card sorting test). A similar battery is the Behavioural Assessment of Dysexecutive Syndrome (BADS) [66] that includes sub-tests exploring the different dimensions of the executive domain.

Few tools are currently available to assess emotional processes and social cognition. A classical test investigating emotional recognition was developed by Ekman et al. [67] in which subjects have to identify basic emotions from facial expression of unknown people presented in photographs. The Iowa Gambling task is another popular task developed to assess decision making abilities in situations involving emotional activation [68].

False belief and Faux Pas tasks are one way to assess theory of mind (ToM), i.e. the ability to infer the mental state of somebody else. Although both Faux Pas and false belief tasks have been shown to detect a differential impairment profile in different NDD, in particular in the comparison of individuals with FTD-behavioural variant and individuals with AD [69], there is no consensus as to which test might be more useful for diagnosis and for differential diagnosis of dementia. Recently, some batteries sensitive to the phenomenological manifestations of FTD-behavioural variant have been proposed. Among these, the Social and Emotional Assessment battery (SEA) [70], assessing emotion recognition and ToM abilities, has been shown to be a promising tool for the early detection of FTD-behavioural symptoms.


Due to the multifaceted nature of the executive domain, the recommendation is to include tests assessing different executive subcomponents such as the Stroop test (selective attention and inhibition) [71], Trail Making Test (set-shifting) [72], Wisconsin Card Sorting Test (set-shifting and set-maintenance) [73], and verbal fluency (strategic access to lexicon) [74]. A comprehensive assessment of executive abilities can be achieved by the use of standardised tests batteries such as the BADS or the GREFEX battery.

Few standardised tests are currently available for the specific assessment of social cognition in dementias. Among these, promising data have been reported for the SEA.

Visual-spatial abilities

Discussion of current evidence

Dementia-related visual impairment is often neglected. However, visual impairments have a profound impact upon everyday life, with previous research demonstrating that spatial perception abilities are more strongly associated with activities of daily living than episodic and verbal short-term memory [75]. Visual impairment contributes to problems as diverse as falls and poor diet, as well as to challenging behaviours, hallucinations, and delusions.

One limitation in many evaluations of cortical visual function is that assessments are limited to higher order visuoperceptual (recognition and identification of objects, faces and scenes and their features) and visuospatial (localisation of objects and representation of the spatial relationship between oneself and objects in the environment [76]) processing without consideration of the integrity of fundamental, basic visual processes supported by striate and extrastriate occipital cortex (basic form, colour, motion, and location processing). Without testing basic visual functions, it is difficult to determine whether higher-order object and space-perception deficits are attributable to parietotemporal tissue loss, or in fact result from a more fundamental de-afferentation of these areas due to occipital lobe disease. Correct attribution of deficits may be particularly important in clinical practice to understand phenomenological heterogeneity in AD or to evaluate whether there are different parietal, occipitotemporal, and primary visual subtypes of PCA [77].

Conversely, there is a need to consider the impact of cortical visual dysfunction on other domains of cognitive test performance, particularly given the number of neuropsychological assessments with visually mediated instructions, stimulus presentation, or response formats. For instance, tests of episodic memory with explicit visual demands in encoding and/or retrieval (e.g. Rey-Osterrieth figure copy) are obviously unsuitable for individuals with prominent cortical visual impairment. Similarly, a majority of tests of executive functions are partly or wholly visually mediated. Less obvious are the more implicit visual demands of tests such as verbal paired associate learning that often draw on mental imagery [78]. The clinical experience in evaluating episodic memory function in individuals with PCA suggests that two alternate forced choice recognition memory tests [79] are particularly suitable (although not necessarily sensitive).

Visuoperceptual and/or visuospatial impairments are central to the diagnostic criteria of several dementias (DLB [80] and corticobasal degeneration (CBD) [81]). However, arguably the cardinal ‘visual dementia’ is posterior cortical atrophy (PCA), a clinical-radiological syndrome primarily characterised by impaired cortical visual function with relative preservation of episodic memory and insight [82].

Currently used batteries to detect deficits in early visual processing (e.g. figure-ground discrimination) and object and space perception include the Visual Object and Space Perception battery (VOSP) [83, 84] and the Birmingham Object Recognition Battery (BORB) [85]. For a short screening the Benton Judgement of Line Orientation [86, 87] and the Rey-Osterrieth figure [8890] are commonly used.


The potential effect of basic visual deficits on performance should be taken into account for the choice of the tests to be used for clinical assessment of visual-spatial disorders. With this in mind, useful tools for the global assessment of visual-spatial abilities are represented by the VOSP and the BORB that allow the examination of the different visual-spatial components. For the purpose of a short screening, the Rey-Osterrieth figure and Benton Judgment of Line Orientation can be reliably administered.

In order to accurately choose the different sub-tests, it is quite important to take into consideration the patient’s comprehension capacity. Indeed, as discussed above, basic visual deficits could contribute to poor performance on tasks designed to evaluate higher order visual processes. This observation leads to the more general issue of test validity. For example, certain VOSP visuospatial sub-tests are better suited to individuals with moderate typical AD (instructions for the Number Location sub-test are more difficult to understand than those for the Dot Counting sub-test).

Behavioural symptoms

Discussion of current evidence

Neuropsychiatric symptoms (NPS), otherwise defined as Behavioural and Psychological Symptoms of Dementia (BPSD), are present in up to 90% of all dementias [91] and in 35–85% of MCI individuals [92]. They require assisted living or nursing facility placement and are highly clinically relevant since severe BPSD cause significant distress on caregivers, and affect quality of life and prognosis.

BPSD are heterogeneous and include the following: agitation, aberrant motor behaviour, anxiety, depression, elation, irritability, apathy, disinhibition, delusions, hallucinations, stereotypic behaviour, sleep or appetite changes, and abnormal sexual behaviour. The most frequent BPSD are apathy, depression, irritability, agitation, and anxiety. There is evidence of a stage-effect of BPSD in dementia. Affective symptoms such as depression, anxiety, and apathy would be prevalent in mild dementia. Psychotic signs such as delusions, hallucinations, elation, disturbances in motor function, and aberrant vocalisations, instead, would be more frequent in moderate to severe dementia. A recent study in a large population of individuals with AD reported five distinct neuropsychiatric syndromes. The apathetic syndrome (as a unique syndrome) was the most frequent, followed by affective syndrome (anxiety and depression), psychomotor (agitation, irritability, and aberrant motor behaviour), psychotic (delusions and hallucinations), and manic (disinhibition and euphoria) syndromes [93]. More than 75% of individuals with AD presented with one or more of the syndromes. The study supports a syndromic approach, and suggests that the clinicians need to incorporate a thorough psychiatric examination of individuals with AD. However, it is important to underline that around 50% of individuals with AD, FTD, vascular dementia (VaD), and DLB show at least four symptoms simultaneously. This makes it difficult to individualise a cluster of symptoms that may improve differential diagnosis accuracy.

The assessment of BPSD is performed by using questionnaires for patients and caregivers, focused on single or multiple signs. The Frontal Behavioural Inventory (FBI) [94] is an interesting tool for the purpose of differential diagnosis and to monitor the progression of individuals with prominent behavioural symptoms. For AD, the first behavioural rating scale was the BEHAVE-AD [95]. This scale investigates 25 behavioural symptoms and provides a rating of caregiver’s burden. Currently, one of the most widely used and reliable tools for the assessment of BPSD in dementia is the Neuropsychiatric Inventory (NPI) [96]. The NPI is a structured interview performed with the caregiver that assesses behavioural disorders belonging to 12 main categories (depression, apathy, agitation, etc.), rating their frequency, severity, and the caregiver’s distress. The NPI was shown to be sensitive to treatment effects and able to distinguish different NDD [9799]. A revised version of the NPI was recently proposed, named the Neuropsychiatric Inventory-Clinician rating scale (NPI-C) [100].


The choice of the best tool to assess BPSD in dementia should be guided by a syndromic approach. Accordingly, all BPSD should be investigated by rating their severity and frequency across the different stages of dementia that include the very early phases. When needed for an in-depth assessment of individual behavioural dimensions, specific ad-hoc scales should be used. The NPI is a reliable tool for an extensive assessment of BPSD in dementias and, thus, it is recommended. However, for the assessment of individual affective dimensions more specific tools such as the Dimension Apathy Scale [101] and The Geriatric Depression Scale (GDS-15) [102] are recommended.

Motor symptoms

Discussion of current evidence

Across European countries, not all clinicians use motor scales in their practice with persons presenting cognitive-behavioural disorders. This point is well outlined by results of a recent survey (337 responses from 33 countries; presented as a poster at the European Association of Neurology meeting in Berlin on 20–23 June 2015 by Symonds and Bak) documenting that 25% of neurologists and 70% of psychiatrists do not assess motor functions regularly. Indeed, most clinicians underestimate the frequency of motor symptoms in memory clinics (according to the above-mentioned survey, most clinicians believe that only 0–20% of patients in the cognitive clinic have motor problems, while the literature points to a much higher frequency of 30–50%).

This is problematic, since in the so-called subcortical dementias such as, for instance, dementia associated to Parkinson’s disease (PDD), supranuclear palsy (PSP), CBD, Huntington disease (HD), and VaD, motor involvement is a marker. In some cases the onset of a cognitive-motor feature can be pathognomonic, e.g. ideomotor apraxia in CBD, although it can also occur in AD [103]. Systematic studies also show that motor signs are common even in dementia with main involvement of cortical brain areas such as AD [104] and PCA [105].

The only commonly used scale to motor symptoms is the Unified Parkinson’s Disease Rating Scale (UPDRS), which has been designed specifically for Parkinson’s disease (PD) and does not cover, therefore, many phenomena which can be of importance in individuals with dementia (e.g. amyotrophic features pointing to amyotrophic lateral sclerosis (ALS)). Unfortunately, a brief motor screening tool with standard norms and validity data that are not disease-specific and could be used in a wide range of diagnoses in a memory clinic is not available. Ideally, this tool should contain items investigating areas of motor function relevant to dementias: Parkinson symptoms (PD, DLB, PSP, CBD, and multiple system atrophy (MSA)); amyotrophic features (ALS/FTD); cerebellar features (MSA, alcoholism, spinocerebellar ataxea-17, etc.); and higher order motor disorders such as praxis, motor sequencing etc. (CBD, PCA). Recently, the Dementia Apraxia Test (DATE) [106] was proposed to evaluate ideomotor apraxia which has a sensitivity of 91% and specificity of 71%, with a good capacity to discriminate between AD and individuals with FTD-behavioural variant.


A global tool that allows for the screening of motor symptoms associated with different dementias is not available. The use of the following disease-specific tools that show a good validity level is recommended: UPDRS; Unified Huntington’s Disease Rating Scale (UHDRS); Progressive Supranuclear Palsy Rating Scale (PSPRS); Unified Multiple System Atrophy Rating Scale (UMSARS); and Clinical examination according to El Escorial criteria for ALS. The development of a brief, clinically applicable and easy-to-use non-disease-specific motor screening tool should be a matter of high priority. The recently developed Edinburgh Motor Assessment (EMAS) [107] could fill the gap, but it will require collection of normative data in patients and healthy controls of different ages and a validation against the above-mentioned established motor tests. Promising data for the assessment of ideomotor apraxia were reported for the DATE that could thus represent an interesting tool to be applied for future research.

Functional abilities

Discussion of current evidence

Impairments in instrumental activities of daily living (IADL) influence everyday lives of patients and caregivers, and are essential for the planning of care needs and for legal and financial matters. As such, functional assessment provides highly ecologically valid information. In clinical practice, an important objective of functional assessment is its ability to detect the impact of cognitive impairment on everyday functioning, as this is an important diagnostic criterion for dementia [6]. Additionally, the distinction between MCI and dementia is characterised by the absence of IADL impairments in the former, and presence of IADL impairments in the latter [108]. The assessment of everyday functioning is therefore crucial both in clinical practice and research studies. Several longitudinal studies have demonstrated that IADL measures in the healthy elderly are related to incident dementia, indicating that subtle impairment in IADL might occur earlier in the disease course [109]. These findings underline the relevance of a functional assessment for the early diagnosis of dementia [110]. IADL assessment is also relevant for the measurement of change over time. In particular, in clinical trials, IADL is an outcome measure required by the Food and Drug Administration to demonstrate clinically relevant changes [111].

There is an abundance of IADL instruments, ranging from self-report questionnaires and informant-based questionnaires to performance-based instruments [112]. Different measurement methods serve different purposes [113], with questionnaires completed by the informant or study partner being the most common assessment method. When focusing on validity there are large differences in the content between different instruments. Instruments combining IADL and basic activities of daily living (BADL) into a single instrument are less sensitive to cognitive impairments and this might lead to an under-estimation of functional impairment [113]. Within the measurement of IADL, instruments also vary as to whether they focus on cognitive aspects of each activity or target IADL performance. In a systematic review, in which quality aspects and psychometric properties of IADL instruments were rated on a predefined scale, it was demonstrated that IADL instruments lacked relevant information on face validity, reliability, content, and construct validity [112]. Other systematic reviews supported this notion that psychometric aspects and quality aspects received limited attention from IADL instrument developers [114]. These limitations currently hamper the adequate measurement of IADL. Most IADL questionnaires, in particular the informant-based questionnaires, pose a low level of burden to individuals with dementia and their relatives and are therefore highly feasible. Performance-based IADL instruments, on the other hand, might be more burdensome due to time requirements.

The Lawton IADL scale [115] is one of the most used and referenced traditional tools to assess instrumental abilities in the elderly such as financial management and telephone use. Although a good reliability for this scale was reported, with Cronbach’s alpha up to 0.94 [116], it suffers from several of the limitations reported above. Innovation of IADL was addressed in the development of the Amsterdam IADL questionnaire [117]. It consists of 70 activities, based on input from professionals, researchers, and caregivers, ensuring face and content validity. Modern psychometric approaches (item response theory) are applied for the scoring of the questionnaire, enabling scoring of different activities for different individuals on the same metric. In a longitudinal construct validation study, the Amsterdam IADL questionnaire was found to be sensitive to changes over time, supporting its usefulness for longitudinal studies [118].


Quality limitations hamper functional assessment. Although further research is needed to investigate quality aspects of IADL instruments, promising results have been found for several questionnaires, including the Everyday Cognition (ECog) [119], and the Cognitive Function Instrument (CFI) [120], and the Amsterdam IADL questionnaire. Therefore, the use of these tools is recommended for research purposes.

General discussion

One main point highlighted by the project is the heterogeneity of the tests used for the assessment of the manifold aspects of clinical manifestations of dementing conditions. Various factors account for this heterogeneity, such as the preference for home-made tests, the weight of local traditions, and the context of assessment (e.g. GP practice, memory clinic, specialist clinic, or a research centre) that is related to the use of different tools according to the specific aim of assessment. In this regard, one important related issue is the “overall data fragmentation” that arises from the use of tests with different psychometric properties. This does not permit the merging of data from different centres and it makes it difficult to compare published data.

The latter observation is directly related to the second main issue of the project, i.e. the difficulty to individualise tools with adequate levels of information about psychometric properties. In the case of AD, for example, Logie et al. [121] recently emphasised that the ideal specific cognitive marker should not be affected by healthy ageing, literacy level, test/re-test, and floor effects. Moreover, it should be sensitive and specific to very early AD manifestations, be useable in primary care, non-invasive, quick to administer, and sensitive to daily living impairments. Similar considerations may be applied to other NDD.

Indeed, the working group evidenced a general issue that, across the different individual dimensions examined here, refers to the importance of paying attention to some crucial psychometric properties that neuropsychological tests should ideally fulfil. As shown in Table 2, one main point is represented by validity (i.e. “does a test measure what it is intended for?”). Content and construct validity should be well established. Moreover, test administration should follow procedures that were adopted in collecting normative data (e.g. tests for which standardisation was individually achieved are often administered within extensive neuropsychological batteries). Reliability (test/re-test and inter-rater reliability) and feasibility are other crucial prerequisites for test administration. Indeed, although, for instance, the invasiveness of the test (in terms of the discomfort caused to the patient) could affect patient performance, the issue of feasibility is often underestimated.

Table 2 Recommendations for test development

A related crucial issue is represented by the absence of good quality normative data (i.e. appropriate age groups and education levels) for many neuropsychological tools. In view of socio-cultural changes that occur in populations over time, a related issue refers to the need to periodically update the normative data of psychological tests. Moreover, many of the tests used in clinical settings were developed several decades ago, often in fields other than NDD (developmental disorders or stroke). There is a danger of over-simplification in applying this knowledge to NDD, where patterns of neuronal loss are often incompletely understood and by far more complex than the focal lesion models. These observations suggest particular caution in comparing data from studies using different tools with relatively dated normative references.

In conclusion, it is at the moment impossible to individualise reliable and feasible protocols and tools common to European research centres working in the field of NDD. The panel recommended psychometric tests that should be used with the aim of harmonising neuropsychological research (Table 1) according to a two-fold strategy. A first step to be followed is the achievement of a minimal data set on the proposed tools in order to reach two milestones: updated normative data and updated validity data. A second step could be the building of a common database by sharing collected data following a “big data approach”. In order to link data from different cohorts, z scores for every test should be made available. For instance, to improve research in multicentre studies, z scores based on normative data of cognitively normal subjects could be calculated [122]. These z scores could be pooled across different cognitive measures also allowing the computation of related composite scores. In this regard, the working group agrees on the opportunity to correctly identify tests taking into account a two-step model. First, tests to be applied for short global screening of cognitive abilities that are used to achieve general evaluation on the subject’s mental functioning, allowing the diagnosis of cognitive impairment. Second, tests with high predictive value should be recommended for the diagnosis in the very early stages of NDD, and a set of tests to be used for the purpose of differential diagnosis through the assessment of the neuropsychological profile needs to be defined.


This project allowed us to identify some key points to improve clinical research in the field of dementias. Sets of indications are given to harmonise tools and procedures to achieve more reliable data on the cognitive-behavioural examination. In this regard, the results of this study should be considered as a starting point to enhance a common view and practice on NDD assessment across European countries.

As it is clear from the above discussion, the possibility to provide firm recommendations to improve neuropsychological research in dementia syndromes suffers from the current limitations of the tools and procedures available. Nevertheless, an agreement was achieved on a list of the most adequate tools and procedures to be used for each target area according to the available evidence (see Table 1). Here, we also identified un-met needs for each specific domain (see Table 1) and practical requirements of the current methods and tools of assessment, based on existing evidence and project participants’ expertise and clinical practice. In this regard, the consortium points out one clear indication on the usefulness to focus further research on those instruments that reveal potentially adequate psychometric properties for the early assessment and differential diagnosis in NDD.

The enormous progress of cognitive neurosciences in the last decades, resulting in novel, translational relevant information about the organisation of cognitive functions in the normal brain, has been exploited only to a very limited extent in proposing new measures with increased sensitivity and specificity to early stages of neurodegenerative diseases. In this vein, the need for harmonisation of tools and procedures should not hamper the possibility to implement innovative ideas. New proposals should be shared among the scientific community to explore the possibility of large-scale validation and standardisation studies at the European level.



Aachener Aphasie Test


Addenbrooke’s Cognitive Examination


Alzheimer’s disease


Alzheimer’s Disease Assessment Scale-Cognition


Basic activities of daily living


Amyotrophic lateral sclerosis


Amsterdam-Nijmegen Everyday Language Test


basic activities of daily living


Behavioral Assessment of Dysexecutive Syndrome


Boston Diagnostic Aphasia Examination


Birmingham Object Recognition Battery


Behavioural and Psychological Symptoms of Dementia


Cambridge Cognitive Assessment-Revised


Corticobasal degeneration


Cognitive Function Instrument


Dementia Apraxia Test


Dementia with Lewy bodies


Everyday Cognition


Edinburgh Motor Assessment


Frontal Assessment Battery


Frontal Behavioural Inventory


Free and Cued Selective Reminding Test


Frontotemporal dementia


Geriatric Depression Scale


Huntington disease


Instrumental activities of daily living


Institute of Cognitive Neurology


Inventaire du Syndrome Dysexécutif Comportemental


Joint Program for Neurodegenerative Diseases


Mild cognitive impairment


Mattis Dementia Rating Scale


Mini Mental State Examination


Montreal Cognitive Assessment


Multiple system atrophy


National Adult Reading Test


Northwestern Anagram Test


Neurodegenerative dementias


Neuropsychiatric Inventory


Neuropsychiatric Inventory-Clinician


Neuropsychiatric symptoms


Posterior cortical atrophy


Parkinson’s disease


Parkinson’s disease dementia


Primary progressive aphasia


Supranuclear palsy


Progressive Supranuclear Palsy Rating Scale


Social and Emotional Assessment battery


Sydney Language Battery


Theory of mind


Test for the reception of grammar


Unified Huntington’s Disease Rating Scale


Unified Multiple System Atrophy Rating Scale


Unified Parkinson’s Disease Rating Scale


Vascular dementia


Visual Object and Space Perception battery


Western Aphasia Battery


Working Group


  1. Daffner KR, Gale SA, Barrett AM, Boeve BF, Chatterjee A, Coslett HB, et al. Improving clinical cognitive testing: report of the AAN Behavioral Neurology Section Workgroup. Neurology. 2015;85:910–8. doi:10.1212/WNL.0000000000001763.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Wilcock GK, Hope RA, Brooks DN, Lantos PL, Oppenheimer C, Reynolds GP, et al. Recommended minimum data to be collected in research studies on Alzheimer’s disease. The MRC (UK) Alzheimer’s Disease Workshop Steering Committee. J Neurol Neurosurg Psychiatry. 1989;52:693–700.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  3. Hachinski V, Iadecola C, Petersen RC, Breteler MM, Nyenhuis DL, Black SE, et al. National Institute of Neurological Disorders and Stroke-Canadian Stroke Network vascular cognitive impairment harmonization standards. Stroke. 2006;37:2220–41.

    Article  PubMed  Google Scholar 

  4. Diaz PR, Gregório GP, Ribera Casado M, Reynish E, Ousset JP, Vellas B, et al. The need for a consensus in the use of assessment tools for Alzheimer’s disease: the Feasibility Study (assessment tools for dementia in Alzheimer Centres across Europe), a European Alzheimer’s Disease Consortium’s (EADC) survey. Int J Geriatr Psychiatry. 2005;20:744–8.

    Article  Google Scholar 

  5. Maruta C, Guerreiro M, de Mendonça A, Hort J, Scheltens P. The use of neuropsychological tests across Europe: the need for a consensus in the use of assessment tools for dementia. Eur J Neurol. 2011;18:279–85.

    Article  CAS  PubMed  Google Scholar 

  6. Dubois B, Feldman HH, Jacova C, Hampel H, Molinuevo JL, Blennow K, et al. Advancing research diagnostic criteria for Alzheimer’s disease: the IWG-2 criteria. Lancet Neurol. 2014;13:614–29. Erratum in: Lancet Neurol. 2014;13:757.

    Article  PubMed  Google Scholar 

  7. McKhann GM, Knopman DS, Chertkow H, Hyman BT, Jack Jr CR, Kawas CH, et al. The diagnosis of dementia due to Alzheimer’s disease: recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimer’s Dement. 2011;7:263–9.

    Article  Google Scholar 

  8. Crutch SJ, Schott JM, Rabinovici GD, Boeve BF, Cappa SF, Dickerson BC, et al. Shining a light on posterior cortical atrophy. Alzheimers Dement. 2013;9:463–5.

    Article  PubMed  Google Scholar 

  9. Rascovsky K, Hodges JR, Knopman D, Mendez MF, Kramer JH, Neuhaus J, et al. Sensitivity of revised diagnostic criteria for the behavioural variant of frontotemporal dementia. Brain. 2011;134:2456–77.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Gorno-Tempini ML, Hillis AE, Weintraub S, Kertesz A, Mendez M, Cappa SF, et al. Classification of primary progressive aphasia and its variants. Neurology. 2011;76:1006–14.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Folstein MF, Folstein SE, McHugh PR. “Mini Mental State” a practical method for grading the cognitive state of patients for the clinicians. J Psychiat Res. 1975;12:189–19.

    Article  CAS  PubMed  Google Scholar 

  12. Marioni RE, Chatfield M, Brayne C, Matthews FE, Medical Research Council Cognitive Function and Ageing Study Group. The reliability of assigning individuals to cognitive states using the Mini Mental-State Examination: a population-based prospective cohort study. BMC Med Res Methodol. 2011;11:127. doi:10.1186/1471-2288-11-127.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Mitolo M, Salmon DP, Gardini S, Galasko D, Grossi E, Caffarra P. The New Qualitative Scoring MMSE Pentagon Test (QSPT) as a valid screening tool between autopsy-confirmed dementia with Lewy bodies and Alzheimer’s disease. J Alzheimers Dis. 2014;39(4):823–32. doi:10.3233/JAD-131403.

    PubMed  PubMed Central  Google Scholar 

  14. Nieuwenhuis-Mark RE. The death knoll for the MMSE: has it outlived its purpose? J Geriatr Psychiatry Neurol. 2010;23:151–7. doi:10.1177/0891988710363714.

    Article  PubMed  Google Scholar 

  15. Nasreddine ZS, Phillips NA, Bédirian V, Charbonneau S, Whitehead V, Collin I, et al. The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005;53:695–9.

    Article  PubMed  Google Scholar 

  16. Freitas S, Simões MR, Alves L, Santana I. Montreal cognitive assessment: validation study for mild cognitive impairment and Alzheimer disease. Alzheimer Dis Assoc Disord. 2013;27:37–43. doi:10.1097/WAD.0b013e3182420bfe.

    Article  PubMed  Google Scholar 

  17. Dubois B, Slachevsky A, Litvan I, Pillon BF. The FAB—a frontal assessment battery at bedside. Neurology. 2000;55:1621–6.

    Article  CAS  PubMed  Google Scholar 

  18. Castiglioni S, Pelati O, Zuffi M, Somalvico F, Marino L, Tentorio T, et al. The frontal assessment battery does not differentiate frontotemporal dementia from Alzheimer’s disease. Dement Geriatr Cogn Disord. 2006;22:125–31.

    Article  PubMed  Google Scholar 

  19. Lipton AM, Ohman KA, Womack KB, Hynan LS, Ninman ET, Lacritz LH. Subscores of the FAB differentiate frontotemporal lobar degeneration from AD. Neurology. 2005;65:726–31.

    Article  CAS  PubMed  Google Scholar 

  20. Doraiswamy PM, Krishen A, Stallone F, Martin WL, Potts NL, Metz A, et al. Cognitive performance on the Alzheimer’s Disease Assessment Scale: effect of education. Neurology. 1995;45:1980–4.

    Article  CAS  PubMed  Google Scholar 

  21. Verhey FR, Huppert FA, Korten EC, Houx P, de Vugt M, van Lang N, et al. Cross-national comparisons of the Cambridge Cognitive Examination-revised: the CAMCOG-R: results from the European Harmonization Project for Instruments in Dementia. Age Ageing. 2003;32:534–40.

    Article  PubMed  Google Scholar 

  22. Mioshi E, Dawson K, Mitchell J, Arnold R, Hodges JR. The Addenbrooke’s Cognitive Examination Revised (ACE‐R): a brief cognitive test battery for dementia screening. Int J Geriatr Psychiatry. 2006;21:1078–85.

    Article  PubMed  Google Scholar 

  23. Rittman T, Ghosh BC, McColgan P, Breen DP, Evans J, Williams-Gray CH, et al. The Addenbrooke’s Cognitive Examination for the differential diagnosis and longitudinal assessment of patients with parkinsonian disorders. J Neurol Neurosurg Psychiatry. 2013;84:544–51.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Schmidt R, Freidl W, Fazekas F, Reinhart B, Grieshofer P, Koch M, et al. The Mattis Dementia Rating Scale. Normative data from 1,001 healthy volunteers. Neurology. 1994;44:964–6.

    Article  CAS  PubMed  Google Scholar 

  25. Pirogovsky E, Schiehser DM, Litvan I, Obtera KM, Burke MM, Lessig SL, et al. The utility of the Mattis Dementia Rating Scale in Parkinson’s disease mild cognitive impairment. Parkinsonism Relat Disord. 2014;20:627–31.

    Article  PubMed  Google Scholar 

  26. Borson S, Scanlan J, Brush M, Vitaliano P, Dokmak A. The mini-cog: a cognitive “vital signs” measure for dementia screening in multi-lingual elderly. Int J Geriatr Psychiatry. 2000;15:1021–7.

    Article  CAS  PubMed  Google Scholar 

  27. Lowndes GJ, Saling MM, Ames D, Chiu E, Gonzalez LM, Savage GR. Recall and recognition of verbal paired associates in early Alzheimer’s disease. J Int Neuropsychol Soc. 2008;14:591–600.

    Article  CAS  PubMed  Google Scholar 

  28. Savage RM, Gouvier WD. Rey Auditory-Verbal Learning Test: the effects of age and gender, and norms for delayed recall and story recognition trials. Arch Clin Neuropsychol. 1992;7:407–14.

    Article  CAS  PubMed  Google Scholar 

  29. Dubois B, Touchon J, Portet F, Ousset PJ, Vellas B, Michel B. “The 5 words”: a simple and sensitive test for the diagnosis of Alzheimer’s disease. Presse Med. 2002;31:1696–9.

    CAS  PubMed  Google Scholar 

  30. Grober E, Sanders AE, Hall C, Lipton RB. Free and cued selective reminding identifies very mild dementia in primary care. Alzheimer Dis Assoc Disord. 2010;24:284–90.

    PubMed  PubMed Central  Google Scholar 

  31. Wagner M, Wolf S, Reischies FM, Daerr M, Wolfsgruber S, Jessen F, et al. Biomarker validation of a cued recall memory deficit in prodromal Alzheimer disease. Neurology. 2012;78:379–86.

    Article  CAS  PubMed  Google Scholar 

  32. Barbeau E, Didic M, Tramoni E, Felician O, Joubert S, Sontheimer A, et al. Evaluation of visual recognition memory in MCI patients. Neurology. 2004;62:1317–22.

    Article  CAS  PubMed  Google Scholar 

  33. Parra MA, Abrahams S, Fabi K, Logie R, Luzzi S, Della SS. Short-term memory binding deficits in Alzheimer’s disease. Brain. 2009;132:1057–66.

    Article  PubMed  Google Scholar 

  34. Della Sala S, Parra MA, Fabi K, Luzzi S, Abrahams S. Short-term memory binding is impaired in AD but not in non-AD dementias. Neuropsychologia. 2012;50:833–40.

    Article  PubMed  Google Scholar 

  35. Papageorgiou SG, Economou A, Routsis C. The 5 Objects Test: a novel, minimal-language, memory screening test. J Neurol. 2014;261:422–31.

    Article  PubMed  Google Scholar 

  36. Costa A, Fadda L, Perri R, Brisindi M, Lombardi MG, Caltagirone C, et al. Sensitivity of a time-based prospective memory procedure in the assessment of amnestic mild cognitive impairment. J Alzheimers Dis. 2015;44:63–7.

    PubMed  Google Scholar 

  37. Masur DM, Sliwinski M, Lipton RB, Blau AD, Crystal HA. Neuropsychological prediction of dementia and the absence of dementia in healthy elderly persons. Neurology. 1994;44:1427–32.

    Article  CAS  PubMed  Google Scholar 

  38. Locascio JJ, Growdon JH, Corkin S. Cognitive test performance in detecting, staging, and tracking Alzheimer’s disease. Arch Neurol. 1995;52:1087–99.

    Article  CAS  PubMed  Google Scholar 

  39. Kaplan E, Goodglass H, Weintraub S. Boston Naming Test. Philadelphia: Lee & Febiger; 1983.

    Google Scholar 

  40. Katsumata Y, Mathews M, Abner EL, Jicha GA, Caban-Holt A, Smith CD, et al. Assessing the discriminant ability, reliability, and comparability of multiple short forms of the Boston Naming Test in an Alzheimer’s disease center cohort. Dement Geriatr Cogn Disord. 2015;39:215–27. doi:10.1159/000370108.

    Article  PubMed  PubMed Central  Google Scholar 

  41. McKenna P, Warrington EK. Testing for nominal dysphasia. J Neurol Neurosurg Psychiatry. 1980;43:781–8.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  42. Huber W. Aachener aphasie test (AAT). Verlag für Psychologie: Dr. CJ Hogrefe: 1983

  43. De Jager CA, Hogervorst E, Combrinck M, Budge MM. Sensitivity and specificity of neuropsychological tests for mild cognitive impairment, vascular cognitive impairment and Alzheimer’s disease. Psychol Med. 2003;33:1039–50.

    Article  PubMed  Google Scholar 

  44. Brambati SM, Myers D, Wilson A, Rankin KP, Allison SC, Rosen HJ, et al. The anatomy of category-specific object naming in neurodegenerative diseases. J Cogn Neurosci. 2006;18:1644–53.

    Article  CAS  PubMed  Google Scholar 

  45. Stuss DT, Alexander MP, Hamer L, Palumbo C, Dempster R, Binns M, et al. The effects of focal anterior and posterior brain lesions on verbal fluency. J Int Neuropsychol Soc. 1998;4:265–78.

    CAS  PubMed  Google Scholar 

  46. Howard D, Patterson KE. The Pyramids and Palm Trees Test: a test of semantic access from words and pictures. England: Thames Valley Test Company; 1992.

  47. Bozeat S, Lambon Ralph MA, Patterson K, Garrard P, Hodges JR. Non-verbal semantic impairment in semantic dementia. Neuropsychologia. 2000;38:1207–15.

    Article  CAS  PubMed  Google Scholar 

  48. Wilson SM, Henry ML, Besbris M, Ogar JM, Dronkers NF, Jarrold W, et al. Connected speech production in three variants of primary progressive aphasia. Brain. 2010;133:2069–88.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Weintraub S, Mesulam MM, Wieneke C, Rademaker A, Rogalski EJ, Thompson CK. The northwestern anagram test: measuring sentence production in primary progressive aphasia. Am J Alzheimers Dis Other Demen. 2009;24:408–16. doi:10.1177/1533317509343104.

    Article  PubMed  PubMed Central  Google Scholar 

  50. De Renzi E, Vignolo LA. The Token Test: a sensitive test to detect receptive disturbances in aphasics. Brain. 1962;85:665–78.

    Article  Google Scholar 

  51. Bishop DVM. Comprehension of English syntax by profoundly deaf children. J Child Psychol Psychiatry. 1983;24:415–34.

    Article  CAS  PubMed  Google Scholar 

  52. Curtiss S. Curtiss–Yamada comprehensive language evaluation. Unpublished test, Los Angeles: UCLA; 1988.

  53. Nelson HE, Willison J. The Nelson Adult Reading Test (NART): test manual. Windsor, England: NFER Nelson; 1991.

    Google Scholar 

  54. Adlam AL, Patterson K, Bozeat S, Hodges JR. The Cambridge Semantic Memory Test Battery: detection of semantic deficits in semantic dementia and Alzheimer’s disease. Neurocase. 2010;16:193–207.

    Article  PubMed  Google Scholar 

  55. Savage S, Hsieh S, Leslie F, Foxe D, Piguet O, Hodges JR. Distinguishing subtypes in primary progressive aphasia: application of the Sydney language battery. Dement Geriatr Cogn Dis. 2013;35:208–18.

    Article  Google Scholar 

  56. Blomert L, Kean M, Koster C, Schokker J. Amsterdam—Nijmegen everyday language test: construction, reliability and validity. Aphasiology. 1994;8:381–407.

    Article  Google Scholar 

  57. Chan RC, Shum D, Toulopoulou T, Chen EY. Assessment of executive functions: review of instruments and identification of critical issues. Arch Clin Neuropsychol. 2008;23:201–16.

    Article  PubMed  Google Scholar 

  58. Torralva T, Cuitino MM, Manes F. Neuropsychological assessment of frontotemporal dementia. In: Dickerson BC, editor. Hodges’ frontotemporal dementia. Cambridge: Cambridge University Press; 2016. p. 55.

    Google Scholar 

  59. Stopford CL, Thompson JC, Neary D, Richardson AMT, Snowden JS. Working memory, attention and executive function in Alzheimer’s disease and frontotemporal dementia. Cortex. 2012;48:429–46.

    Article  PubMed  Google Scholar 

  60. Collette F, Schmidt C, Scherrer C, Adam S, Salmon E. Specificity of inhibitory deficits in normal aging and Alzheimer’s disease. Neurobiol Aging. 2009;30:875–89.

    Article  CAS  PubMed  Google Scholar 

  61. Collette F, Amieva H, Adam S, Hogge M, Van der Linden M, Fabrigoule C, et al. Comparison of inhibitory functioning in mild Alzheimer’s disease and frontotemporal dementia. Cortex. 2007;43:866–74.

    Article  PubMed  Google Scholar 

  62. Lagarde J, Valabrègue R, Corvol JC, Garcin B, Volle E, Le Ber I, et al. Why do patients with neurodegenerative frontal syndrome fail to answer: ‘in what way are an orange and a banana alike?’. Brain. 2015;138:456–71.

    Article  PubMed  Google Scholar 

  63. Burgess PW, Alderman N, Evans J, Emslie H, Wilson BA. The ecological validity of tests of executive functions. J Int Neuropsychol Soc. 1998;4:547–58.

    Article  CAS  PubMed  Google Scholar 

  64. Torralva T, Roca M, Gleichgerrcht E, Bekinschtein T, Manes F. A neuropsychological battery to detect specific executive and social cognitive impairments in early frontotemporal dementia. Brain. 2009;132:1299–309.

    Article  PubMed  Google Scholar 

  65. Godefroy O, GREFEX. Fonctions exécutives et pathologies neurologiques et psychiatriques. Evaluation en pratique clinique. Marseille: Solal; 2008.

    Google Scholar 

  66. Wilson BA, Evans JJ, Emslie H, Alderman N, Burgess P. The development of an ecologically valid test for assessing patients with a dysexecutive syndrome. Neuropsychol Rehabil. 1998;8:213–28.

    Article  Google Scholar 

  67. Ekman P, Friesen WV, Ellsworth P. Emotion in the human face. New York: Pergamon; 1972.

    Google Scholar 

  68. Bechara A, Tranel D, Damasio H. Characterization of the decision-making deficit of patients with ventromedial prefrontal cortex lesions. Brain. 2000;123:2189–202.

    Article  PubMed  Google Scholar 

  69. Bertoux M, Funkiewiez A, O’Callaghan C, Dubois B, Hornberger M. Sensitivity and specificity of ventromedial prefrontal cortex tests in behavioral variant frontotemporal dementia. Alzheimer’s Dement. 2013;9:S84–94.

    Article  Google Scholar 

  70. Bertoux M, Volle E, de Souza LC, Funkiewiez A, Dubois B, Habert MO. Neural correlates of the mini-SEA (Social cognition and Emotional Assessment) in behavioral variant frontotemporal dementia. Brain Imaging Behav. 2014;8:1–6.

    Article  CAS  PubMed  Google Scholar 

  71. Hutchison KA, Balota DA, Duchek JM. The utility of Stroop Task switching as a marker for early stage Alzheimer’s disease. Psychol Aging. 2010;25:545–59.

    Article  PubMed  PubMed Central  Google Scholar 

  72. Reitan R. Trail-making test. Arizona: Reitan Neuropsychology Laboratory; 1970.

    Google Scholar 

  73. Heaton RK, Chelune GJ, Talley JL, Kay GG, Curtiss G. Wisconsin Card Sorting Test Manual: revised and expanded. Odessa, FL: Psychological Assessment Resources; 1993.

    Google Scholar 

  74. Henry JD, Crawford JR, Phillips LH. Verbal fluency performance in dementia of the Alzheimer’s type: a meta-analysis. Neuropsychologia. 2004;2:1212–22.

    Article  Google Scholar 

  75. Shakespeare TJ, Yong KX, Foxe D, Hodges J, Crutch SJ. Pronounced impairment of everyday skills and self-care in posterior cortical atrophy. J Alzheimers Dis. 2015;43:381–4. doi:10.3233/JAD-141071.

    CAS  PubMed  Google Scholar 

  76. Goodale MA, Milner AD. Separate visual pathways for perception and action. Trends Neurosci. 1992;15:20–5.

    Article  CAS  PubMed  Google Scholar 

  77. Lehmann M, Barnes J, Ridgway GR, Wattam-Bell J, Warrington EK, Fox NC, et al. Basic visual function and cortical thickness patterns in posterior cortical atrophy. Cereb Cortex. 2011;212122-32. doi: 10.1093/cercor/bhq287

  78. Twum M, Parenté R. Role of imagery and verbal labeling in the performance of paired associates tasks by persons with closed head injury. J Clin Exp Neuropsychol. 1994;16:630–9.

    Article  CAS  PubMed  Google Scholar 

  79. Warrington EK. Studies of retrograde memory: a long-term view. Proc Natl Acad Sci U S A. 1996;93:13523–6.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  80. McKeith IG, Dickson DW, Lowe J, Emre M, O’Brien JT, Feldman H, et al. Diagnosis and management of dementia with Lewy bodies: third report of the DLB Consortium. Neurology. 2005;65:1863–72. Erratum in: Neurology. 2005; 65;1992.

    Article  CAS  PubMed  Google Scholar 

  81. Mathew R, Bak TH, Hodges JR. Diagnostic criteria for corticobasal syndrome: a comparative study. J Neurol Neurosurg Psychiatry. 2012;83:405–10.

    Article  PubMed  Google Scholar 

  82. Crutch SJ, Lehmann M, Schott JM, Rabinovici GD, Rossor MN, Fox NC. Posterior cortical atrophy. Lancet Neurol. 2012;11:170–8.

    Article  PubMed  PubMed Central  Google Scholar 

  83. Warrington EK, James M. A new test of object decision: 2D silhouettes featuring a minimal view. Cortex. 1991;27:370–83.

    Article  CAS  PubMed  Google Scholar 

  84. Quental NB, Brucki SM, Bueno OF. Visuospatial function in early Alzheimer’s disease—the use of the Visual Object and Space Perception (VOSP) battery. PLoS One. 2013;8:e68398. doi:10.1371/journal.pone.0068398.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  85. Riddoch MJ, Humphreys GW. The Birmingham Object Recognition Battery (BORB). London: Erlbaum; 1993.

    Google Scholar 

  86. Benton AL, Varney NR, Hamsher KS. Visuospatial judgment: a clinical test. Arch Neurol. 1978;35:364–7.

    Article  CAS  PubMed  Google Scholar 

  87. Simard M, van Reekum R, Myran D. Visuospatial impairment in dementia with Lewy bodies and Alzheimer’s disease: a process analysis approach. Int J Geriatr Psychiatry. 2003;18:387–91.

    Article  PubMed  Google Scholar 

  88. Osterrieth PA. Le test de copie d’une figure complex: contribution à l’étude de la perception et de la memoir. Arch Psychol. 1944;30:286–356.

    Google Scholar 

  89. Siri S, Benaglio I, Frigerio A, Binetti G, Cappa SF. A brief neuropsychological assessment for the differential diagnosis between frontotemporal dementiaand Alzheimer’s disease. Eur J Neurol. 2001;8:125–32.

    Article  CAS  PubMed  Google Scholar 

  90. Possin KL, Laluz VR, Alcantar OZ, Miller BL, Kramer JH. Distinct neuroanatomical substrates and cognitive mechanisms of figure copy performance in Alzheimer’s disease and behavioral variant frontotemporal dementia. Neuropsychologia. 2011;49:43–8. doi:10.1016/j.neuropsychologia.2010.10.026.

    Article  PubMed  Google Scholar 

  91. Cerejeira J, Lagarto L, Mukaetova-Ladinska EB. Behavioral and psychological symptoms of dementia. Front Neurol. 2012. doi:10.3389/fneur.2012.00073.

    PubMed  PubMed Central  Google Scholar 

  92. Monastero R, Mangialasche F, Camarda C, Ercolani S, Camarda R. A systematic review of neuropsychiatric symptoms in mild cognitive impairment. J Alzheimers Dis. 2009;18:11–30.

    Article  PubMed  Google Scholar 

  93. Spalletta G, Musicco M, Padovani A, Rozzini L, Perri R, Fadda L, et al. Neuropsychiatric symptoms and syndromes in a large cohort of newly diagnosed, untreated patients with Alzheimer. Am J Geriatr Psychiatry. 2010;18:1026–35. doi:10.1097/JGP.0b013e3181d6b68d.

    Article  PubMed  Google Scholar 

  94. Kertesz A, Davidson W, Fox H. Frontal Behavioral Inventory: diagnostic criteria for frontal lobe dementia. Can J Neurol Sci. 1997;24:29–36.

    Article  CAS  PubMed  Google Scholar 

  95. Reisberg B, Borenstein J, Salob SP, Ferris SH, Franssen E, Georgotas A. Behavioral symptoms in Alzheimer’s disease: phenomenology and treatment. J Clin Psychiatry. 1987;48 suppl 5:9–1.

    PubMed  Google Scholar 

  96. Cummings JL. The Neuropsychiatric Inventory: assessing psychopathology in dementia patients. Neurology. 1997;48 suppl 6:10–6.

    Article  Google Scholar 

  97. Suárez-González A, Serrano-Pozo A, Arroyo-Anlló EM, Franco-Macías E, Polo J, García-Solís D, et al. Utility of neuropsychiatric tools in the differential diagnosis of dementia with Lewy bodies and Alzheimer’s disease: quantitative and qualitative findings. Int Psychogeriatr. 2014;26:453–61. doi:10.1017/S1041610213002068.

    Article  PubMed  Google Scholar 

  98. Rosenberg PB, Drye LT, Porsteinsson AP, Pollock BG, Devanand DP, Frangakis C, et al. Change in agitation in Alzheimer’s disease in the placebo arm of a nine-week controlled trial. Int Psychogeriatr. 2015;27:2059–67. doi:10.1017/S1041610215001106.

    Article  PubMed  PubMed Central  Google Scholar 

  99. Atri A, Hendrix SB, Pejović V, Hofbauer RK, Edwards J, Molinuevo JL, Graham SM. Cumulative, additive benefits of memantine-donepezil combination over component monotherapies in moderate to severe Alzheimer’s dementia: a pooled area under the curve analysis. Alzheimers Res Ther. 2015;7:28. doi:10.1186/s13195-015-0109-2.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  100. De Medeiros K, Robert P, Gauthier S, Stella F, Politis A, Leoutsakos J, et al. The Neuropsychiatric Inventory-Clinician rating scale (NPI-C): reliability and validity of a revised assessment of neuropsychiatric symptoms in dementia. Int Psychogeriatr. 2010;22:984–94.

    Article  PubMed  PubMed Central  Google Scholar 

  101. Radakovic R, Abrahams S. Developing a new apathy measurement scale: Dimensional Apathy Scale. Psychiatry Res. 2014;219:658–63. doi:10.1016/j.psychres.2014.06.010.

    Article  PubMed  Google Scholar 

  102. Yesavage JA, Brink TL, Rose TL, Lum O, Huang V, Adey MB, et al. Development and validation of a geriatric depression screening scale: a preliminary report. J Psychiat Res. 1983;17:37–49.

    Article  CAS  Google Scholar 

  103. Lesourd M, Le Gall D, Baumard J, Croisile B, Jarry C, Osiurak F. Apraxia and Alzheimer’s disease: review and perspectives. Neuropsychol Rev. 2013;23:234–56. doi:10.1007/s11065-013-9235-4.

    Article  PubMed  Google Scholar 

  104. Scarmeas N, Hadjigeorgiou GM, Papadimitriou A, Dubois B, Sarazin M, Brandt J, et al. Motor signs during the course of Alzheimer disease. Neurology. 2004;28(63):975–82.

    Article  Google Scholar 

  105. Ryan NS, Shakespeare TJ, Lehmann M, Keihaninejad S, Nicholas JM, Leung KK, et al. Motor features in posterior cortical atrophy and their imaging correlates. Neurobiol Aging. 2014;35:2845–57. doi:10.1016/j.neurobiolaging.2014.05.028.

    Article  PubMed  PubMed Central  Google Scholar 

  106. Johnen A, Frommeyer J, Modes F, Wiendl H, Duning T, Lohmann H. Dementia Apraxia Test (DATE): a brief tool to differentiate behavioral variant frontotemporal dementia from Alzheimer’s. J Alzheimers Dis. 2015;49:593–605. doi:10.3233/JAD-150447.

    Article  Google Scholar 

  107. Bak T, Bennett G, Symonds A, PAI S. Motor symptoms in healthy ageing and dementia: frequency, patterns and the relation between motor and cognitive functions. Eur J Neurol. 2015;2 Suppl 1:94.

    Google Scholar 

  108. Petersen R, Doody R, Kurz A, Mohs R, Morris J, Rabins P, et al. Current concepts in mild cognitive impairment. Arch Neurol. 2001;58:1985–92.

    Article  CAS  PubMed  Google Scholar 

  109. Sikkes SAM, Visser PJ, Knol DL, de Lange-de Klerk ESM, Tsolaki M, Frisoni GB, et al. Do instrumental activities of daily living predict dementia at 1- and 2-year follow-up? Findings from the Development of Screening guidelines and diagnostic Criteria for Predementia Alzheimer’s disease study. J Am Geriatr Soc. 2011;59:2273–81.

    Article  PubMed  Google Scholar 

  110. Jekel K, Damian M, Wattmo C, Hausner L, Bullock R, Connelly PJ, et al. Mild cognitive impairment and deficits in instrumental activities of daily living: a systematic review. Alzheimers Res Ther. 2015;7:17.

    Article  PubMed  PubMed Central  Google Scholar 

  111. Desai AK, Grossberg GT, Sheth DN. Activities of daily living in patients with dementia: clinical relevance, methods of assessment and effects of treatment. CNS Drugs. 2004;18:853–75.

    Article  PubMed  Google Scholar 

  112. Sikkes SAM, de Lange-de Klerk ESM, Pijnenburg YAL, Scheltens P, Uitdehaag BMJ. A systematic review of Instrumental Activities of Daily Living scales in dementia: room for improvement. J Neurol Neurosurg Psychiatry. 2009;80:7–12.

    Article  CAS  PubMed  Google Scholar 

  113. Gold DA. An examination of instrumental activities of daily living assessment in older adults and mild cognitive impairment. J Clin Exp Neuropsychol. 2012;34:11–34.

    Article  PubMed  Google Scholar 

  114. Marshall G, Amariglio RE, Sperling R, Rentz DM. Activities of daily living: where do they fit in the diagnosis of Alzheimer’s disease? Neurodegener Dis Manag. 2012;2:483–91.

    Article  PubMed  PubMed Central  Google Scholar 

  115. Lawton MP, Brody EM. Assessment of older people: self-maintaining and instrumental activities of daily living. Gerontologist. 1969;9:179–86.

    Article  CAS  PubMed  Google Scholar 

  116. Vergara I, Bilbao A, Orive M, Garcia-Gutierrez S, Navarro G, Quintana JM. Validation of the Spanish version of the Lawton IADL Scale for its application in elderly people. Health Qual Life Outcomes. 2012;10:130. doi:10.1186/1477-7525-10-130.

    Article  PubMed  PubMed Central  Google Scholar 

  117. Sikkes SAM, Pijnenburg YAL, Knol DL, de Lange-de Klerk ESM, Scheltens P, Uitdehaag BMJ. Assessment of instrumental activities of daily living in dementia: diagnostic value of the Amsterdam Instrumental Activities of Daily Living Questionnaire. J Geriatr Psychiatry Neurol. 2013;26:244–50.

    Article  PubMed  Google Scholar 

  118. Koster N, Knol DL, Uitdehaag BMJ, Scheltens P, Sikkes SAM. The sensitivity to change over time of the Amsterdam IADL Questionnaire. Alzheimer’s Dement. 2015;11:1231–40. doi:10.1016/j.jalz.2014.10.006.

    Article  Google Scholar 

  119. Farias ST, Mungas D, Reed BR, Cahn-Weiner D, Jagust W, Baynes K, et al. The measurement of everyday cognition (ECog): scale development and psychometric properties. Neuropsychology. 2008;22:531–44.

    Article  PubMed  PubMed Central  Google Scholar 

  120. Walsh SP, Raman R, Jones KB, Aisen PS. ADCS Prevention Instrument Project: the Mail-In Cognitive Function Screening Instrument (MCFSI). Alzheimer Dis Assoc Disord. 2006;20(4 Suppl 3):170–8.

    Article  Google Scholar 

  121. Logie R, Parra Rodriguez M, Della SS. From cognitive science to dementia assessment. Behav Brain Sc. 2015;2:81–91.

    Google Scholar 

  122. Visser PJ, Verhey FR, Boada M, Bullock R, De Deyn PP, Frisoni GB, et al. Development of screening guidelines and clinical criteria for predementia Alzheimer’s disease. The DESCRIPA Study. Neuroepidemiology. 2008;30:254–65.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

Download references


Not applicable.


This project was founded by a grant of the European Joint Programme for Neurodegenerative Disease Research (EU-JPND) and of the Italian Ministry of Health.

Availability of data and materials

Not applicable.

Authors’ contributions

AC and SFC: involved in conception and design of the study and in drafting and revising the manuscript and revising critically. TB, PC, CC, MC, FC, SC, SDS, JFD, BD, ED, PN, SGP, ES, SS, PT, WMF and PJV: made substantial contributions to conception and design of the study and revised the manuscript critically. All authors read and approved the final manuscript.

Competing interests

The authors declare that they have no competing interests.

Consent for publication

Not applicable.

Ethics approval and consent to participate

Not applicable.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Author information

Authors and Affiliations


Corresponding author

Correspondence to Alberto Costa.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Costa, A., Bak, T., Caffarra, P. et al. The need for harmonisation and innovation of neuropsychological assessment in neurodegenerative dementias in Europe: consensus document of the Joint Program for Neurodegenerative Diseases Working Group. Alz Res Therapy 9, 27 (2017).

Download citation

  • Published:

  • DOI: