The choice of an instrument in neuropsychology practice and research contexts must be directly related to the set of psychometric properties the test possesses. A quality test should provide evidence of validity and reliability for the target population (AERA, APA, & NCME, 2014). The validity of an instrument refers to the degree to which evidence is accumulated and corroborates the interpretation of a test according to its specific purpose. Among the different types of evidence, validity based on the relationship with external variables (criteria) has proven important in clinical practice by demonstrating that the results on the instrument are related to predicting an outcome or are related to similar constructs. Reliability, on the other hand, refers to the accuracy with which test scores and interpretations are maintained, regardless of the conditions in which the instrument is used (AERA, APA, & NCME, 2014). Therefore, extensively researched instruments with positive results should be prioritized.
One of the neuropsychological instruments, directed toward psychology and speech therapy professionals with adequate psychometric properties in the Brazilian context is the Brief Neuropsychological Assessment Instrument NEUPSILIN (Fonseca, Salles, & Parente, 2009). However, most of the NEUPSILIN subtests require verbal responses from the patient, making it impossible to assess individuals with communicative difficulties such as aphasia, mutism, and specific language disorders. Accordingly, neuropsychological deficits can be demonstrated by tasks with verbal responses in patients with expressive challenges due to their linguistic impairment, making it essential to provide visual response options to compensate for these difficulties (Crivelli et al., 2023). To overcome this limitation, the Brief Neuropsycholinguistic Assessment Instrument NEUPSILIN-L (Fontoura, Rodrigues, Fonseca, Parente, & Salles, 2011) was adapted from the NEUPSILIN (Fonseca et al., 2009) to assist in evaluating patients who have difficulty expressing themselves verbally.
The reason behind the adoption of of this instrument was because several studies have demonstrated adequate psychometric properties of the NEUPSILIN for the Brazilian population, such as evidence of content validity (Fonseca et al., 2009), convergent and concurrent construct validity (Pawlowski et al., 2008), criterion and incremental validity in neurological assessment (Pawlowski et al., 2014). Furthermore, the NEUPSILIN presents evidence of test-retest and inter-rater reliability (Pawlowski, Parente, & Bandeira, 2013a) and normative data for adolescents to older adults (Fonseca et al., 2009). These data demonstrated that this would be an instrument suitable for adaptation to another context, such as for patients with expressive language difficulties.
The NEUPSILIN-L assesses the same neuropsychological functions as the NEUPSILIN: orientation, attention, memory (verbal and visual episodic, prospective, and working memory), perception, language (oral and written), praxis, arithmetic skills, and executive functions. To analyze the psychometric properties of the NEUPSILIN-L, it was first sought to adapt its items with verbal responses (oral) by adding multiple-choice response options (motor). Studies with the NEUPSILIN-L demonstrated that this instrument provides evidence of content validity and criterion-related validity, showing that the inclusion of motor responses maintained the primary neuropsychological function to be assessed by the tasks and differentiated the performance of patients with and without expressive aphasia after left cerebral hemisphere cerebrovascular injury (Fontoura, Rodrigues, Mansur, Monção, & Salles, 2013).
A sensitivity analysis of the NEUPSILIN-L task items was also conducted to determine which ones better differentiated the performance of post-stroke adults and neurologically healthy individuals (Rodrigues et al., 2019). Analyses based on Item Response Theory using the Rasch model demonstrated that several items in the instrument presented discriminative power between individuals with and without neuropsychological deficits. Analyses using Receiver Operating Characteristic (ROC) plots indicated that the cognitive dimensions of orientation, oral language, academic skills (reading, writing, and arithmetic), and executive functions were the ones that best differentiated between clinical and healthy groups. These results reinforce the evidence of criterion-related validity for the NEUPSILIN-L.
Considering the scarcity of validated neuropsychological instruments in Brazil, especially for evaluating non-verbal patients with expressive oral language difficulties (e.g., mutism, aphasia, specific language disorder, speech disorder, catatonia, autism spectrum disorder, and neurocognitive disorders affecting language), the present study aimed to analyze preliminary data on the psychometric properties of the NEUPSILIN-L by comparing the performance of adults who had experienced unilateral stroke, with and without expressive aphasia, to that of neurologically healthy adults. Specific objectives included analyzing evidence of criterion-related validity by a) comparing the performance of post-stroke adults and neurologically healthy adults; b) comparing performance between post-stroke groups with and without predominantly expressive aphasia; c) comparing performance between oral and motor (multiple-choice) responses to the subtests that encompass these alternatives in the NEUPSILIN-L in groups with left cerebral hemisphere damage (LHD) and right cerebral hemisphere damage (RHD); and d) analyzing the internal consistency and reliability of the instrument.
It was hypothesized that adults with stroke and LHD would present lower performance in the NEUPSILIN-L subtests related to language tasks (Rapp, 2011; Rodrigues et al., 2013, 2019; Rodrigues, Bandeira, & Salles, 2020) and praxis tasks (Rodrigues et al., 2011) compared to healthy individuals. Another hypothesis is that adults with stroke, specifically those with RHD lesions, would present lower performance in the NEUPSILIN-L subtests related to visuospatial processing, visual perception, constructive praxis, and inference processing in comparison to healthy adults (Rapp, 2011; Rodrigues et al., 2013, 2020; Tynterova, Perepelitsa, & Golubev, 2022). Furthermore, in comparisons between groups with and without aphasia, it is possible that language impairments may affect the ability of aphasic participants to respond to verbal tasks and result in lower scores (Fontoura et al., 2013). On the other hand, developing alternative tasks involving motor responses for some functions, a unique feature of the NEUPSILIN-L, should facilitate the response process for patients with language impairments. Therefore, it is assumed that LHD patients, whose language impairments are expected, will have higher scores in subtests involving motor response than oral response.
Method
Participants
The study included adults (over 18 years of age), of both sexes, divided into three groups: a) 45 neurologically healthy individuals, b) 11 with post-stroke RHD, and c) 38 with post-stroke LHD. The final sample consisted of 94 adults, 52 of them female. The healthy, RHD, and LHD groups did not show statistically significant differences in sex, age, and years of education. The post-stroke patients exhibited a heterogeneous profile based on the types and locations of their lesions. Table 1 provides descriptive data for each group.
Healthy n = 45 M (SD) |
RHD n = 11 M (SD) |
LHD n = 38 M (SD) |
F/χ2 | p | |
---|---|---|---|---|---|
Age (years) | 56.13 (9.95) | 52.45 (9.66) | 60.24 (10.23) | 2.219 | 0.115 |
Sex (Fe/Ma) | 25/20 | 7/4 | 20/ 18 | 0.420 | 0.811 |
Years of education | 9.56 (4.36) | 9.45 (3.33) | 8.32 (4.68) | 0.838 | 0.436 |
Time since stroke (months) | - | 27.00 (10.03) | 47.03 (35.17) | 3.427 | 0.071 |
Frequency of cerebrovascular lesion data and types of aphasia. | |||||
I/ H/ NR | - | 5/ 5/ 1 | 26/ 7/ 5 | ||
Cor/ Sub/ CS/ NR | - | 3/ 2/ 5/ 1 | 7/ 9/ 9/ 13 | ||
Broca’s aphasia | 0 | 0 | 8 | ||
Mixed transcortical aphasia | 0 | 0 | 1 | ||
Motor transcortical aphasia | 0 | 0 | 6 | ||
Unspecified aphasia | 0 | 0 | 1 |
Note. Fe = female; Ma = male; I = ischemic; H = hemorrhagic; NR = not reported; Cor = cortical; Sub = subcortical; CS = cortico-subcortical; M = mean; SD = standard deviation; LHD = left hemisphere damage; RHD = right hemisphere damage.
All participants were Brazilian, monolingual, and had at least four years of formal education. For the healthy group, individuals without any history of stroke or other neurological conditions were included. Post-stroke patients could have up to two episodes of lesions in the same cerebral hemisphere (right or left). They should not have neurological damage resulting from other diseases, such as tumors or traumatic brain injuries, confirmed by neuroimaging exams and neurological assessments.
Exclusion criteria for all groups (healthy and post-stroke) included a current or previous history of substance abuse (alcohol and illicit drugs) and self-reported psychiatric or sensory disorders (uncorrected hearing and/or visual impairments). Adults with moderate to severe depressive symptoms, as indicated by their responses on the depression scales selected according to the participant’s age (described in the instruments section), were also excluded. Additionally, for the neurologically healthy group, evidence of cognitive decline assessed through the Mini-Mental State Examination (Folstein et al., 1975) was an exclusion criterion, following the cutoff points proposed by Kochhann et al. (2010), which vary according to education level.
Data collection procedures and Instruments
The study participants were part of a project that obtained approval from the Research Ethics Committee of a general hospital in Porto Alegre, under number 100149, and of a public university in Rio Grande do Sul (authorization number 2009028). All participants signed the consent form. The stroke patients were contacted by telephone after being referred by doctors and residents at the general hospital or after an analysis of their medical records. The neurologically healthy participants were from the general community. The following instruments were administered:
a) Health and sociodemographic conditions questionnaire: produced by the research group, consisting of questions about age, years of education, gender, substance use history, and history of psychiatric and neurological diagnoses (sensory and others). The questionnaire was used for sample characterization and to relate data such as age and education to neuropsychological performance.
b) Brief Neuropsycholinguistic Assessment Instrument - NEUPSILIN-L (Fontoura et al., 2011): this instrument consists of a battery of 33 neuropsychological tasks, assessed with options for oral responses (OR), motor responses (MR), or both. The instrument assesses temporal-spatial orientation (OR - 8 points and MR - 8 points), attention (reverse counting - 20 points OR; digit sequence repetition - 7 points OR and 7 points MR), visual perception (verification of line equalities and differences - 6 points; visual hemineglect - 1 point; face perception - 3 points; face recognition - 2 points), working memory (backwards digit ordering - 10 points MR; auditory word span in sentences - 28 points MR), episodic-semantic verbal memory (immediate, delayed, and recognition - 40 points OR), long-term semantic memory (5 points OR and 5 points MR), short-term visual memory (3 points), arithmetic skills (8 points), oral language (naming - 4 points; repetition - 10 points; comprehension - 3 points; inference processing - 3 points OR and 3 points MR), written language (reading - 12 points; comprehension - 3 points; spontaneous writing - 2 points; copied writing - 2 points; dictated writing - 12 points), praxis (ideomotor - 3 points; constructive - 16 points; reflective - 3 points), and executive functions (problem-solving - 2 points OR and 2 points MR; orthographic and semantic verbal fluency - score dependent on the number of words evoked). Tasks that assess neuropsychological functions visually do not have OR options. Tasks that depend on speech are answered in both OR and multiple-choice (MR) forms, always in this order. Tasks of verbal memory and language do not have MR options since this form of response would alter the target function being assessed. The NEUPSILIN-L scoring is done separately based on the number of correctly verbalized and pointed items, with scores extracted for both tasks and functions (task groups).
c) Boston Aphasia Diagnostic Test - Short version (Goodglass, Kaplan, & Barresi, 2001; Radanovic, Mansur, Azambuja, Porto, & Scaff, 2004): applied exclusively to the post-stroke adult group by a speech therapist experienced in clinical diagnosis to classify the type of aphasia presented by the patient. It consists of a battery with 28 tasks that assess oral comprehension, oral agility, repetition, naming, oral reading, reading comprehension, and writing. This test was used only for the characterization of the sample, as it is a reference for aphasia diagnosis and for dividing the groups into those with and without predominantly expressive aphasia.
d) Geriatric Depression Scale - GDS-15 (Almeida & Almeida, 1999): a 15-item instrument with yes/no responses, answered only by participants aged 60 and over, to exclude those with moderate to severe depressive symptoms (score of 11 points or more). This scale was applied only to ensure that participants met the study's inclusion criteria.
e) Beck Depression Inventory (BDI, Cunha, 2001): Completed by adults up to 59 years of age to exclude participants with moderate to severe depressive symptoms. The BDI has 21 items, in which the participant indicates whether they have experienced depressive symptoms in the past few weeks, with scores ranging from zero to four. This instrument was applied only to ensure the study's inclusion criteria, with participants with a score of 20 points or higher being excluded.
f) Mini-Mental State Examination (Folstein et al., 1975): A screening instrument used to check for signs of cognitive decline. This test was only administered to neurologically healthy adults to ensure the inclusion criteria, using cutoff points for education according to Kochhann et al. (2010).
The assessments took place in rooms at the research institution or in the participants’ homes (four post-stroke adults) in case of difficulty with transportation. The assessments were conducted in quiet, well-lit environments with no interruptions in both situations. Participants completed the entire assessment in an average of two sessions, each lasting approximately one hour and thirty minutes.
Data analysis
Initially, descriptive analyses of the participants’ performances in the NEUPSILIN-L were conducted. As the data did not follow a normal distribution, non-parametric analyses were performed using Kruskal-Wallis tests, with corrections for multiple comparisons, to compare the three groups (LHD, RHD, and healthy adults) and their scores in the NEUPSILIN-L subtests. Mann-Whitney U tests (non-parametric) were used to compare the groups of patients with and without aphasia. Wilcoxon Signed-Rank tests were used for intra-group task comparisons. Furthermore, reliability was estimated using internal consistency analysis by calculating Cronbach’s alpha and McDonald’s omega for all subtests of the instrument. Spearman correlations were also conducted only with tasks that showed modifications in the instrument adaptation, as the unmodified tasks had already demonstrated reliability in other studies (see Pawlowski et al., 2008). The statistical significance level for all analyses was set at α < 0.05. Analyses were performed using the SPSS (Statistical Package for the Social Sciences) version 27.0 software.
Results
a) Comparative groups (LHD, RHD, and neurologically healthy adults) in the NEUPSILIN-L
In the comparison between groups, as shown in Table 2, it was identified that patients with LHD had lower scores compared to both the RHD group and healthy adults in tasks related to temporal-spatial orientation (p = 0.010; p < 0.01), time orientation (p = 0.008; p < 0.001), and spatial orientation (p < 0.01; p = 0.015), in both motor response (MR) and oral response (OR). Additionally, the LHD group performed worse than the other groups in tasks related to working memory (p = 0.014; p < 0.001), auditory word span in sentences (p = 0.033; p = 0.001), oral language (p = 0.009; p < 0.001), written language (p = 0.015; p < 0.001), repetition (p = 0.004; p < 0.01), automatic language (p = 0.005; p < 0.001), inference processing (OR) (p = 0.001; p < 0.001), written comprehension (p = 0.034; p < 0.001), spontaneous writing (p = 0.022; p < 0.001), dictated writing (p = 0.036; p < 0.001), and orthographic (p = 0.007; p < 0.001) and semantic (p = 0.039; p < 0.001) verbal fluency. The RHD and healthy groups did not differ in these tasks.
NEUPSILIN- L | Healthy n = 45 M (SD) |
RHD n = 11 M (SD) |
LHD n = 38 M (SD) |
H | p |
---|---|---|---|---|---|
Temporal-spatial orientation (OR) | 7.96a (0.30) | 7.64a (1.21) | 6.08b (2.26) | 30.126 | <0.001* |
Time | 3.98a (0.15) | 3.82a (0.60) | 2.61b (1.60) | 30.868 | <0.001* |
Space | 3.98a (0.15) | 4.00a (0.00) | 3.00b (1.63) | 18.967 | <0.001* |
Temporal-spatial orientation (MR) | 7.98a (0.15) | 8.00a (0.00) | 6.74b (2.05) | 18.995 | <0.001* |
Time | 3.98b (0.15) | 3.82a.b (0.60) | 3.47a (0.86) | 14.294 | 0.001* |
Space | 4.00b (0.00) | 4.00a.b (0.00) | 3.74a (0.64) | 11.013 | 0.004* |
Attention | |||||
Reverse counting | 19.27a (2.61) | 18.09a.b (4.04) | 12.74b (9.08) | 19.321 | <0.001* |
Digit sequence repetition (OR) | 3.07a (1.75) | 2.64a.b (1.43) | 1.51b (1.28) | 18.338 | <0.001* |
Digit sequence repetition (MR) | 3.00a (1.99) | 2.55a.b (2.02) | 1.19b (1.10) | 21.011 | <0.001* |
Perception | 10.39b (1.38) | 9.36a (1.03) | 9.89a.b (1.62) | 6.752 | 0.034* |
Verification of similarities and differences between lines | 5.36b (0.93) | 4.27a (0.90) | 5.03b (1.24) | 11.557 | 0.003* |
Face perception | 2.14a (0.90) | 2.45a (0.52) | 2.08a (0.75) | 1.825 | 0.402 |
Face recognition | 1.91a (0.28) | 1.64a (0.67) | 1.79a (0.41) | 3.625 | 0.163 |
Memory | |||||
Working memory | 19.60a (6.19) | 19.18a (6.34) | 12.87b (5.63) | 21.070 | <0.001* |
Backward digit ordering | 4.60a (1.96) | 4.09a (2.16) | 2.55b (1.67) | 19.549 | <0.001* |
Auditory word span in sentences | 15.09a (5.08) | 15.09a (5.22) | 10.32b (4.69) | 15.476 | <0.001* |
Episodic-semantic verbal memory | 21.95a (5.61) | 22.36a.b (4.96) | 18.38b (5.85) | 8.117 | 0.017* |
Immediate recall | 4.56a (1.42) | 4.36a.b (1.36) | 3.22v (1.86) | 14.390 | 0.001* |
Delayed recall | 2.19a (2.11) | 2.36a (1.86) | 1.19a (1.58) | 6.447 | 0.040 |
Recognition | 15.21a (2.91) | 15.64a (3.01) | 13.95a (3.47) | 3.837 | 0.147 |
Semantic memory (OR) | 4.82a (0.49) | 4.82a.b (0.40) | 3.58b (2.03) | 12.835 | 0.002* |
Semantic memory (MR) | 4.84a (0.47) | 4.82a (0.40) | 4.58a (0.76) | 4.891 | 0.087 |
Short-term visual memory | 2.75a (0.65) | 2.73a.b (0.65) | 2.34b (0.91) | 8.226 | 0.016* |
Prospective memory | 1.73a (0.58) | 1.36a.b (0.81) | 1.26b (0.86) | 8.230 | 0.016* |
Arithmetic skills (OR) | 7.27a (1.40) | 6.64a.b (2.20) | 4.68b (3.25) | 15.783 | <0.001* |
Language | |||||
Oral language (OR) | 26.13a (1.24) | 26.09a (0.94) | 19.76b (7.76) | 28.841 | <0.001* |
Oral language (MR) | 23.51a (0.81) | 23.36a (0.81) | 18.37b (6.90) | 22.246 | <0.001* |
Naming | 3.98b (0.15) | 3.82a.b (0.40) | 3.11a (1.52) | 12.349 | 0.002 |
Repetition | 9.89a (0.32) | 9.91a (0.30) | 7.47b (3.37) | 25.714 | <0.001* |
Automatic | 4.00a (0.00) | 4.00a (0.00) | 2.95b (1.43) | 25.824 | <0.001* |
Oral comprehension | 2.87a (0.34) | 2.91a (0.30) | 2.61a (0.64) | 5.645 | 0.059 |
Inference processing (OR) | 2.62a (0.65) | 2.73a (0.47) | 1.45b (1.11) | 29.443 | <0.001* |
Inference processing (MR) | 2.78b (0.51) | 2.73a.b (0.65) | 2.24a (0.91) | 12.381 | 0.002* |
Written language | 28.67a (2.09) | 28.60a (1.65) | 19.05b (10.92) | 23.606 | <0.001* |
Reading aloud | 11.76a (0.48) | 11.70a (0.48) | 8.05b (4.80) | 22.403 | <0.001* |
Written comprehension | 2.91a (0.29) | 2.91a (0.30) | 2.34b (0.85) | 16.872 | <0.001* |
Spontaneous writing | 1.60a (0.54) | 1.64a (0.50) | 0.84b (0.90) | 17.524 | <0.001* |
Copied writing | 1.78a (0.42) | 1.82a (0.40) | 1.54a (0.69) | 2.907 | 0.234 |
Dictated writing | 10.70a (1.32) | 10.45a (1.03) | 6.35b (4.66) | 24.696 | <0.001* |
Praxis | 18.16b (2.81) | 16.80a.b (2.70) | 14.3a (4.91) | 14.038 | 0.001* |
Ideomotor | 3.00a (0.00) | 3.00a.b (0.00) | 2.76b (0.71) | 7.694 | 0.021* |
Constructive | 12.89a (2.34) | 11.91a.b (2.88) | 10.00b (3.75) | 11.788 | 0.003* |
Reflective | 2.29a (1.03) | 2.30a.b (1.06) | 1.61b (1.28) | 6.859 | 0.032* |
Executive Functions | |||||
Problem-solving (OR) | 1.67a (0.47) | 1.82a (0.40) | 1.37a (0.63) | 7.563 | 0.023 |
Problem-solving (MR) | 1.67a (0.47) | 1.82a (0.40) | 1.45a (0.64) | 4.340 | 0.114 |
Orthographic verbal fluency | 20.51a (7.55) | 15.09a (4.41) | 5.97b (7.15) | 47.797 | <0.001* |
Semantic verbal fluency | 24.76a (8.84) | 20.45a (4.76) | 11.34b (8.98) | 32.844 | <0.001* |
Note: OR = Oral Response; MR = Motor Response; M = mean; SD = standard deviation.
a, b = letters were used to represent differences between groups. Equal letters indicate that the groups had the same neuropsychological performance. In contrast, different letters indicate that the groups differed, meaning that the group with the lower means had lower neuropsychological performance.
The LHD group had lower scores only compared to the healthy adult group in tasks related to attention (OR and MR; p < 0.001), reverse counting (p < 0.001), digit sequence repetition (p < 0.001), backward digit ordering (p < 0.001), episodic-semantic verbal memory (p = 0.028), immediate recall (p = 0.001), semantic (OR; p = 0.002), visual (p = 0.017), and prospective (p = 0.017) memory, arithmetic skills (p < 0.001), naming (p = 0.001), and ideomotor (p = 0.024), constructive (p = 0.002), and reflective (p = 0.034) praxis. The LHD and RHD groups did not differ in these tasks.
The RHD group performed worse than the healthy adults (p = 0.002) and the LHD group (p = 0.042) in the line perception task and worse than the healthy adults in visual perception (p = 0.038). The hemineglect task reached a ceiling effect, meaning that none of the participants in the sample scored zero.
b) Comparisons between groups with and without aphasia
When dividing the LHD group into adults with predominantly expressive aphasia (n = 16) and those without aphasia (n = 22), statistically significant differences were identified between these groups in tasks related to inference processing by OR (U = 246.000; p = 0.039) and MR (U = 248.000; p = 0.033), oral language by OR (U = 251.500; p = 0.024) and MR (U = 244.000; p = 0.045), and reflexive praxis (U = 247.500; p = 0.033), with the first group performing worse than the second.
c) Comparisons between oral and motor responses in post-stroke patients with LHD
For some subtests, motor responses were provided to the patient during the NEUPSILIN-L assessment. According to the results, motor responses for the subtests of temporal orientation, spatial orientation, semantic memory, and inference processing were significantly better than the oral responses for the same subtests (Table 3).
Oral response | Motor response | |||||||
---|---|---|---|---|---|---|---|---|
Mean | SD | Median | Mean | SD | Median | Z | p | |
Temporal orientation | 2.61 | 1.60 | 3.00 | 3.47 | 0.86 | 4.00 | -3471 | <0.001 |
Spatial orientation | 3.00 | 1.63 | 4.00 | 3.74 | 0.64 | 4.00 | -2.890 | 0.003 |
Digit sequence repetition | 1.51 | 1.28 | 1.00 | 1.19 | 1.10 | 1.00 | -1542 | 0.123 |
Semantic memory | 3.58 | 2.03 | 5.0 | 4.58 | 0.74 | 5.0 | -2869 | 0.004 |
Inference processing | 1.45 | 1.11 | 1.5 | 2.24 | 0.91 | 2.00 | -3857 | <0.001 |
Problem-solving | 1.37 | 0.63 | 1.00 | 1.45 | 0.64 | 2.00 | -1732 | 0.083 |
Note: SD = standard deviation; Z = Wilcoxon Signed-Rank Test statistic.
d) Analysis of internal consistency
The items of the NEUPSILIN-L showed a Cronbach’s alpha and McDonald’s omega of 0.931 and 0.950, respectively. The results of the correlations between the tasks of the NEUPSILIN-L, which underwent modifications compared to the original instrument, are presented in Tables 4 and 5. In the healthy sample, only the semantic memory task (OR) did not show correlations with any task of the NEUPSILIN-L (Table 4). Other subtests showed weak to moderate correlations with each other. In the group of adults with stroke, there were weak, moderate, and strong correlations between all the NEUPSILIN-L tasks (Table 5).
OR (MR) |
AT (MR) | WM | VM | SM (MR) | PM | AR | OL (MR) | PS (MR) | OVF | SVF | |
---|---|---|---|---|---|---|---|---|---|---|---|
OR (MR) | - | ||||||||||
AT (MR) | 0.056 | - | |||||||||
WM | 0.242 | 0.333* | - | ||||||||
VM | 0.221 | 0.053 | 0.535** | - | |||||||
SM (MR) | -0.050 | 0.026 | 0.002 | -0.020 | - | ||||||
PM | 0.456** | 0.332* | 0.373* | 0.499** | -0.072 | - | |||||
AR | 0.137 | 0.041 | 0.438** | 0.206 | 0.098 | 0.033 | - | ||||
OL (MR) | 0.470** | 0.072 | 0.426** | 0.477** | 0.034 | 0.439** | 0.275 | - | |||
PS (MR) | -0.107 | 0.097 | 0.455** | 0.372* | 0.167 | 0.164 | 0.305* | 0.097 | - | ||
OVF | 0.273 | 0.327* | 0.537** | 0.370* | 0.092 | 0.442** | 0.205 | 0.451** | 0.320* | - | |
SVF | 0.030 | 0.219 | 0.583** | 0.402** | 0.018 | 0.284 | 0.218 | 0.459** | 0.325* | 0.528** | - |
Note: OR = orientation; AT = attention; WM = working memory; VM = verbal memory; SM = semantic memory; PM = prospective memory; AR = arithmetic; OL = oral language; PS = problem-solving; OVF = orthographic verbal fluency; SVF = semantic verbal fluency; MR = motor response.
* = p<0.05
** = p<0.01
OR (MR) | AT (MR) | WM | VM | SM (MR) | PM | AR | OL (MR) | PS (MR) | OVF | SVF | |
---|---|---|---|---|---|---|---|---|---|---|---|
OR (MR) | - | ||||||||||
AT (MR) | 0.754** | - | |||||||||
WM | 0.562** | 0.584** | - | ||||||||
VM | 0.609** | 0.502** | 0.538** | - | |||||||
SM (MR) | 0.308* | 0.257 | 0.327* | 0.621** | - | ||||||
PM | 0.524** | 0.486** | 0.502** | 0.362* | 0.253 | - | |||||
AR | 0.707** | 0.725** | 0.693** | 0.552** | 0.335* | 0.570** | - | ||||
OL (MR) | 0.824** | 0.811** | 0.523** | 0.522** | 0.324* | 0.505** | 0.644** | - | |||
PS (MR) | 0.459** | 0.533** | 0.303* | 0.361* | 0.172 | 0.184 | 0.494** | 0.444** | - | ||
OVF | 0.526** | 0.609** | 0.647** | 0.441** | 0.297* | 0.336* | 0.593** | 0.597** | 0.349* | - | |
SVF | 0.619** | 0.702** | 0.749** | 0.403** | 0.277 | 0.486** | 0.655** | 0.732** | 0.367** | 0.765** | - |
Note: OR = orientation; AT = attention; WM = working memory; VM = verbal memory; SM = semantic memory; PM = prospective memory; AR = arithmetic; OL = oral language; PS = problem-solving; OVF = orthographic verbal fluency; SVF = semantic verbal fluency; MR = motor response.
* = p<0.05
** = p<0.01
Discussion
Comparative groups (LHD, RHD, and neurologically healthy adults) in the NEUPSILIN-L
From the analysis of group comparisons, the hypothesis that adults with LHD would perform worse in the NEUPSILIN-L language subtests compared to the other groups was confirmed. Several studies support the findings of language impairments in post-stroke adults (Basilakos, 2015; Boukrina et al., 2015; Fontoura et al., 2013; Pawlowski et al., 2013; Rapp, 2011; Rodrigues et al., 2019, 2020). Basilakos (2015) found an association between speech apraxia and aphasia with motor cortical regions, somatosensory areas, the temporal lobe, and the prefrontal cortex of the left cerebral hemisphere. Boukrina et al. (2015) identified lower performance in patients with LHD in tasks involving semantic, orthographic, and phonological processing. These findings are consistent with the lower performance of participants with LHD in oral language, repetition, automatic language, inference processing, written language, spontaneous writing, and dictated writing tasks of the NEUPSILIN-L when compared to the RHD and healthy groups. Therefore, the relationship between the processing of oral and written language predominantly performed by the left cerebral hemisphere is evident.
The hypothesis that adults with LHD would perform worse in the praxis tasks was also confirmed. Deficits in reading, spontaneous writing, copied writing, dictated writing, and praxis tasks show correlations with left hemisphere functioning, as well as with each other, as they are all related to social interaction through communication (Pawlowski et al., 2013b; Rodrigues et al., 2011). Accordingly, apraxic deficits and language comprehension impairments are significantly associated with lesions in the left cerebral hemisphere. The NEUPSILIN-L evaluation results also indicated lower performance in the praxis tasks (ideomotor, constructive, and reflective) in the patients with LHD compared to the other groups, showing a relationship between these deficits and the affected hemisphere (Rodrigues et al., 2011).
The results with the NEUPSILIN-L confirmed findings from the original NEUPSILIN when comparing the performance of adults with LHD to neurologically healthy adults (Pawlowski et al., 2013b). Adults with post-stroke LHD showed a significant reduction in performance in language (oral and written), working memory, and ideomotor praxis tasks. The NEUPSILIN-L working memory tasks depend on language (comprehension and expression) to be performed correctly, which justifies the poorer performance of the LHD group.
Another confirmed hypothesis was that adults with RHD would perform worse than healthy adults in the visual perception subtest. Participants with RHD showed poorer performance in the line perception task of the NEUPSILIN-L. Russell et al. (2013) demonstrated that RHD patients had a reduced effective visual field, mainly for identifying items to their left, indicating the importance of the right hemisphere in visual perception processing. Vossel et al. (2013) also showed the emergence of deficits such as hemineglect and agnosia, directly impacting the daily living activities of these patients. Cerebral areas related to this type of deficit were the frontal cortex, cingulate cortex, and white matter of the right hemisphere.
The other visual perception tasks (face perception and recognition), as well as the hemineglect task of the NEUPSILIN-L, did not differentiate the three groups, although it is common for RHD patients to present visual hemineglect after a stroke (Nurmi et al., 2010). It is likely that the small number of items in the instrument, along with the small sample size, compromised the significance of the differences. Additionally, the hemineglect task may have been too easy to execute, not being sensitive to patients with chronic cerebrovascular lesions or more subtle deficits.
The hypotheses that participants with RHD would perform worse in the inference processing and constructive praxis tasks when compared to the healthy group were not confirmed. This fact may be related to the small sample size and the limited variability in the NEUPSILIN-L scores, which were not sensitive enough to detect these difficulties. Qualitative analyses of error types, such as observing whether the drawing suggests hemineglect and whether there are concrete responses in metaphor interpretation, may complement the quantitative analysis of the NEUPSILIN-L and contribute to the understanding of deficit processing.
In general, the results of the comparisons between the three groups (LHD, RHD, and healthy) using the NEUPSILIN-L corroborated findings already documented in the literature on cerebral hemisphere specialization (Rapp, 2011; Rodrigues et al., 2013; Tynterova, Perepelitsa, & Golubev, 2022). Furthermore, the instrument was able to help understand the neuropsychological profile of patients with LHD, RHD, and neurologically healthy adults. Therefore, it can be said that the NEUPSILIN-L presents evidence of criterion-related validity by demonstrating differences in performance according to the participants’ neurological clinical status. However, the study limitations include the small number of participants and the heterogeneity of cerebrovascular lesions, which may not have shown statistically significant differences. Analyses with larger and more homogeneous groups are recommended for future studies.
b) Comparisons between groups with and without aphasia
The hypothesis that participants with LHD and aphasia would have lower scores on the NEUPSILIN-L was also corroborated, again demonstrating criterion-related validity evidence. Differences in oral language skills between groups with and without expressive aphasia are expected, as these tasks involve naming, comprehension, automatic speech, and repetition, which may be impaired in these cases (Fontoura et al., 2014). The task of processing inferences is also speech-dependent, which may have hindered the performance of patients with aphasia. On the other hand, reflexive praxis is not a language-dependent task for execution, although participants must understand its instructions. Therefore, difficulties in attention and comprehension of what should be done may have highlighted these differences in this task.
It is important to note that participants in the groups with and without aphasia, despite having left hemisphere lesions, are heterogeneous in terms of the extent of the lesion, affected lobes, and time post-stroke, which are variables that influence neuropsychological deficits (Rodrigues et al., 2011; 2018). This constitutes a further limitation of the present study. Patients with aphasia may have a greater number of neuropsychological deficits associated with extensive brain lesions, affecting various cognitive abilities such as working memory and attention (Crivelli et al., 2023; Lee & Pyun, 2014). Furthermore, even if patients have lesions in the same specific brain areas, they may manifest different impairments. It is suggested that case series studies with the same type of brain lesion or studies with homogeneous groups, using the NEUPSILIN-L, could contribute to research in the field.
c) Comparisons between oral and motor responses in post-stroke patients with LHD
Participants in the clinical groups showed better performance in the NEUPSILIN-L in tasks with motor response options compared to oral responses in the orientation, memory, and inferential processing subtests. It is possible that having response options facilitates neuropsychological assessment, as participants can recognize the correct alternative instead of recalling it. In the application of the NEUPSILIN-L, to standardize the instrument, all participants initially provided oral responses, followed by motor responses. This inclusion of motor responses has proven valuable in clinical practice, offering greater sensitivity when compared to tests relying solely on oral responses, especially for patients with aphasia (Crivelli et al., 2023). Furthermore, having visual options to point to for the answer may provide a more reliable assessment of the specific neuropsychological function in question. This result suggests that the motor modality, an innovation in the NEUPSILIN-L, allows the patient to respond to the subtest without the effect of expressive or oral language impairments affecting their score.
On the other hand, having alternatives for the participant to point to may make the assessment easier, and the participant may “guess” the answer, leading to a false-negative result (not demonstrating a deficit in the neuropsychological function). Therefore, it is recommended that the evaluator pays attention to the accuracy of the responses, hesitations, and test duration, and analyzes the patient’s results in the NEUPSILIN-L to assess their neuropsychological profile. Despite these limitations, the use of the instrument is recommended for patients with expressive language difficulties, such as aphasia, mutism, and communication disorders, aiming to circumvent the language deficit and assess the target neuropsychological construct in clinical contexts.
d) Analysis of internal consistency
Finally, internal consistency analyses demonstrated results above 0.90, with alphas between 0.60 to 0.70 being considered borderline for an acceptable result (Hair, Black, Babin, Anderson, & Tatham, 2009). Therefore, the results of the NEUPSILIN-L demonstrate high internal consistency. Additionally, in general, the neuropsychological tasks showed statistically significant weak, moderate, and strong correlations in both groups, indicating that they assess related functions and demonstrate interdependence (Rodrigues et al., 2019). Moreover, many tasks are language-dependent, which supports the correlations found between the subtests. From the correlations, it can be observed that the motor response alternatives continue to assess the main neuropsychological functions. Therefore, the results of the NEUPSILIN-L demonstrate high reliability. The weakness of the correlations among healthy individuals may have been due to this group exhibiting a ceiling effect in many of the tasks of this instrument, compromising the significance between them. In contrast, in the group of adults with stroke, there were weak, moderate, and strong correlations between all the NEUPSILIN-L tasks. The greater variability in scores in this group, compared to the healthy individuals, may have favored the stronger and more significant correlations.
Conclusion
In summary, the NEUPSILIN-L demonstrated evidence of criterion-related validity and evidence of reliability (internal consistency and reliability). This instrument has shown its ability to differentiate between two clinical groups (LHD and RHD) and healthy adults, as well as between two groups with different clinical conditions (with and without aphasia). These findings are important in the field of neuropsychology to ensure that the instrument is capable of identifying different cognitive profiles (AERA, APA, & NCME, 2014). It is important to note that this is not a diagnostic tool but rather a tool for assessing the neuropsychological profile of adults, especially those with difficulties in verbalizing responses. It can assist healthcare providers in identifying deficits in patients and referring them for the appropriate treatment.
This study was conducted with preliminary data and has limitations, including a small number of participants and variability in the types and locations of the cerebrovascular lesions. Therefore, future studies will be carried out with larger samples and patients with other clinical conditions that affect expressive language. Normative data for the Brazilian population will also be provided, allowing clinicians and researchers to use this instrument in their neuropsychological assessments.