DOI:

https://revistascientificas.cuc.edu.co/JACN

Original

Teleneuropsychological assessment in South America: A perspective from patients and neuropsychologists

Evaluación teleneuropsicológica en América del Sur: Una perspectiva desde los pacientes y los neuropsicólogos

Micaela-María Arruabarrena1

María-Eugenia Martin2

Ismael-Luis Calandri3

Nicolás Corvalán4

María-Belén Helou5

Carlos Martínez6

Lucia Crivelli7

..

For cite this articule:

Arruabarrena, M.-M-, Martin, M.-E., Calandri, I.-L., Corvalán, N., Helou, M.-B., Martínez, C. & Crivelli, L. (2022). Teleneuropsychological assessment in South America: A perspective from patients and neuropsychologists. Journal of Applied Cognitive Neuroscience, 3(2), e00324683.

https://doi.org/10.17981/JACN.3.2.2022.05

..

Manuscript received on 19th October 2022

Accepted on 23th December 2022

..

Abstract

Teleneuropsychology (teleNP) in Argentina was promoted by the COVID-19 pandemic. This investigation aimed to evaluate patients’ and neuropsychologists’ satisfaction with teleNP and to identify the advantages and disadvantages of its use. 41 patients with mild cognitive impairment and 35 neuropsychologists from Argentina were surveyed. Both groups were sent a questionnaire by e-mail to evaluate their satisfaction and preferences regarding teleNP. Patients were sent the survey after being cognitively evaluated by teleNP. Outcomes reflected a 91% degree of satisfaction with teleNP, with no differences between patients and specialists (p = 0.112). Regarding patients, 50% had no predilection regarding evaluation modality, and 35.7% preferred teleNP. The main benefits identified were accessibility to remote areas (72.4%), and comfort of performing the assessment at home (57.14%). Moreover, 74.3% of practitioners reported that the principal difficulty was the patient’s lack of familiarity with the technology, and 60% a deficiency in environmental control. TeleNP cognitive evaluation has a high degree of acceptability for practitioners and patients. The main obstacles identified are network connection problems and the lack of familiarity with technology. The principal advantages come from accessing isolated areas. This suggests that this practice will remain relevant beyond the pandemic context.

Keywords: Teleneuropsychology; COVID-19; Cognitive assessment; Telehealth; Telemedicine

Resumen

La teleneuropsicología (teleNP) en Argentina fue promovida por la pandemia del COVID-19. Esta investigación se propuso evaluar la satisfacción de pacientes y neuropsicólogos con la teleNP e identificar las ventajas y desventajas de su uso. Se encuestaron 41 pacientes con deterioro cognitivo leve y 35 neuropsicólogos de Argentina. A ambos grupos se les envió un cuestionario por correo electrónico para evaluar su satisfacción y preferencias respecto a la teleNP. A los pacientes se les envió la encuesta después de ser evaluados cognitivamente mediante teleNP. Los resultados reflejaron un grado de satisfacción con la teleNP del 91%, sin diferencias entre pacientes y especialistas (p = 0.112). En cuanto a los pacientes, el 50% no tenía predilección por ninguna modalidad de evaluación, y el 35.7% prefería la telePN. Los principales beneficios identificados fueron la accesibilidad a zonas remotas (72.4%), y la comodidad de realizar la evaluación en casa (57.14%). Por otra parte, el 74.3% de los profesionales informaron de que la principal dificultad era la falta de familiaridad del paciente con la tecnología, y el 60% una deficiencia en el control del entorno. La evaluación cognitiva TeleNP tiene un alto grado de aceptabilidad para los profesionales y los pacientes. Los principales obstáculos identificados son los problemas de conexión a la red y la falta de familiaridad con la tecnología. Las principales ventajas provienen del acceso a zonas aisladas. Esto sugiere que esta práctica seguirá siendo relevante más allá del contexto pandémico.

Palabras clave: Teleneuropsicología; COVID-19; Evaluación cognitiva; Telesalud; Telemedicina

Introduction

Telepsychology is defined as the provision of psychological services using telecommunication technologies. Telecommunication is the preparation, transmission, communication, or related processing of information by electrical, electromagnetic, electromechanical, electro-optical, or electronic means (Committee on National Security Systems-CNSS, 2010). Telephone, mobile devices, interactive videoconferencing, e-mail, chat, text, and internet are examples of telecommunication technologies (e.g., Self-help websites, blogs, and social media). The information sent may be written or may include images, sounds, or other data. It can be synchronous, with multiple parties communicating in real time (e.g., interactive videoconferencing, telephone), or asynchronous, with multiple parties communicating in the background (e.g., e-mail).

Also, teleneuropsychology (teleNP) was defined by The Inter-Organizational Practice Committee as “the use of audiovisual technology to establish clinical contact with patients for neuropsychological assessments”, recognizing that teleNP has reduced accessibility problems and enabled the provision of health services through the Information of Communications and Technology (ICT) during the global health emergency because of the coronavirus pandemic (COVID-­19).

Regarding the history of teleNP, the first use of this technology in the field of neuropsychology could be traced back to 1969, when the Wechsler scales were automated (CNSS, 2010). Over the years, several studies on the use and validity of teleNP as an alternative assessment modality have been conducted worldwide, mainly in Anglo-Saxon countries (Elwood & Griffin, 1972; Galusha-Glasscock et al., 2016; Chappell & Zimmer, 1999; Rentz et al., 2016; Soto-Pérez et al., 2010; Stricker et al., 2020; Wadsworth et al., 2018). However, teleNP was not an option in Argentina until the COVID-19 pandemic arose. The global impact of the COVID-19 pandemic drove the development of teleNP in Argentina. Literature indicates that teleNP may offer reliable and valid assessments (Crivelli et al., 2021).

Some of the advantages of using teleNP for the patient are broader access to services and better use of time (Morris et al., 2007), reduced costs in travel, increased comfort, and the possibility of obtaining a more rapid diagnosis. On the other hand, for the examiner, the advantages include greater clinical care capacity, a reduction in travel costs, a greater number of assessment and treatment alternatives, and increased productivity (Morris et al., 2007). Similarly, it is believed that remote assessment could lead to a reduction in practice-associated expenses for the examiner. Other possible advantages of teleNP for the examiner include increased access to multidisciplinary work, the opportunity to observe the patient’s environment in more detail, and the possibility of advancing part of the neuropsychological assessment process by identifying clinical needs in advance during the virtual clinical interview (Harrell et al., 2014; Cullum et al., 2014).

The COVID-19 pandemic and mandatory preventive social isolation (ASPO) have led to changes in the organization and utilization of the healthcare system throughout the world (Bilder et al., 2020).

In Argentina, between March 1 and July 31, 2020, compared to the same period in 2019, adults’ face-to-face consultations for cognitive assessment decreased significantly because they belong to the at-risk population (Calandri et al., 2021).

Furthermore, Argentina’s public health authorities implemented isolation measures structured in five phases. The first phase of the quarantine started on March 20 – 31, 2020, and was called strict quarantine; this policy only authorized the circulation of essential services (health personnel, security forces, among others), and population mobility decreased by up to 10%. The second phase was called controlled isolation. This phase started on April 1 – April 12, 2020, allowing a 25% increase in new permits and mobility. The third phase started on April 13 – May 10, 2020, and was called geographic segmentation, allowing mobility to decrease by up to 50%. Numerous cities along the country and rural areas moved to phase four according to epidemiological criteria. The fourth phase was called progressive reopening, allowing up to 75% circulation. This phase started on May 10 – July 17, 2020. Finally, the fifth phase started on July 18 – August 16 and was called new normality, allowing new authorizations, increased circulation, and appealing to social responsibility.

In this highly restrictive context, teleNP was adopted and implemented in this context to avoid the interruption of cognitive assessment. The primary goal of this study was to assess patients’ and neuropsychologists’ satisfaction with the use of teleNP during Argentina’s mandatory preventive social isolation period.

Reporting the experience that professionals and patients have had with this modality will make it possible to identify the benefits and difficulties that are encountered in practice. In this sense, with this information, it will be possible to improve and consolidate the positive aspects and to eliminate those that are not practical or useful so that in this way, teleNP is implemented as an alternative to face-to-face and not only as a compliment (Crivelli et al., 2021).

Methodology

Participants

A group of 35 neuropsychologists (Age: 41.3 +/–17.1) from Neurological Centers, General hospitals, and specific neuropsychological units in Argentina who were using the Fleni-ECaD (Evaluación Cognitiva a Distancia) teleNP battery were surveyed. In addition, 41 patients (Age: 54.9 +/–18.4) recruited from a Memory Clinic in Buenos Aires were recruited to complete a survey (Table 1). Before any procedure, all participants signed an informed consent form that was approved by the Institutional Review Board (IRB) (Table 1).

Table 1. Demographic Results.

Neuropsychologists

Patients

N: 35

N: 41

Age: 41.3 +/–17.1

Age: 54.9 +/–18.4

Source: Authors.

Assessment battery

The assessment was performed following the recommendations from the Latin American Teleneuropsychology Working Group (Crivelli et al., 2021).

The cognitive battery administered to the patient group was the Fleni-ECaD protocol, a comprehensive cognitive battery that includes tests for multiple cognitive domains.

Fleni-ECaD is an exhaustive neuropsychological battery that is administered remotely by video conference and includes: the (MOCA), the Rey Auditory-Verbal List (RAVLT), the Boston Naming Test (30 items), the Semantic Verbal Fluency (animal category), the Phonological Verbal Fluency, the Trail Making Test A (TMTA) and B (TMTB) oral version, the Digit Span Forward and Backward (WAIS-IV), the Clock Drawing Test and the Rey Osterrieth Complex Figure (copy and delayed recall).

The patient group had been assessed via teleNP, using an institutional network, which secured confidentiality. The assessment was completed in a single interview and lasted approximately 40 minutes.

Patient’s Survey

In a separate interview, posterior to the neuropsychological evaluation, patients were invited to participate in a survey. The survey was meant to assess their degree of satisfaction and to collect feedback regarding the previous neuropsychological evaluation.

Patients were asked to use a five-point Likert scale to respond to a series of statements about the testing modalities: “I Strongly Agree, I Agree, Neutral, I Disagree, I Strongly Disagree.” Examples of those statements include: “Overall, I was satisfied with the videoconference testing session,” “The testing instructions during video conference testing were easy to understand,” “I was concerned about my privacy during video conference testing,” and “I felt comfortable with the video conference equipment” are some examples of those statements. Participants were also asked to choose their preferred testing modality and explain why (See Appendix 1 for complete survey in Spanish).

Neuropsychologist’s Survey

A group of neuropsychologists from various centers across the country who used the Fleni-ECaD battery were also invited to participate in a brief survey to rate their experience performing the cognitive assessments via videoconference. Neuropsychologists were asked to use a five-point Likert scale to respond to a series of statements about satisfaction and adaptation: “I Strongly Agree, I Agree, Neutral, I Disagree, I Strongly Disagree.” Examples of those statements include: “I have been satisfied providing videoconference neuropsychological assessments’’, “It has been difficult for me to adapt to the teleNP modality,” “Videoconference evaluations are just as valid/reliable as face-to-face evaluations”, “I have had problems with the sound during video conference evaluations” and “I have had problems with visual quality during video conference evaluations.” The neuropsychologists were also asked to identify their preferred testing modality as well as the advantages and disadvantages of teleNP (See Appendix 2 for the complete survey in Spanish).

Statistical Analysis

The responses to the surveys were pondered using percentages. A Fisher’s chi-square correction test was used to compare the satisfaction across groups.

Results

In the neuropsychological group, 71% had no inconvenience when adapting to the teleNP modality. In addition, 31% of them had connection problems, mainly related to visual quality. Only 22.85% of the neuropsychologists preferred to evaluate face-to-face, and the remaining 74% reported no preferences. The reported main benefits of teleNP were related to the extended practice that allows accessibility in remote, rural, and isolated areas. In addition, 74.3% of the surveyed neuropsychologists reported that the main difficulty is the lack of patients’ familiarity with technology (Figure 1).

Figure 1. Advantages and Disadvantages according to Neuropsychologists.

Source: Authors.

When inquired about the main reason for consultation, patients reported memory problems (70.73%), attention problems (46.34%), and naming (56%). Regarding assessment modality, 50% of the patients indicated no preference concerning the assessment modality, and 35.7% preferred teleNP (Figure 2). Furthermore, 93% of the patients felt comfortable with the videoconferencing equipment and the neuropsychologist, and none of them had any concerns about their privacy (Figure 3). Remarkably, 100% of patients stated that they would recommend teleNP (Figure 5; Table 2).

Figure 2. Patients’ assessment modality.

Source: Authors.

Satisfaction with teleNP was compared across groups, using a Fisher’s chi-square correction, and no significant differences were found (p = 0.112).

Figure 3. Comfort with videoconferencing equipment.

Source: Authors.

Table 2. Survey’s Results.

Variable

Neuropsychologists

Patients

Satisfaction with the assessment.

91.4%

90.3%

Connection problems.

31.42%

Sound problems.

8.56%

Visual quality problems.

17.13%

No concern for privacy.

100%

Would recommend teleNP.

100%

Principal advantage.

Accessibility 77.14%.

Remote areas 94.3%.

Expanded practice 45.7%.

Home comfort 57.14%.

Less anxiety 22%.

Easy to communicate 22%.

Easy to concentrate 22%.

Main difficulty.

Lack of patients’ familiarity with technology 74.3%.

Source: Authors.

Discussion

The goal of this study was to assess patients’ and neuropsychologists’ satisfaction with teleNP, as well as its acceptability and the benefits and drawbacks of its use.

Figure 4. Neuropsychologists’ satisfaction.

Source: Authors.

This study reports that teleNP has high acceptability in both neuropsychologists and patients (Figure 4). The results reflected 91% of satisfaction, with no significant differences between patients and neuropsychologists (p = 0.112). This high degree of satisfaction suggests that this is a practice that will be able to continue and grow in the clinic of neuropsychology. 50% of patients had no preference for the evaluation modality, while 35.7% preferred the teleNP. The principal benefits identified related to teleNP were the accessibility in remote areas (72.4%) and the comfort of the home (57.14%). The main difficulty, according to 74.3% of practitioners, is a lack of familiarity with the technology, while 60% believe the main difficulty is a lack of control over the environment in the patient’s home. These are the first findings on Latin American teleNP acceptability and satisfaction, as well as the perspectives of patients and neuropsychologists.

Similar findings were obtained in a recent paper about the experiences, challenges, and practical advice/solutions regarding teleNP assessment in adults (Fox-Fuller et al., 2022). They discovered the same challenges, such as internet connection problems, environmental distractions in the examinees’ homes (e.g., pets, children, partners, unexpected loud noises), and a lack of familiarity with the technology.

There are some limitations to this study. First, the patients’ group only included adult participants. Including children’s experience with teleNP assessment would add to a more comprehensive perspective. Also, the complete sample (neuropsychologists and patients) was limited to individuals living in Argentina. Thus, the results can only be applied to similar populations. Despite these limitations, the results of this investigation are promising for using teleNP in Latin America.

Future investigations should study and evaluate the experience and degree of satisfaction of individuals who work in remote cognitive assessment with children and teenagers. In addition, comparing the level of satisfaction in LMIC (low and middle-income countries) and high-income countries would also provide interesting knowledge.

Conclusions

In Argentina, cognitive assessment using teleNP has been successfully implemented as an alternative during health emergencies. The findings of this study show that it is well-accepted by both neuropsychologists and patients. The most significant challenges identified are related to connection issues, visual quality, and a lack of familiarity with the technology (Figure 5). The main benefits are related to the ability to reach patients in remote areas (Figure 5). The high level of satisfaction suggests that this practice will continue to grow and serve as a resource after the COVID-19 pandemic is over.

Figure 5. Patients’ satisfaction.

Source: Authors.

Appendix

Appendix 1. Patients Survey in Spanish.

Edad

¿Cuál fue el motivo por el que realizó la evaluación cognitiva? (Marque todo lo que Problemas de atención corresponda).

□ Problemas de memoria.

□ Problemas para nombrar objetos/nombres.

□ Problemas para encontrar palabras.

□ ACV.

□ Enfermedad de Alzheimer.

□ Enfermedad de Parkinson.

□ Epilepsia.

□ Otra enfermedad actual.

□ Antecedentes familiares por enfermedad neurológica.

□ Otro.

En general, quedé satisfecho con la evaluación por videoconferencia.

□ Totalmente en desacuerdo.

□ En desacuerdo.

□ Ni de acuerdo, ni en desacuerdo.

□ De acuerdo.

□ Totalmente de acuerdo.

¿Qué condición de evaluación le gustó más? (Marque uno).

□ Me gustó más la evaluación presencial.

□ Me gustó más la evaluación por videoconferencia.

□ Ambas por igual.

□ Realice únicamente la evaluación presencial.

□ Realice únicamente la evaluación por videoconferencia.

Me sentí cómodo con

el equipo de

video­conferencia.

□ Totalmente en desacuerdo.

□ En desacuerdo.

□ Ni de acuerdo, ni en desacuerdo.

□ De acuerdo.

□ Totalmente de acuerdo.

Las instrucciones de la

evaluación durante la

videoconferencia fueron

fáciles de entender.

□ Si.

□ No.

Estuve preocupado

por mi privacidad

durante la

evaluación por

videoconferencia.

□ Si.

□ No.

Mi comodidad con el

examinador fue la misma

durante la evaluación por

videoconferencia que de

manera presencial.

□ Si.

□ No.

□ Realice únicamente evaluación presencial.

□ Realice únicamente evaluación por videoconferencia.

¿Recomendaría la evaluación cognitiva

por video­conferencia

a otros?

□ Si.

□ No.

¿Qué le gustó de la

evaluación presencial?

(Marque todo lo que

corresponda).

□ Es más fácil establecer una conexión personal con el examinador.

□ Es más fácil comunicarse con el examinador cuando estamos en la misma habitación.

□ Es más fácil manipular los materiales de la evaluación.

□ No realicé evaluación presencial.

¿Qué le gustó de la

evaluación por

videoconferencia?

(Marque todas las

opciones que

correspondan).

□ Se sintió menos ansioso/nervioso sin un examinador en la habitación.

□ Es más fácil comunicarse con el examinador por videoconferencia.

□ Es más fácil concentrarse sin un examinador en la sala.

□ El equipo de videoconferencia hizo que la evaluación fuera más interesante y/o divertida.

Si necesitara ver a un

psicólogo para este tipo de

pruebas, ¿cuánto tiempo

estaría dispuesto a viajar

para realizar la evaluación

en modalidad presencial?

Por favor marque solo una

respuesta.

□ Menos de 1 hora 1-3 horas.

□ 3-6 horas.

□ Manejaría / viajaría tan lejos como fuera necesario y pasaría la noche, si fuera necesario.

□ Preferiría no viajar y realizar una evaluación por videoconferencia.

Source: Authors.

Appendix 2. Neuropsychologists Survey in Spanish.

Edad

¿Se ha sentido cómodo/a realizando evaluaciones cognitivas por video­conferencia?

□ Si.

□ No.

He quedado satisfecho/a con las evaluaciones cognitivas por video­conferencia.

□ Totalmente en desacuerdo cognitivas por video­conferencia.

□ En desacuerdo.

□ Ni de acuerdo, ni en desacuerdo.

□ De acuerdo.

□ Totalmente de acuerdo.

Me ha costado adaptarme a la modalidad de Teleneuropsicología.

□ Totalmente en desacuerdo cognitivas por videoconferencia.

□ En desacuerdo.

□ Ni de acuerdo, ni en desacuerdo.

□ De acuerdo.

□ Totalmente de acuerdo.

Las instrucciones de la evaluación por video­conferencia, ¿le resultaron fáciles de explicar?

□ Si.

□ No.

¿Tuvo problemas con la conexión a la plataforma de Tele­neuropsicología?

□ Nunca.

□ Raramente.

□ Ocasionalmente.

□ Frecuentemente.

□ Muy frecuentemente.

¿Qué plataforma utilizó? (Marque todas las que correspondan).

□ ZOOM.

□ MEET.

□ SKYPE.

□ Plataforma institucional.

He tenido problemas con el sonido durante las evaluaciones por videoconferencia.

□ Totalmente en desacuerdo cognitivas por video­conferencia.

□ En desacuerdo.

□ Ni de acuerdo, ni en desacuerdo.

□ De acuerdo.

□ Totalmente de acuerdo.

He tenido problemas con la calidad visual durante las evaluaciones por videoconferencia.

□ Totalmente en desacuerdo cognitivas por videoconferencia.

□ En desacuerdo.

□ Ni de acuerdo, ni en desacuerdo.

□ De acuerdo.

□ Totalmente de acuerdo.

Las evaluaciones por videoconferencia son igual de válidas/fiables que las evaluaciones presenciales.

□ Totalmente en desacuerdo cognitivas por video­conferencia.

□ En desacuerdo.

□ Ni de acuerdo, ni en desacuerdo.

□ De acuerdo.

□ Totalmente de acuerdo.

¿Piensa que en el futuro próximo la Teleneuropsicología podrá ser integrada fácilmente al servicio de prestación de salud?

□ Si.

□ No.

¿Qué tipo de evaluación prefiere realizar?

□ Evaluación presencial.

□ Evaluación por video­conferencia.

□ Ambas.

Para usted, ¿cuáles de estos beneficios o ventajas cree que tiene la Tele­neuropsicología? (Marque todos los que correspondan).

□ Accesibilidad.

□ Facilidad de llegar a las zonas lejanas.

□ Costo del transporte.

□ Satisfacción del paciente.

□ Práctica ampliada.

□ Facilidad de programación de la cita.

□ Comodidad del paciente en el entorno del hogar.

¿Y cuáles de estas desventajas cree que tiene la Teleneuropsicología? (Marque todas las que correspondan).

□ Costo de la tecnología del hogar.

□ Dificultades tecnológicas.

□ Familiaridad del paciente con la tecnología.

□ Falta de control del entorno.

□ Ansiedad/incomodidad con la tecnología.

□ Comunicación/señales no verbales.

□ Manejo de emergencias.

¿Tiene alguna sugerencia para la Tele­­neuropsicología?

Source: Authors.

Contributor Roles

Micaela Maria Arruabarrena: Conceptualization, Investigation, Project administration, Writing-original draft.

Maria Eugenia Martin: Conceptualization, Investigation, Resources.

Ismael Luis Calandri: Formal analysis, Investigation.

Nicolas Corvalan: Formal analysis, Visualization.

Maria Belen Helou: Conceptualización, Resources.

Carlos Martinez Canyazo: Conceptualization, Resources.

Crivelli Lucia: Conceptualization, Investigation, Project administration, Writing-original draft, Supervision.

References

Bilder, R. M.; Postal, K. S.; Barisa, M.; Aase, D. M.; Cullum, C. M.; Gillaspy, S. R.; Harder, L.; Kanter, G.; Lanca, M.; Lechuga, D. M.; Morgan, J. M.; Most, R.; Puente, A. E.; Salinas, C. M. & Woodhouse, J. (2020). Inter Organizational Practice Committee Recommendations/Guidance for TeleNeuropsychology in Response to the COVID-19 Pandemic. Archives of clinical neuropsychology: the official journal of the National Academy of Neuropsychologists, 35(6), 647659.

https://doi.org/10.1093/arclin/acaa046

Calandri, I. L.; Hawkes, M. A.; Marrodan, M.; Ameriso, S. F.; Correale, J. & Allegri, R. F. (2021). Changes in the Care of Neurological Diseases During the First Wave of the COVID-19 Pandemic: A Single Private Center Study in Argentina. Frontiers in Neurology, 12, 18.

https://doi.org/10.3389/fneur.2021.613838

Chappell, N. L. & Zimmer, Z. (1999). Receptivity to new technology among older adults. Disability and Rehabilitation, 21(5-6), 222230.

https://doi.org/10.1080/096382899297648

CNSS. (2010). National information assurance (IA) glossary. Retrieved from https://www.cnss.gov/cnss/

Crivelli, L.; Quiroz, Y. T.; Calandri, I. L.; Martin, M. E.; Velilla, L. M.; Cusicanqui, M. I.; Coto, F.; Llibre-Rodríguez, J. J.; Armele, M.; Román, F.; Barceló, E.; Dechent, C.; Agostina, M.; Olavarría, L.; Yassuda, M. S.; Custodio, N.; Dansilio, S.; Sosa, A. L.; Acosta, D. M.; Brucki, S. M. D.; Caramelli, P.; Slachevsky, A.; Nitrini, R.; Carrillo, M. C. & Allegri, R. F. (2021). Working Group Recommendations for the Practice of Teleneuropsychology in Latin America. Archives of Clinical Neuropsychology, 37(3), 553567

https://doi.org/10.1093/arclin/acab080

Cullum, M. C.; Hynan, L. S; Grosch, M.; Parikh, M. & Weiner, M. F. (2014). Teleneuropsychology: Evidence for Video Teleconference-Based Neuropsychological Assessment. Journal of the International Neuropsychological Society, 20(10), 10281033.

http://dx.doi.org/10.1017/S1355617714000873

Elwood, D. L. & Griffin, R. (1972). Individual intelligence testing without the examiner. Journal of Consulting and Clinical Psychology, 38(1), 914.

https://doi.org/10.1037/h0032416

Fox-Fuller, J. T.; Rizer, S.; Andersen, S. L. & Sunderaraman, P. (2022). Survey Findings About the Experiences, Challenges, and Practical Advice/Solutions Regarding Teleneuropsychological Assessment in Adults. Archives of clinical neuropsychology: the official journal of the National Academy of Neuropsychologists, 37(2), 274291.

https://doi.org/10.1093/arclin/acab076

Galusha-Glasscock, J. M.; Horton, D. K.; Weiner, M. F. & Cullum, C. M. (2016). Video Teleconference Administration of the Repeatable Battery for the Assessment of Neuropsychological Status. Archives of clinical neuropsychology: the official journal of the National Academy of Neuropsychologists, 31(1), 811.

https://doi.org/10.1093/arclin/acv058

Harrell, K. M.; Wilkins, S. S.; Connor, M. K. & Chodosh, J. (2014). Telemedicine and the Evaluation of Cognitive Impairment: The Additive Value of Neuropsychological Assessment. Journal of the American Medical Directors Association, 15(8), 600606.

https://doi.org/10.1016/j.jamda.2014.04.015

Morris, A.; Goodman-Deane, J. & Brading, H. (2007). Internet use and non-use: Views of older users. Universal Access in the Information Society, 6, 4357.

https://doi.org/10.1007/s10209-006-0057-5

Rentz, D. M.; Dekhtyar, M.; Sherman, J.; Burnham, S.; Blacker, D.; Aghjayan, S. L.; Papp, K. V.; Amariglio, R. E.; Schembri, A.; Chenhall, T.; Maruff, P.; Aisen, P.; Hyman, B. T. & Sperling, R. A. (2016). The Feasibility of At-Home iPad Cognitive Testing For Use in Clinical Trials. The journal of prevention of Alzheimer´s disease, 3(1), 812.

https://doi.org/10.14283/jpad.2015.78

Soto-Pérez, F.; Franco, M. y Jiménez, F. (2010). Tecnologías y neuropsicología: Hacia una ciber-neuropsicología. Cuadernos de Neuropsicología, 4(2), 112130.

https://www.cnps.cl/index.php/cnps/article/view/106

Stricker, N. H.; Lundt, E. S.; Alden, E. C.; Albertson, S. M.; Machulda, M. M.; Kremers, W. K.; Knopman, D. S.; Petersen, R. C. & Mielke, M. M. (2020). Longitudinal Comparison of in clinic and at Home Administration of the Cogstate Brief Battery and Demonstrated Practice Effects in the Mayo Clinic Study of Aging. The journal of prevention of Alzheimer´s disease, 7(1), 2128.

https://doi.org/10.14283/jpad.2019.35

Wadsworth, H. E.; Dhima, K.; Womack, K. B.; Hart, J.; Weiner, M. F.; Hynan, L. S. & Cullum, C. M. (2018). Validity of TeleNeuropsychological Assessment in Older Patients with Cognitive Disorders. Archives of Clinical Neuropsychology. 33(8), 10401045.

https://doi.org/10.1093/arclin/acx140

1 Servicio de Neurología Cognitiva, Neuropsicología y Neuropsiquiatría. Fleni, Buenos Aires, Argentina. Correo de contacto: mica.arruabarrena@gmail.com. ORCID: https://orcid.org/0000-0001-6193-1683

2 Servicio de Neurología Cognitiva, Neuropsicología y Neuropsiquiatría, Fleni. Buenos Aires, Argentina. ORCID: https://orcid.org/0000-00001-5757-5938

3 Servicio de Neurología Cognitiva, Neuropsicología y Neuropsiquiatría, Fleni. Buenos Aires, Argentina. ORCID: https://orcid.org/0000-0002-6983-1430

4 Servicio de Neurología Cognitiva, Neuropsicología y Neuropsiquiatría, Fleni. Buenos Aires, Argentina. ORCID: https://orcid.org/0000-0002-1437-0446

5 Servicio de Neurología Cognitiva, Neuropsicología y Neuropsiquiatría, Fleni. Buenos Aires, Argentina. ORCID: https://orcid.org/0000-0001-5513-010X

6 Servicio de Neurología Cognitiva, Neuropsicología y Neuropsiquiatría, Fleni. Buenos Aires, Argentina. ORCID: https://orcid.org/0000-0001-7055-5624

7 Instituto de Neurociencias Fleni-CONICET. Buenos Aires, Argentina. ORCID: https://orcid.org/0000-0002-0083-9389