Search

Introduction: To facilitate large-scale assessment of a variety of cognitive abilities in clinical studies, we developed a self-administered online neuropsychological test battery: the Amsterdam Cognition Scan (ACS). The current studies evaluate in a group of adult cancer patients: test–retest reliability of the ACS and the influence of test setting (home or hospital), and the relationship between our online and a traditional test battery (concurrent validity).Method: Test–retest reliability was studied in 96 cancer patients (57 female;Mage = 51.8 years) who completed the ACS twice. Intraclass correlation coefficients (ICCs) were used to assess consistency over time. The test setting was counterbalanced between home and hospital; influence on test performance was assessed by repeated measures analyses of variance. Concurrent validity was studied in 201 cancer patients (112 female;Mage = 53.5 years) who completed both the online and an equivalent traditional neuropsychological test battery. Spearman or Pearson correlations were used to assess consistency between online and traditional tests.Results: ICCs of the online tests ranged from .29 to .76, with an ICC of .78 for the ACS total score. These correlations are generally comparable with the test–retest correlations of the traditional tests as reported in the literature. Correlating online and traditional test scores, we observed medium to large concurrent validity (r/ρ = .42 to .70; total scorer = .78), except for a visuospatial memory test (ρ = .36). Correlations were affected—as expected—by design differences between online tests and their offline counterparts.Conclusions: Although development and optimization of the ACS is an ongoing process, and reliability can be optimized for several tests, our results indicate that it is a highly usable tool to obtain (online) measures of various cognitive abilities. The ACS is expected to facilitate efficient gathering of data on cognitive functioning in the near future. [ABSTRACT FROM AUTHOR]

Objective:Online neuropsychological test batteries could allow for large-scale cognitive data collection in clinical studies. However, the few online neuropsychological test batteries that are currently available often still require supervision or lack proper psychometric evaluation. In this paper, we have outlined prerequisites for proper development and use of online neuropsychological tests, with the focus on reliable measurement of cognitive function in an unmonitored setting.Method:First, we identified several technical, contextual, and psychological factors that should be taken into account in order to facilitate reliable test results of online tests in the unmonitored setting. Second, we outlined a methodology of quality assurance needed in order to obtain reliable cognitive data in the long run.Results:Based on factors that distinguish the online unmonitored test setting from the traditional face-to-face setting, we provide a set of basic requirements and suggestions for optimal development and use of unmonitored online neuropsychological tests, including suggestions on acquiring reliability, validity, and norm scores.Conclusions:When properly addressing factors that could hamper reliable test results during development and use, online neuropsychological tests could aid large-scale data collection for clinical studies in the future. Investment in both proper development of online neuropsychological test platforms and the performance of accompanying psychometric studies is currently required. [ABSTRACT FROM AUTHOR]