ACAudrey Carillo

Audrey Carillo

*This is an algorithmically generated author record based on publicly available information.

Audrey Carillo has a total of 4 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Remote Clinical Neuropsychological Assessment Using Portable Automated Rapid Testing (PART): Validation in a Healthy Older Adult Population (Preprint)

    by Quentin Coppola, Lakshmi Kannan, Audrey Carillo, Susanne M. Jaeggi, Aaron R. Seitz

    Background: Remote, scalable cognitive assessment could improve detection and longitudinal monitoring of age-related cognitive change, but few studies have validated comprehensive digital neuropsychological batteries administered entirely at home. Objective: This study aims to evaluate the feasibility, acceptability, and short-term test-retest reliability of a remotely delivered digital neuropsychological battery (portable automated rapid testing [PART]) in cognitively healthy older adults. Methods: We screened 82 English-speaking, cognitively healthy older adults aged 50 to 85 years and mailed configured tablets to participants. Researchers remotely administered a battery of neuropsychological assessments spanning language fluency (Boston Naming Test, verbal fluency: letter “F,” supermarket items, and animals), memory (verbal paired associates, word list recall, and logical memory recall), praxis memory (clock drawing and constructional praxis [CP]), and executive functioning (trail making test [TMT]) using the PART app twice, approximately 1 month apart. Task comfortability was summarized with a comfort index based on participants’ self-reports after completing each task. Reliability analyses included paired t tests to detect group-level shifts in performance, Pearson correlations for short-term stability, and Bland-Altman limits of agreement (LoA) to quantify bias and within-person variability. Performance across all tasks was also compared to comparative samples from large normative studies using equivalent paper-and-pencil versions of these tasks. Results: A total of 72 participants completed the first time point (T1), 64 completed the second time point (T2), and the analytic sample comprised a total of 63 participants. Overall comfort was high across sessions (mean comfort index was 88% at T1 and 84% at T2). Memory and executive function measures showed moderate test-retest correlations (r=0.39-0.73), while clock drawing and CP showed low or nonsignificant associations, likely due to ceiling effects. Paired tests indicated small but significant practice effects for verbal paired associates (t62=−3.10; P=.003) and word list (t57=−2.50; P=.02), with substantial practice effects for logical memory (story A: t56=−2.95; P=.005) and TMT part A (t50=−3.97; P<.001) and part B (t42=−2.05; P=.05). Bland-Altman analyses revealed minimal mean bias for many tasks but notably wide LoA for TMT (part A: LoA=−44.7 to 29.2 seconds; part B: LoA=−78.1 to 57.9 seconds). Importantly, in descriptive comparisons, our sample generally overlapped within ±1 SD of the medians in comparative paper-and-pencil normative samples. Conclusions: PART was well tolerated among healthy older adults and reproduces group-level normative patterns with moderate short-term reliability for several conventional measures. However, nontrivial within-person variability, practice effects, ceiling effects, and wide LoAs for some measures (eg, TMT, CP, and clock drawing) limit interpretation of individual change. Future work should validate alternative digital outcome metrics (eg, stylus interactions and speech recordings), extend sampling to more diverse and lower-education cohorts, and evaluate more ecologically valid designs to improve sensitivity for detecting meaningful within-person cognitive fluctuations.


  • Open Access

    Remote Clinical Neuropsychological Assessment Using Portable Automated Rapid Testing (PART): Validation in a Healthy Older Adult Population (Preprint)

    by Quentin Coppola, Lakshmi Kannan, Audrey Carillo, Susanne M. Jaeggi, Aaron R. Seitz

    BACKGROUND Remote, scalable cognitive assessment could improve detection and longitudinal monitoring of age-related cognitive change, but few studies have validated comprehensive digital neuropsychological batteries administered entirely at home. OBJECTIVE To evaluate the feasibility, acceptability, and short-term test–retest reliability of a remotely delivered digital neuropsychological battery (Portable Automated Rapid Testing; PART) in cognitively healthy older adults. METHODS We screened 82 English-speaking, cognitively healthy older adults aged 50–85 and mailed configured tablets to participants. Researchers remotely administered a battery of neuropsychological assessments spanning language fluency (Boston naming test, verbal fluency: letter “F”, supermarket items, animals), memory (verbal paired associates, word list recall, logical memory recall), praxis memory (clock drawing, constructional praxis), and executive functioning (trail making test) using the Portable Automated Rapid Testing app twice approximately one month apart. Task tolerability was summarized with a comfort index based on participants' self-reports after completing each task. Reliability analyses included paired t-tests to detect group-level shifts in performance, Pearson correlations for short term stability, and Bland–Altman limits of agreement (LoA) to quantify bias and within-person variability. Performance across all tasks was also compared to comparative samples from large normative studies using equivalent paper-and-pencil versions of these tasks. RESULTS 73 completed the first timepoint (T1), 64 completed the second (T2), and the analytic sample comprised N = 63. Overall tolerability was high, as over 75% of participants rated tasks comfortable. Memory and executive function measures showed moderate-to-high test–retest correlations (r range = 0.39–0.73); ns t-tests), while clock drawing and constructional praxis showed low or non-significant associations likely due to ceiling effects. Paired tests indicated small but significant practice/improvement effects for logical memory (Story A: t56 = −2.95, p < 0.01), verbal paired associates (t60 = −3.10, p<0.01), word list (t57 = −2.50, p = 0.02), and trail making part A (t50 = −3.97, p < 0.01) and Part B (t42 = −2.05, p = 0.05). Bland–Altman analyses revealed minimal mean bias for many tasks but notably wide LoA for TMT (Part A: LoA = −44.7 to 29.2 seconds; Part B: LoA = −78.1 to 57.9 seconds). Importantly, medians and quartiles of our sample overlapped within plus or minus one standard deviation of the medians of comparative paper-and-pencil normative in comparable samples. CONCLUSIONS PART was well tolerated among healthy older adults and reproduces group-level normative patterns with moderate-to-high short-term reliability for several conventional measures. However, non-trivial within-person variability, practice effects, ceiling effects, and wide limits of agreement for some measures (e.g., TMT, constructional praxis, and clock drawing) limit interpretation of individual change. Future work should validate alternative digital outcome metrics (e.g., stylus interactions, speech recordings), extend sampling to more diverse and lower-education cohorts, and evaluate more ecologically valid designs to improve sensitivity for detecting meaningful within-person cognitive fluctuations.