Kelly M. Ramsey

UNSTRUCTURED This article describes the development, implementation, evaluation, and optimization of the COVID Coach app, a mobile application created by the National Center for PTSD (NC-PTSD) to help people cope with trauma and stressor-related symptoms associated with the COVID-19 pandemic. Using the PTSD Coach as a foundation, NC-PTSD rapidly developed COVID Coach in the spring of 2020 as a key aspect of both the VA and the nation’s pandemic response. It was disseminated widely through both public and VA channels. Based on our research and evaluation of the app, we have concluded that COVID Coach was well-received and popular during the pandemic. Reductions in anxiety, depression and burnout were mixed; however, as late as 2025 COVID Coach retained a loyal long-term user base with high engagement and a user retention rate comparable to that of NC-PTSD’s most popular apps. Research and evaluation data suggests that there is a case for continued sustainment and improvement of COVID Coach, thus this article describes the optimization and transition of COVID Coach into Coping Coach, a coping and stress management tool designed to prevent and target trauma and stressor-related symptoms in those who may not identify with a formal diagnosis like PTSD.

Background: Military sexual trauma (MST) can have significant adverse effects on mental health and well-being, often leading to posttraumatic stress disorder (PTSD) symptoms and maladaptive beliefs. Although effective psychotherapies exist, stigma, confidentiality concerns, and systemic barriers often hinder help-seeking among service members and veterans. Mobile mental health apps offer an accessible and anonymous support alternative, potentially addressing such barriers. However, app effectiveness depends on user engagement and emerging evidence suggests that engagement may be shaped by symptom severity. Objective: This retrospective observational study aimed to explore the relationship between posttraumatic symptom severity and user engagement with Beyond MST (US Department of Veterans Affairs [VA] National Center for PTSD), an app for individuals who experienced MST. Specific aims included (1) characterizing trauma-related symptom levels and app engagement among users who completed in-app assessments, and (2) evaluating how PTSD symptom severity, negative posttraumatic cognitions, and mental well-being relate to objective measures of engagement. Methods: Anonymous usage data from 27,517 users collected between March 11, 2021 and July 29, 2024, were analyzed. Three subsamples were identified: those who completed the in-app PTSD checklist for DSM-5 (Diagnostic and Statistical Manual of Mental Disorders [Fifth Edition]; PCL-5, n=3689), the Posttraumatic Maladaptive Beliefs Scale (PMBS; n=2197), and the Warwick-Edinburgh Mental Well-Being Scale (WEMWBS; n=2160). Engagement metrics included duration of use (ie, days of use and minutes of use), frequency of feature access (ie, coping tool and psychoeducation access), and frequency of feature use (ie, total assessment completions). Regression analyses, including quadratic terms, were conducted to evaluate how symptom severity and well-being levels influenced engagement and identify possible curvilinear trends. Results: Median engagement levels ranged across subsamples as follows: 3-4 days of use (IQR 5-6), 22-30 minutes of use (IQR 33.7-42.9), 1-5 feature accesses (IQR 6-9), and 2-3 assessment completions (IQR 2). Subsamples were highly symptomatic. Analyses revealed that moderate PTSD symptom and negative posttraumatic cognition severity were associated with higher engagement relative to users with very low and very high symptom levels, particularly for days of use and frequency of coping tool access. Conversely, higher mental well-being scores were generally linked to increased app engagement with linear effects. Effect sizes were small, suggesting limited clinical impact. Conclusions: This study highlights the possible challenges in engaging highly symptomatic individuals with digital mental health interventions. Although Beyond MST successfully reaches its targeted population, very low or high symptom levels and lower well-being may hinder sustained engagement. These findings suggest that symptom levels should be considered in app development (ie, personalization) and when integrating apps into professional care. Interpretation is limited by the anonymous nature of the data, which prevented characterization of users and their trauma histories. Further research is needed to clarify how symptom patterns influence engagement, especially in trauma contexts. International Registered Report Identifier (IRRID): RR2-10.31979/etd.882a-5fcx

BACKGROUND Military sexual trauma (MST) can have significant adverse effects on mental health and well-being, often leading to posttraumatic stress disorder (PTSD) symptoms and maladaptive beliefs. Although effective psychotherapies exist, stigma, confidentiality concerns, and systemic barriers often hinder help-seeking among service members and veterans. Mobile mental health apps offer an accessible and anonymous support alternative, potentially addressing such barriers. However, app effectiveness depends on user engagement and emerging evidence suggests that engagement may be shaped by symptom severity. OBJECTIVE This retrospective observational study aimed to explore the relationship between posttraumatic symptom severity and user engagement with Beyond MST (US Department of Veterans Affairs [VA] National Center for PTSD), an app for individuals who experienced MST. Specific aims included (1) characterizing trauma-related symptom levels and app engagement among users who completed in-app assessments, and (2) evaluating how PTSD symptom severity, negative posttraumatic cognitions, and mental well-being relate to objective measures of engagement. METHODS Anonymous usage data from 27,517 users collected between March 11, 2021 and July 29, 2024, were analyzed. Three subsamples were identified: those who completed the in-app PTSD checklist for DSM-5 (Diagnostic and Statistical Manual of Mental Disorders [Fifth Edition]; PCL-5, n=3689), the Posttraumatic Maladaptive Beliefs Scale (PMBS; n=2197), and the Warwick-Edinburgh Mental Well-Being Scale (WEMWBS; n=2160). Engagement metrics included duration of use (ie, days of use and minutes of use), frequency of feature access (ie, coping tool and psychoeducation access), and frequency of feature use (ie, total assessment completions). Regression analyses, including quadratic terms, were conducted to evaluate how symptom severity and well-being levels influenced engagement and identify possible curvilinear trends. RESULTS Median engagement levels ranged across subsamples as follows: 3-4 days of use (IQR 5-6), 22-30 minutes of use (IQR 33.7-42.9), 1-5 feature accesses (IQR 6-9), and 2-3 assessment completions (IQR 2). Subsamples were highly symptomatic. Analyses revealed that moderate PTSD symptom and negative posttraumatic cognition severity were associated with higher engagement relative to users with very low and very high symptom levels, particularly for days of use and frequency of coping tool access. Conversely, higher mental well-being scores were generally linked to increased app engagement with linear effects. Effect sizes were small, suggesting limited clinical impact. CONCLUSIONS This study highlights the possible challenges in engaging highly symptomatic individuals with digital mental health interventions. Although Beyond MST successfully reaches its targeted population, very low or high symptom levels and lower well-being may hinder sustained engagement. These findings suggest that symptom levels should be considered in app development (ie, personalization) and when integrating apps into professional care. Interpretation is limited by the anonymous nature of the data, which prevented characterization of users and their trauma histories. Further research is needed to clarify how symptom patterns influence engagement, especially in trauma contexts. CLINICALTRIAL INTERNATIONAL REGISTERED REPORT RR2-10.31979/etd.882a-5fcx

Background: Although the COVID-19 pandemic has not led to a uniform increase of mental health concerns among older adults, there is evidence to suggest that some older veterans did experience an exacerbation of preexisting mental health conditions, and that mental health difficulties were associated with a lack of social support and increasing numbers of pandemic-related stressors. Mobile mental health apps are scalable, may be a helpful resource for managing stress during the pandemic and beyond, and could potentially provide services that are not accessible due to the pandemic. However, overall comfort with mobile devices and factors influencing the uptake and usage of mobile apps during the pandemic among older veterans are not well known. COVID Coach is a free, evidence-informed mobile app designed for pandemic-related stress. Public usage data have been evaluated; however, the uptake and usage of the app among older veterans have not been explored. Objective: The purpose of this study was to characterize smartphone ownership rates among US veterans, identify veteran characteristics associated with downloading and use of COVID Coach, and characterize key content usage within the app. Methods: Data were analyzed from the 2019-2020 National Health and Resilience in Veterans Study (NHRVS), which surveyed a nationally representative, prospective cohort of 3078 US military veterans before and 1 year into the pandemic. The NHRVS sample was drawn from KnowledgePanel, a research panel of more than 50,000 households maintained by Ipsos, Inc. The median time to complete the survey was nearly 32 minutes. The research version of COVID Coach was offered to all veterans who completed the peripandemic follow-up assessment on a mobile device (n=814; weighted 34.2% of total sample). App usage data from all respondents who downloaded the app (n=34; weighted 3.3% of the mobile completers sample) were collected between November 14, 2020, and November 7, 2021. Results: We found that most US veterans (81.5%) own smartphones, and that veterans with higher education, greater number of adverse childhood experiences, higher extraversion, and greater severity of pandemic-related posttraumatic stress disorder symptoms were more likely to download COVID Coach. Although uptake and usage of COVID Coach were relatively low (3.3% of eligible participants, n=34), 50% of the participants returned to the app for more than 1 day of use. The interactive tools for managing stress were used most frequently. Conclusions: The COVID-19 pandemic has increased the need for and creation of digital mental health tools. However, these resources may require tailoring for older veteran populations. Future research is needed to better understand how to optimize digital mental health tools such as apps to ensure uptake and usage among older adults, particularly those who have experienced traumas across the lifespan.

Background: With widespread smartphone ownership, mobile health apps (mHealth) can expand access to evidence-based interventions for mental health conditions, including posttraumatic stress disorder (PTSD). Research to evaluate new features and capabilities in these apps is critical but lags behind app development. The initial release of PTSD Coach, a free self-management app developed by the US Departments of Veterans Affairs and Defense, was found to have a positive public health impact. However, major stakeholder-driven updates to the app have yet to be evaluated. Objective: We aimed to characterize the reach, use, and potential impact of PTSD Coach Version 3.1 in the general public. As part of characterizing use, we investigated the use of specific app features, which extended previous work on PTSD Coach. Methods: We examined the naturalistic use of PTSD Coach during a 1-year observation period between April 20, 2020, and April 19, 2021, using anonymous in-app event data to generate summary metrics for users. Results: During the observation period, PTSD Coach was broadly disseminated to the public, reaching approximately 150,000 total users and 20,000 users per month. On average, users used the app 3 times across 3 separate days for 18 minutes in total, with steep drop-offs in use over time; a subset of users, however, demonstrated high or sustained engagement. More than half of users (79,099/128,691, 61.46%) accessed one or more main content areas of the app (ie, Manage Symptoms, Track Progress, Learn, or Get Support). Among content areas, features under Manage Symptoms (including coping tools) were accessed most frequently, by over 40% of users (53,314/128,691, 41.43% to 56,971/128,691, 44.27%, depending on the feature). Users who provided initial distress ratings (56,971/128,691, 44.27%) reported relatively high momentary distress (mean 6.03, SD 2.52, on a scale of 0-10), and the use of a coping tool modestly improved momentary distress (mean −1.38, SD 1.70). Among users who completed at least one PTSD Checklist for DSM-5 (PCL-5) assessment (17,589/128,691, 13.67%), PTSD symptoms were largely above the clinical threshold (mean 49.80, SD 16.36). Among users who completed at least two PCL-5 assessments (4989/128,691, 3.88%), PTSD symptoms decreased from the first to last assessment (mean −4.35, SD 15.29), with approximately one-third (1585/4989, 31.77%) of these users experiencing clinically significant improvements. Conclusions: PTSD Coach continues to fulfill its mission as a public health resource. Version 3.1 compares favorably with version 1 on most metrics related to reach, use, and potential impact. Although benefits appear modest on an individual basis, the app provides these benefits to a large population. For mHealth apps to reach their full potential in supporting trauma recovery, future research should aim to understand the utility of individual app features and identify strategies to maximize overall effectiveness and engagement.

BACKGROUND Although the COVID-19 pandemic has not led to a uniform increase of mental health concerns among older adults, there is evidence to suggest that some older veterans did experience an exacerbation of preexisting mental health conditions, and that mental health difficulties were associated with a lack of social support and increasing numbers of pandemic-related stressors. Mobile mental health apps are scalable, may be a helpful resource for managing stress during the pandemic and beyond, and could potentially provide services that are not accessible due to the pandemic. However, overall comfort with mobile devices and factors influencing the uptake and usage of mobile apps during the pandemic among older veterans are not well known. COVID Coach is a free, evidence-informed mobile app designed for pandemic-related stress. Public usage data have been evaluated; however, the uptake and usage of the app among older veterans have not been explored. OBJECTIVE The purpose of this study was to characterize smartphone ownership rates among US veterans, identify veteran characteristics associated with downloading and use of COVID Coach, and characterize key content usage within the app. METHODS Data were analyzed from the 2019-2020 National Health and Resilience in Veterans Study (NHRVS), which surveyed a nationally representative, prospective cohort of 3078 US military veterans before and 1 year into the pandemic. The NHRVS sample was drawn from KnowledgePanel, a research panel of more than 50,000 households maintained by Ipsos, Inc. The median time to complete the survey was nearly 32 minutes. The research version of COVID Coach was offered to all veterans who completed the peripandemic follow-up assessment on a mobile device (n=814; weighted 34.2% of total sample). App usage data from all respondents who downloaded the app (n=34; weighted 3.3% of the mobile completers sample) were collected between November 14, 2020, and November 7, 2021. RESULTS We found that most US veterans (81.5%) own smartphones, and that veterans with higher education, greater number of adverse childhood experiences, higher extraversion, and greater severity of pandemic-related posttraumatic stress disorder symptoms were more likely to download COVID Coach. Although uptake and usage of COVID Coach were relatively low (3.3% of eligible participants, n=34), 50% of the participants returned to the app for more than 1 day of use. The interactive tools for managing stress were used most frequently. CONCLUSIONS The COVID-19 pandemic has increased the need for and creation of digital mental health tools. However, these resources may require tailoring for older veteran populations. Future research is needed to better understand how to optimize digital mental health tools such as apps to ensure uptake and usage among older adults, particularly those who have experienced traumas across the lifespan.

BACKGROUND With widespread smartphone ownership, mobile health apps (mHealth) can expand access to evidence-based interventions for mental health conditions, including posttraumatic stress disorder (PTSD). Research to evaluate new features and capabilities in these apps is critical but lags behind app development. The initial release of PTSD Coach, a free self-management app developed by the US Departments of Veterans Affairs and Defense, was found to have a positive public health impact. However, major stakeholder-driven updates to the app have yet to be evaluated. OBJECTIVE We aimed to characterize the reach, use, and potential impact of PTSD Coach Version 3.1 in the general public. As part of characterizing use, we investigated the use of specific app features, which extended previous work on PTSD Coach. METHODS We examined the naturalistic use of PTSD Coach during a 1-year observation period between April 20, 2020, and April 19, 2021, using anonymous in-app event data to generate summary metrics for users. RESULTS During the observation period, PTSD Coach was broadly disseminated to the public, reaching approximately 150,000 total users and 20,000 users per month. On average, users used the app 3 times across 3 separate days for 18 minutes in total, with steep drop-offs in use over time; a subset of users, however, demonstrated high or sustained engagement. More than half of users (79,099/128,691, 61.46%) accessed one or more main content areas of the app (ie, Manage Symptoms, Track Progress, Learn, or Get Support). Among content areas, features under Manage Symptoms (including coping tools) were accessed most frequently, by over 40% of users (53,314/128,691, 41.43% to 56,971/128,691, 44.27%, depending on the feature). Users who provided initial distress ratings (56,971/128,691, 44.27%) reported relatively high momentary distress (mean 6.03, SD 2.52, on a scale of 0-10), and the use of a coping tool modestly improved momentary distress (mean −1.38, SD 1.70). Among users who completed at least one PTSD Checklist for DSM-5 (PCL-5) assessment (17,589/128,691, 13.67%), PTSD symptoms were largely above the clinical threshold (mean 49.80, SD 16.36). Among users who completed at least two PCL-5 assessments (4989/128,691, 3.88%), PTSD symptoms decreased from the first to last assessment (mean −4.35, SD 15.29), with approximately one-third (1585/4989, 31.77%) of these users experiencing clinically significant improvements. CONCLUSIONS PTSD Coach continues to fulfill its mission as a public health resource. Version 3.1 compares favorably with version 1 on most metrics related to reach, use, and potential impact. Although benefits appear modest on an individual basis, the app provides these benefits to a large population. For mHealth apps to reach their full potential in supporting trauma recovery, future research should aim to understand the utility of individual app features and identify strategies to maximize overall effectiveness and engagement. CLINICALTRIAL

Background: The COVID-19 pandemic has significantly impacted mental health and well-being. Mobile mental health apps can be scalable and useful tools in large-scale disaster responses and are particularly promising for reaching vulnerable populations. COVID Coach is a free, evidence-informed mobile app designed specifically to provide tools and resources for addressing COVID-19–related stress. Objective: The purpose of this study was to characterize the overall usage of COVID Coach, explore retention and return usage, and assess whether the app was reaching individuals who may benefit from mental health resources. Methods: Anonymous usage data collected from COVID Coach between May 1, 2020, through October 31, 2020, were extracted and analyzed for this study. The sample included 49,287 unique user codes and 3,368,931 in-app events. Results: Usage of interactive tools for coping and stress management comprised the majority of key app events (n=325,691, 70.4%), and the majority of app users tried a tool for managing stress (n=28,009, 58.8%). COVID Coach was utilized for ≤3 days by 80.9% (n=34,611) of the sample whose first day of app use occurred within the 6-month observation window. Usage of the key content in COVID Coach predicted returning to the app for a second day. Among those who tried at least one coping tool on their first day of app use, 57.2% (n=11,444) returned for a second visit; whereas only 46.3% (n=10,546) of those who did not try a tool returned (P<.001). Symptoms of anxiety, depression, and posttraumatic stress disorder (PTSD) were prevalent among app users. For example, among app users who completed an anxiety assessment on their first day of app use (n=4870, 11.4% of users), 55.1% (n=2680) reported levels of anxiety that were moderate to severe, and 29.9% (n=1455) of scores fell into the severe symptom range. On average, those with moderate levels of depression on their first day of app use returned to the app for a greater number of days (mean 3.72 days) than those with minimal symptoms (mean 3.08 days; t1=3.01, P=.003). Individuals with significant PTSD symptoms on their first day of app use utilized the app for a significantly greater number of days (mean 3.79 days) than those with fewer symptoms (mean 3.13 days; t1=2.29, P=.02). Conclusions: As the mental health impacts of the pandemic continue to be widespread and increasing, digital health resources, such as apps like COVID Coach, are a scalable way to provide evidence-informed tools and resources. Future research is needed to better understand for whom and under what conditions the app is most helpful and how to increase and sustain engagement.

BACKGROUND The COVID-19 pandemic has significantly impacted mental health and well-being. Mobile mental health apps can be scalable and useful tools in large-scale disaster responses and are particularly promising for reaching vulnerable populations. COVID Coach is a free, evidence-informed mobile app designed specifically to provide tools and resources for addressing COVID-19–related stress. OBJECTIVE The purpose of this study was to characterize the overall usage of COVID Coach, explore retention and return usage, and assess whether the app was reaching individuals who may benefit from mental health resources. METHODS Anonymous usage data collected from COVID Coach between May 1, 2020, through October 31, 2020, were extracted and analyzed for this study. The sample included 49,287 unique user codes and 3,368,931 in-app events. RESULTS Usage of interactive tools for coping and stress management comprised the majority of key app events (n=325,691, 70.4%), and the majority of app users tried a tool for managing stress (n=28,009, 58.8%). COVID Coach was utilized for ≤3 days by 80.9% (n=34,611) of the sample whose first day of app use occurred within the 6-month observation window. Usage of the key content in COVID Coach predicted returning to the app for a second day. Among those who tried at least one coping tool on their first day of app use, 57.2% (n=11,444) returned for a second visit; whereas only 46.3% (n=10,546) of those who did not try a tool returned (P<.001). Symptoms of anxiety, depression, and posttraumatic stress disorder (PTSD) were prevalent among app users. For example, among app users who completed an anxiety assessment on their first day of app use (n=4870, 11.4% of users), 55.1% (n=2680) reported levels of anxiety that were moderate to severe, and 29.9% (n=1455) of scores fell into the severe symptom range. On average, those with moderate levels of depression on their first day of app use returned to the app for a greater number of days (mean 3.72 days) than those with minimal symptoms (mean 3.08 days; t1=3.01, P=.003). Individuals with significant PTSD symptoms on their first day of app use utilized the app for a significantly greater number of days (mean 3.79 days) than those with fewer symptoms (mean 3.13 days; t1=2.29, P=.02). CONCLUSIONS As the mental health impacts of the pandemic continue to be widespread and increasing, digital health resources, such as apps like COVID Coach, are a scalable way to provide evidence-informed tools and resources. Future research is needed to better understand for whom and under what conditions the app is most helpful and how to increase and sustain engagement.

Background: As smartphones are now used by most Americans, it is increasingly possible for mental health mobile apps to be disseminated to the general public. However, little is known about how mobile mental health apps are used by the general population outside of a controlled research design. Objective: Our objective is to describe how the general population engages with Mindfulness Coach, an iOS- and Android-based app designed to deliver a mindfulness training course. Methods: Using anonymous download and analytics data, we characterized the reach, usage, retention, and impact of Mindfulness Coach. We included mobile analytics data from all unique downloads of Mindfulness Coach between August 1, 2018, and April 8, 2019 (N=104,067) as well as starred reviews from all Mindfulness Coach users who provided reviews of the app as of March 1, 2020. Mindfulness characteristics were measured by an in-app assessment using the Five-Facet Mindfulness Questionnaire–Short Form (FFMQ-SF). Results: Users engaged, on average, in 4.3 visits to the app (SD 8.8; median 2; 90th percentile 8) and associated with an average total of 49.2 interactions with the app (ie, clicks within the app) (SD 113.8; median 19; 90th percentile 105). Users spent an average of 16.2 minutes (SD 63.1) engaged with the app over the full study time period. There were strong linear effects of app engagement on total FFMQ-SF scores. For example, FFMQ-SF scores were associated with more time spent engaged with the app (R2=.23; P<.001). Mindfulness Coach has been reviewed in the Google Play Store 3415 times, with an average rating of 4.7 out of 5 stars, and over 2000 times in the Apple App Store, with an average rating of 4.8 out of 5 stars. Conclusions: These findings suggest that Mindfulness Coach has achieved substantial and sustained reach in the general population; however, it was used less frequently by many downloaders than researchers and designers intended. There was a subpopulation of users who engaged in the app regularly over an extended period of time, and there was a clear relationship between app use and improvements in mindfulness. To strengthen Mindfulness Coach’s public health impact, more research is needed to understand who is using the app and how, and to design strategies to increase user engagement in order for users to receive a larger dose of mindfulness treatment.