NRNatalie Rios

Natalie Rios

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Natalie Rios has a total of 19 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Top Cited Papers
    Open Access

    Comparing GPT-4 and Human Researchers in Health Care Data Analysis: Qualitative Description Study

    by Kevin Danis Li, Adrian M Fernandez, Rachel Schwartz, Natalie Rios, Marvin Nathaniel Carlisle, Gregory M Amend, Hiren V Patel, Benjamin N Breyer

    Background: Large language models including GPT-4 (OpenAI) have opened new avenues in health care and qualitative research. Traditional qualitative methods are time-consuming and require expertise to capture nuance. Although large language models have demonstrated enhanced contextual understanding and inferencing compared with traditional natural language processing, their performance in qualitative analysis versus that of humans remains unexplored. Objective: We evaluated the effectiveness of GPT-4 versus human researchers in qualitative analysis of interviews with patients with adult-acquired buried penis (AABP). Methods: Qualitative data were obtained from semistructured interviews with 20 patients with AABP. Human analysis involved a structured 3-stage process—initial observations, line-by-line coding, and consensus discussions to refine themes. In contrast, artificial intelligence (AI) analysis with GPT-4 underwent two phases: (1) a naïve phase, where GPT-4 outputs were independently evaluated by a blinded reviewer to identify themes and subthemes and (2) a comparison phase, where AI-generated themes were compared with human-identified themes to assess agreement. We used a general qualitative description approach. Results: The study population (N=20) comprised predominantly White (17/20, 85%), married (12/20, 60%), heterosexual (19/20, 95%) men, with a mean age of 58.8 years and BMI of 41.1 kg/m2. Human qualitative analysis identified “urinary issues” in 95% (19/20) and GPT-4 in 75% (15/20) of interviews, with the subtheme “spray or stream” noted in 60% (12/20) and 35% (7/20), respectively. “Sexual issues” were prominent (19/20, 95% humans vs 16/20, 80% GPT-4), although humans identified a wider range of subthemes, including “pain with sex or masturbation” (7/20, 35%) and “difficulty with sex or masturbation” (4/20, 20%). Both analyses similarly highlighted “mental health issues” (11/20, 55%, both), although humans coded “depression” more frequently (10/20, 50% humans vs 4/20, 20% GPT-4). Humans frequently cited “issues using public restrooms” (12/20, 60%) as impacting social life, whereas GPT-4 emphasized “struggles with romantic relationships” (9/20, 45%). “Hygiene issues” were consistently recognized (14/20, 70% humans vs 13/20, 65% GPT-4). Humans uniquely identified “contributing factors” as a theme in all interviews. There was moderate agreement between human and GPT-4 coding (κ=0.401). Reliability assessments of GPT-4’s analyses showed consistent coding for themes including “body image struggles,” “chronic pain” (10/10, 100%), and “depression” (9/10, 90%). Other themes like “motivation for surgery” and “weight challenges” were reliably coded (8/10, 80%), while less frequent themes were variably identified across multiple iterations. Conclusions: Large language models including GPT-4 can effectively identify key themes in analyzing qualitative health care data, showing moderate agreement with human analysis. While human analysis provided a richer diversity of subthemes, the consistency of AI suggests its use as a complementary tool in qualitative research. With AI rapidly advancing, future studies should iterate analyses and circumvent token limitations by segmenting data, furthering the breadth and depth of large language model–driven qualitative analyses.


  • Open Access

    Perceptions of Older Men Using a Mobile Health App to Monitor Lower Urinary Tract Symptoms and Tamsulosin Side Effects: Mixed Methods Study

    by Elizabeth Y Wang, Benjamin N Breyer, Austin W Lee, Natalie Rios, Akinyemi Oni-Orisan, Michael A Steinman, Ida Sim, Stacey A Kenfield, Scott R Bauer

    Background: Mobile health (mHealth) apps may provide an efficient way for patients with lower urinary tract symptoms (LUTS) to log and communicate symptoms and medication side effects with their clinicians. Objective: The aim of this study was to explore the perceptions of older men with LUTS after using an mHealth app to track their symptoms and tamsulosin side effects. Methods: Structured phone interviews were conducted after a 2-week study piloting the daily use of a mobile app to track the severity of patient-selected LUTS and tamsulosin side effects. Quantitative and qualitative data were considered. Results: All 19 (100%) pilot study participants completed the poststudy interviews. Most of the men (n=13, 68%) reported that the daily questionnaires were the right length, with 32% (n=6) reporting that the questionnaires were too short. Men with more severe symptoms were less likely to report changes in perception of health or changes in self-management; 47% (n=9) of the men reported improved awareness of symptoms and 5% (n=1) adjusted fluid intake based on the questionnaire. All of the men were willing to share app data with their clinicians. Thematic analysis of qualitative data yielded eight themes: (1) orientation (setting up app, format, symptom selection, and side-effect selection), (2) triggers (routine or habit and symptom timing), (3) daily questionnaire (reporting symptoms, reporting side effects, and tailoring), (4) technology literacy, (5) perceptions (awareness, causation or relevance, data quality, convenience, usefulness, and other apps), (6) self-management, (7) clinician engagement (communication and efficiency), and (8) improvement (reference materials, flexibility, language, management recommendations, and optimize clinician engagement). Conclusions: We assessed the perceptions of men using an mHealth app to monitor and improve management of LUTS and medication side effects. LUTS management may be further optimized by tailoring the mobile app experience to meet patients' individual needs, such as tracking a greater number of symptoms and integrating the app with clinicians' visits. mHealth apps are likely a scalable modality to monitor symptoms and improve care of older men with LUTS. Further study is required to determine the best ways to tailor the mobile app and to communicate data to clinicians or incorporate data into the electronical medical record meaningfully.


  • Open Access

    Perceptions of Older Men Using a Mobile Health App to Monitor Lower Urinary Tract Symptoms and Tamsulosin Side Effects: Mixed Methods Study (Preprint)

    by Elizabeth Y Wang, Benjamin N Breyer, Austin W Lee, Natalie Rios, Akinyemi Oni-Orisan, Michael A Steinman, Ida Sim, Stacey A Kenfield, Scott R Bauer

    BACKGROUND Mobile health (mHealth) apps may provide an efficient way for patients with lower urinary tract symptoms (LUTS) to log and communicate symptoms and medication side effects with their clinicians. OBJECTIVE The aim of this study was to explore the perceptions of older men with LUTS after using an mHealth app to track their symptoms and tamsulosin side effects. METHODS Structured phone interviews were conducted after a 2-week study piloting the daily use of a mobile app to track the severity of patient-selected LUTS and tamsulosin side effects. Quantitative and qualitative data were considered. RESULTS All 19 (100%) pilot study participants completed the poststudy interviews. Most of the men (n=13, 68%) reported that the daily questionnaires were the right length, with 32% (n=6) reporting that the questionnaires were too short. Men with more severe symptoms were less likely to report changes in perception of health or changes in self-management; 47% (n=9) of the men reported improved awareness of symptoms and 5% (n=1) adjusted fluid intake based on the questionnaire. All of the men were willing to share app data with their clinicians. Thematic analysis of qualitative data yielded eight themes: (1) orientation (setting up app, format, symptom selection, and side-effect selection), (2) triggers (routine or habit and symptom timing), (3) daily questionnaire (reporting symptoms, reporting side effects, and tailoring), (4) technology literacy, (5) perceptions (awareness, causation or relevance, data quality, convenience, usefulness, and other apps), (6) self-management, (7) clinician engagement (communication and efficiency), and (8) improvement (reference materials, flexibility, language, management recommendations, and optimize clinician engagement). CONCLUSIONS We assessed the perceptions of men using an mHealth app to monitor and improve management of LUTS and medication side effects. LUTS management may be further optimized by tailoring the mobile app experience to meet patients’ individual needs, such as tracking a greater number of symptoms and integrating the app with clinicians’ visits. mHealth apps are likely a scalable modality to monitor symptoms and improve care of older men with LUTS. Further study is required to determine the best ways to tailor the mobile app and to communicate data to clinicians or incorporate data into the electronical medical record meaningfully.

  • Open Access

    Predictive Factor of Preresidency Publication on Career Academic Achievement in Urologists

    by Nikan K. Namiri, Austin W. Lee, Natalie Rios, Anthony Enriquez, Behnam Nabavizadeh, Nnenaya Agochukwu-Mmonu, Alan Shindel, Benjamin N. Breyer

    Introduction: Publications at any point in training can impact future academic interest and achievement. Implications of publishing scholarly work prior to residency on accomplishments during and after residency are under-studied. Methods: We obtained publication output before, during, and after residency for urologists graduating between 2002 and 2008 from the 36 training programs affiliated with a top 50 urology hospital nationwide. Additional collected information included fellowship training, current appointment, total and R01 National Institutes of Health (NIH) grants, and h-index. We compared urologists’ pre-residency scholarship with residency and career achievements. Results: We retrieved data from 543 urologists, of whom 161 (29.7%) and 92 (16.9%) published one or more total and first author manuscripts before residency, respectively. A total of 269 (49.5%) urologists went on to pursue fellowship and 183 (33.7%) entered academic practice. Urologists with a first author publication before residency had increased odds of entering academics (OR: 1.9, 95% CI: 1.2–3.1), obtaining NIH grants (OR: 2.2, 95% CI: 1.1–4.3), and acquiring NIH R01 grants (OR: 4.1, 95% CI: 1.7–9.7). Those with more first author manuscripts prior to residency were also more likely to pursue fellowship (p=0.0002), have a higher h-index (p <0.0001), and publish more during (p <0.0001) and after residency (p=0.0002). Those with more total publications before residency, however, were only associated with greater h-index (p=0.002) and publications in residency (p=0.001). Conclusions: Pre-residency scholarly endeavors, particularly first author publications, are associated with future scholarly achievement, which may inform both resident selection procedures and medical education curricular development.