BTBryan Tripp

Bryan Tripp

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Bryan Tripp has a total of 57 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    A Language Model for Pediatric Occupational Therapy Documentation: Model Development and Pilot Study

    by Rachel DiMaio, Tia Tuinstra, Trevor Yu, Ilona Koshy, Brendan Wylie-Toal, Bryan Tripp

    Background: In occupational therapy, progress notes and other client-related administrative tasks are essential for providing treatment but are time-consuming. Therapists spend at least as much time on these tasks as providing care, which contributes to growing waitlists. Objective: This study aimed to create a custom large language model to make the process of writing progress notes more efficient by converting point-form scratch notes from pediatric occupational therapy treatment sessions into draft documentation in subjective-objective-assessment-plan format. Methods: Using a dataset of redacted historical progress notes, various training methods, including domain-adaptive pretraining and low-rank adaptation fine-tuning, were applied to train Llama 2 and 3 models. Since the historical notes lacked corresponding scratch notes, few-shot prompting with human-in-the-loop evaluations was used to generate synthetic scratch notes. This pairing of historical notes and generated scratch notes enabled effective fine-tuning of the Llama models on the desired task. The final model, a fine-tuned Llama 3 8B Instruct model, was piloted in a pediatric rehabilitation center and compared with Microsoft Copilot. Ten therapists used both models for 3 weeks each. Results: The custom model notes scored higher than manually written notes on clarity, completeness, relevance, and organization ( P <.001) , and similarly on conciseness. They scored higher than those from Copilot on conciseness ( P <.001). However, in this small pilot, a significant reduction in time spent on documentation when using the custom model versus manual notes was not detected. Follow-up investigation revealed that time savings were observed only when therapists were coached to write sparse scratch notes; however, they tended to revert to detailed notes after coaching for which the model was not shown to improve efficiency. Conclusions: The model had the capacity to save time when therapists provided brief input to the model. However, in practice, therapists preferred to provide detailed input. Used in this way, the model improved note quality rather than saving time.


  • Open Access

    The Impact of Robot Role and Personality on Participants’ Perception of the Robot in a Human–Robot Teaching Task

    by Sahand Shaghaghi, Pourya Aliasghari, Bryan Tripp, Kerstin Dautenhahn, Chrystopher L. Nehaniv

    A better understanding of how humans perceive robot personality variables could enable the design of more socially acceptable robots. In this exploratory study, we examined whether manipulations of an iCub robot’s voice and movements affected human participants’ perceptions of the robot’s personality. We programmed the robot to behave in different ways during a teaching scenario in which it played either a teaching, learning, or collaborative role, shown in recorded videos of human–robot interactions. A total of 240 participants in an Amazon Mechanical Turk study watched these videos and completed a series of questionnaires assessing their perceptions of the robot. Participants perceived the iCub as more extroverted when it spoke faster, with a higher pitch, and performed larger-amplitude movements. It was determined that participants’ personality dimensions were more influential in their perceptions of the robot’s TIPI and RoSAS personality dimensions than the robot’s social role and personality manipulations. Participants’ self-rated extroversion, emotional stability, and conscientiousness repeatedly appeared as significant factors affecting their perceptions of the robot’s personality. Interestingly, we observed strong perceiver effects, whereby participants’ perceptions of the robot’s personality traits were correlated with their own self-rated personality traits.

  • Open Access

    FocalVid: A Platform for Tracking Visual Attention to Video via Crowdsourcing Validated Against Human Gaze Data

    by Sahand Shaghaghi, Karissa B. Payne, Bryan Tripp, Kerstin Dautenhahn, Chrystopher L. Nehaniv

    Human attention to dynamic visual stimuli can be measured using mouse-contingent cursor movements as a proxy for tracking human gaze when eye tracking is not feasible, for example, in online studies. FocalVid is the first such platform for collecting mouse-contingent attention data for video as a proxy approximating eye tracking. The present study analyses in detail how data collected with FocalVid are related to human gaze data. Cursor movements of 225 participants watching a variety of videos are compared to eye movements for an established corpus on human gaze that used the same videos. Such a comparison is critical to justifying the use of FocalVid or similar platforms, and for choosing suitable user interface settings to produce results most similar to human gaze. Cursor movements in FocalVid are shown to have notable similarities with eye movements. For example, distributions of cursor velocities and fixation durations are qualitatively similar to those of eye movements. However, moment-to-moment cursor movements and eye movements were significantly different with most video stimuli. We discuss the implications for mouse-contingent attention measures to video stimuli in different contexts.


  • Open Access

    Complex Properties of Training Stimuli Affect Brain Alignment in a Deep Network Model of Mouse Visual Cortex

    by Parsa Torabian, Yinghan Chen, Candace Ng, Stefan Mihalas, Michael Buice, Shahab Bakhtiari, Bryan Tripp

    Deep convolutional neural networks are important models of the visual cortex that ac-count relatively well for brain activity and are able to perform ethologically relevant functions. However, it is unknown which combination of factors, such as network ar-chitecture, training objectives, and data best align this family of models with the brain. Here we investigate the statistics of training data. We hypothesized that stimuli that are naturalistic for mice would lead to higher similarity between deep network models and activity in mouse visual cortex. We used a video-game engine to create training datasets in which we varied the naturalism of the environment, the movement statis-tics, and the optics of the modelled eye. The naturalistic environment substantially and consistently led to greater brain similarity, while the other factors had more subtle and area-specific effects. We then hypothesized that differences in brain similarity between the two environments arose due to differences in spatial frequency spectra, distribu-tions of color and orientation, and/or temporal autocorrelations. To test this, we created abstract environments, composed of cubes and spheres, that resembled the naturalis-tic and non-naturalistic environments in these respects. Contrary to our expectations, these factors accounted poorly for differences in brain similarity due to the naturalis-tic and non-naturalistic environments. This suggests that the higher brain similarities we observed after training with the naturalistic environment were due to more complex factors.

  • Open Access

    Multimodal Artificial Intelligence in Medicine

    by Conor S. Judge, Finn Krewer, Martin J. O'DOnnell, Lisa Kiely, Donal Sexton, Graham W. Taylor, Joshua August Skorburg, Bryan Tripp

    Traditional medical artificial intelligence models that are approved for clinical use restrict themselves to single-modal data (e.g., images only), limiting their applicability in the complex, multimodal environment of medical diagnosis and treatment. Multimodal transformer models in health care can effectively process and interpret diverse data forms, such as text, images, and structured data. They have demonstrated impressive performance on standard benchmarks, like United States Medical Licensing Examination question banks, and continue to improve with scale. However, the adoption of these advanced artificial intelligence models is not without challenges. While multimodal deep learning models like transformers offer promising advancements in health care, their integration requires careful consideration of the accompanying ethical and environmental challenges.


  • Open Access

    Modeling the Role of Contour Integration in Visual Inference

    by Salman Khan, Alexander Wong, Bryan Tripp

    Under difficult viewing conditions, the brain’s visual system uses a variety of recurrent modulatory mechanisms to augment feedforward processing. One resulting phenomenon is contour integration, which occurs in the primary visual (V1) cortex and strengthens neural responses to edges if they belong to a larger smooth contour. Computational models have contributed to an understanding of the circuit mechanisms of contour integration, but less is known about its role in visual perception. To address this gap, we embedded a biologically grounded model of contour integration in a task-driven artificial neural network and trained it using a gradient-descent variant. We used this model to explore how brain-like contour integration may be optimized for high-level visual objectives as well as its potential roles in perception. When the model was trained to detect contours in a background of random edges, a task commonly used to examine contour integration in the brain, it closely mirrored the brain in terms of behavior, neural responses, and lateral connection patterns. When trained on natural images, the model enhanced weaker contours and distinguished whether two points lay on the same versus different contours. The model learned robust features that generalized well to out-of-training-distribution stimuli. Surprisingly, and in contrast with the synthetic task, a parameter-matched control network without recurrence performed the same as or better than the model on the natural-image tasks. Thus, a contour integration mechanism is not essential to perform these more naturalistic contour-related tasks. Finally, the best performance in all tasks was achieved by a modified contour integration model that did not distinguish between excitatory and inhibitory neurons.


  • Improved Generalization of Probabilistic Movement Primitives for Manipulation Trajectories

    by Xueyang Yao, Yinghan Chen, Bryan Tripp

    Imitation learning methods have proven effective in learning robotic tasks by leveraging multiple human-controlled demonstrations. However, existing approaches often struggle to generalize across a wide range of tasks, such as extrapolating to unseen object locations, incorporating via-point modulation, accurately modeling orientation, handling trajectories with multiple options, and capturing aiming actions. In this study, we propose a novel framework that combines ideas from task-parameterized Gaussian mixture models and probabilistic movement primitives to address these limitations and satisfy all the aforementioned properties within a single framework. We conduct comprehensive evaluations of our approach on four real-life tasks: pick-and-place, water pouring, shooting a hockey puck into a net, and sweeping.


  • Open Access

    Identifying and interpreting tuning dimensions in deep networks

    by Nolan S. Dey, J. Eric Taylor, Bryan P. Tripp, Alexander Wong, Graham W. Taylor

    In neuroscience, a tuning dimension is a stimulus attribute that accounts for much of the activation variance of a group of neurons. These are commonly used to decipher the responses of such groups. While researchers have attempted to manually identify an analogue to these tuning dimensions in deep neural networks, we are unaware of an automatic way to discover them. This work contributes an unsupervised framework for identifying and interpreting "tuning dimensions" in deep networks. Our method correctly identifies the tuning dimensions of a synthetic Gabor filter bank and tuning dimensions of the first two layers of InceptionV1 trained on ImageNet.

  • 37,000 Human-Planned Robotic Grasps With Six Degrees of Freedom

    by Victor Reyes Osorio, Rajan Iyengar, Xueyang Yao, Presish Bhattachan, Adrian Ragobar, Nolan Dey, Bryan Patrick Tripp

    Much recent work in grasp planning has focused on data-driven approaches, using deep learning to map from images to gripper configurations. However, this approach typically fails about once per ten attempts, limiting its practicality. We sought to better understand the degree to which such failures can be attributed to hardware versus control. To this end, we developed a naturalistic grasp demonstration system in which a gripper was fitted with a handle and moved by a human operator, while its trajectory was recorded with a motion tracker. The gripper's fingers were controlled with a joystick. We recorded roughly 37K grasp demonstrations with this system. These grasps were almost always successful. In contrast with planar grasp planners that perform only top-down grasps by design, many of the human-planned grasps used a horizontal approach rather than a top-down approach. We analysed robustness of a subset of these human-planned grasps, and found that many were robust to gripper rotations of about ${\pi/8}$ radians and translations of 3cm (depending on the object). Consistent with past work, human operators tended to align the gripper aperture with objects' principal axes. We also tested robustness of grasps in which the gripper aperture was aligned exactly with the principal axes, and found that these heuristic grasps were even more robust than human-planned grasps. This suggests that humans used a partly symbolic grasp planning strategy, with somewhat imprecise control.