DSDaniel P. Siewiorek

Daniel P. Siewiorek

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Daniel P. Siewiorek has a total of 313 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Designing a Human-Centered Intelligent System to Monitor & Explain Abnormal Patterns of Older Adults

    by Min Hun Lee, Daniel P. Siewiorek, Alexandre Bernardino

    Older adult care technologies are increasingly explored to support the independent living of older adults by monitoring their abnormal activities and informing caregivers to provide intervention if necessary. However, the adoption of these technologies remains challenging due to several factors (e.g. lack of usability). In this work, we present a human-centered, intelligent system for older adult care. Our proposed designs of the system were created based on the findings from a focus group session with caregivers. This system monitors the abnormal activities of an older adult using wireless motion sensors and machine learning models. In addition, unlike previous work that only notifies an outcome of activity recognition and abnormal detection models to a caregiver, the system supports interactive dialogue responses to explain the abnormal activities of an older adult to a caregiver and allow the caregiver to elicit additional information about the older adult and the older adult to proactively share his/her status with the caregiver for an adequate intervention.


  • Design, development, and evaluation of an interactive personalized social robot to monitor and coach post-stroke rehabilitation exercises

    by Min Hun Lee, Daniel P. Siewiorek, Asim Smailagic, Alexandre Bernardino, Sergi Bermúdez i Badia

    Socially assistive robots are increasingly being explored to improve the engagement of older adults and people with disability in health and well-being-related exercises. However, even if people have various physical conditions, most prior work on social robot exercise coaching systems has utilized generic, predefined feedback. The deployment of these systems still remains a challenge. In this paper, we present our work of iteratively engaging therapists and post-stroke survivors to design, develop, and evaluate a social robot exercise coaching system for personalized rehabilitation. Through interviews with therapists, we designed how this system interacts with the user and then developed an interactive social robot exercise coaching system. This system integrates a neural network model with a rule-based model to automatically monitor and assess patients’ rehabilitation exercises and can be tuned with individual patient’s data to generate real-time, personalized corrective feedback for improvement. With the dataset of rehabilitation exercises from 15 post-stroke survivors, we demonstrated our system significantly improves its performance to assess patients’ exercises while tuning with held-out patient’s data. In addition, our real-world evaluation study showed that our system can adapt to new participants and achieved 0.81 average performance to assess their exercises, which is comparable to the experts’ agreement level. We further discuss the potential benefits and limitations of our system in practice.


  • Open Access

    Enabling AI and Robotic Coaches for Physical Rehabilitation Therapy: Iterative Design and Evaluation with Therapists and Post-stroke Survivors

    by Min Hun Lee, Daniel P. Siewiorek, Asim Smailagic, Alexandre Bernardino, Sergi Bermúdez i Badia

    Artificial intelligence (AI) and robotic coaches promise the improved engagement of patients on rehabilitation exercises through social interaction. While previous work explored the potential of automatically monitoring exercises for AI and robotic coaches, the deployment of these systems remains a challenge. Previous work described the lack of involving stakeholders to design such functionalities as one of the major causes. In this paper, we present our efforts on eliciting the detailed design specifications on how AI and robotic coaches could interact with and guide patient’s exercises in an effective and acceptable way with four therapists and five post-stroke survivors. Through iterative questionnaires and interviews, we found that both post-stroke survivors and therapists appreciated the potential benefits of AI and robotic coaches to achieve more systematic management and improve their self-efficacy and motivation on rehabilitation therapy. In addition, our evaluation sheds light on several practical concerns (e.g. a possible difficulty with the interaction for people with cognitive impairment, system failures, etc.). We discuss the value of early involvement of stakeholders and interactive techniques that complement system failures, but also support a personalized therapy session for the better deployment of AI and robotic exercise coaches.


  • Weighted Multisource Tradaboost

    by João Antunes, Alexandre Bernardino, Asim Smailagic, Daniel Siewiorek


  • Open Access

    Attention Filtering for Multi-person Spatiotemporal Action Detection on Deep Two-Stream CNN Architectures

    by João Antunes, Pedro Abreu, Alexandre Bernardino, Asim Smailagic, Daniel Siewiorek

    Action detection and recognition tasks have been the target of much focus in the computer vision community due to their many applications, namely, security, robotics and recommendation systems. Recently, datasets like AVA, provide multi-person, multi-label, spatiotemporal action detection and recognition challenges. Being unable to discern which portions of the input to use for classification is a limitation of two-stream CNN approaches, once the vision task involves several people with several labels. We address this limitation and improve the state-of-the-art performance of two-stream CNNs. In this paper we present four contributions: our fovea attention filtering that highlights targets for classification without discarding background; a generalized binary loss function designed for the AVA dataset; miniAVA, a partition of AVA that maintains temporal continuity and class distribution with only one tenth of the dataset size; and ablation studies on alternative attention filters. Our method, using fovea attention filtering and our generalized binary loss, achieves a relative video mAP improvement of 20% over the two-stream baseline in AVA, and is competitive with the state-of-the-art in the UCF101-24. We also show a relative video mAP improvement of 12.6% when using our generalized binary loss over the standard sum-of-sigmoids.

  • Open Access

    Weighted Multisource Tradaboost

    by João Antunes, Alexandre Bernardino, Asim Smailagic, Daniel Siewiorek

    In this paper we propose an improved method for transfer learning that takes into account the balance between target and source data. This method builds on the state-of-the-art Multisource Tradaboost, but weighs the importance of each datapoint taking into account the amount of target and source data available. A comparative study is then presented exposing the performance of four transfer learning methods as well as the proposed Weighted Multisource Tradaboost. The experimental results show that the proposed method is able to outperform the base method as the number of target samples increase. These results are promising in the sense that source-target ratio weighing may be a path to improve current methods of transfer learning. However, against the asymptotic conjecture, all transfer learning methods tested in this work get outperformed by a no-transfer SVM for large number on target samples.

  • Open Access

    Design and Assessment of Myoelectric Games for Prosthesis Training of Upper Limb Amputees

    by Meera Radhakrishnan, Asim Smailagic, Brian French, Daniel P. Siewiorek, Rajesh Krishna Balan

    In this paper, we present the design and evaluation of our system, which provides an engaging game-based pre-prosthesis training environment for upper limb transradial amputees. We believe that patients who train using such a training tool will demonstrate significantly higher improvement in functional performance tests using a myoelectric prosthesis than when conventional pre-prosthesis training protocols are used. We re-designed two simple games to be playable using three muscle contractions which are appropriate to pre-prosthesis exercises and are detected by an EMG-based arm sleeve. Through user studies conducted with 16 non-amputee subjects, we show that the proposed games are enjoyable, fun to play, sustains motivation to continue playing and also helps in improving muscular control. Using an HMM trained on EMG data collected from the game play sessions of each user, we are able to detect if the subject felt fatigued, while continuously contracting the muscles to play the game, in 93% of the cases and with a latency of only ±15 seconds. We are also able to understand the subject's quality of muscle isolation during the game play.


  • Top Cited Papers
    Open Access

    Ecological Momentary Assessment in Behavioral Research: Addressing Technological and Human Participant Challenges

    by Lora E Burke, Saul Shiffman, Edvin Music, Mindi A Styn, Andrea Kriska, Asim Smailagic, Daniel Siewiorek, Linda J Ewing, Eileen Chasens, Brian French, et al.

    Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet