FSFloor Sieverink

Floor Sieverink

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Floor Sieverink has a total of 25 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Personas for Better Targeted eHealth Technologies: User-Centered Design Approach

    by Iris Ten Klooster, Jobke Wentzel, Floor Sieverink, Gerard Linssen, Robin Wesselink, Lisette van Gemert-Pijnen

    Background: The full potential of eHealth technologies to support self-management and disease management for patients with chronic diseases is not being reached. A possible explanation for these lacking results is that during the development process, insufficient attention is paid to the needs, wishes, and context of the prospective end users. To overcome such issues, the user-centered design practice of creating personas is widely accepted to ensure the fit between a technology and the target group or end users throughout all phases of development. Objective: In this study, we integrate several approaches to persona development into the Persona Approach Twente to attain a more holistic and structured approach that aligns with the iterative process of eHealth development. Methods: In 3 steps, a secondary analysis was carried out on different parts of the data set using the Partitioning Around Medoids clustering method. First, we used health-related electronic patient record data only. Second, we added person-related data that were gathered through interviews and questionnaires. Third, we added log data. Results: In the first step, 2 clusters were found, with average silhouette widths of 0.12 and 0.27. In the second step, again 2 clusters were found, with average silhouette widths of 0.08 and 0.12. In the third step, 3 clusters were identified, with average silhouette widths of 0.09, 0.12, and 0.04. Conclusions: The Persona Approach Twente is applicable for mixed types of data and allows alignment of this user-centered design method to the iterative approach of eHealth development. A variety of characteristics can be used that stretches beyond (standardized) medical and demographic measurements. Challenges lie in data quality and fitness for (quantitative) clustering.


  • Open Access

    Personas for Better Targeted eHealth Technologies: User-Centered Design Approach (Preprint)

    by Iris Ten Klooster, Jobke Wentzel, Floor Sieverink, Gerard Linssen, Robin Wesselink, Lisette van Gemert-Pijnen

    BACKGROUND The full potential of eHealth technologies to support self-management and disease management for patients with chronic diseases is not being reached. A possible explanation for these lacking results is that during the development process, insufficient attention is paid to the needs, wishes, and context of the prospective end users. To overcome such issues, the user-centered design practice of creating personas is widely accepted to ensure the fit between a technology and the target group or end users throughout all phases of development. OBJECTIVE In this study, we integrate several approaches to persona development into the Persona Approach Twente to attain a more holistic and structured approach that aligns with the iterative process of eHealth development. METHODS In 3 steps, a secondary analysis was carried out on different parts of the data set using the Partitioning Around Medoids clustering method. First, we used health-related electronic patient record data only. Second, we added person-related data that were gathered through interviews and questionnaires. Third, we added log data. RESULTS In the first step, 2 clusters were found, with average silhouette widths of 0.12 and 0.27. In the second step, again 2 clusters were found, with average silhouette widths of 0.08 and 0.12. In the third step, 3 clusters were identified, with average silhouette widths of 0.09, 0.12, and 0.04. CONCLUSIONS The Persona Approach Twente is applicable for mixed types of data and allows alignment of this user-centered design method to the iterative approach of eHealth development. A variety of characteristics can be used that stretches beyond (standardized) medical and demographic measurements. Challenges lie in data quality and fitness for (quantitative) clustering.


  • Open Access

    Integrating People, Context, and Technology in the Implementation of a Web-Based Intervention in Forensic Mental Health Care: Mixed-Methods Study

    by Hanneke Kip, Floor Sieverink, Lisette J E W C van Gemert-Pijnen, Yvonne H A Bouman, Saskia M Kelders

    Background: While eMental health interventions can have many potential benefits for mental health care, implementation outcomes are often disappointing. In order to improve these outcomes, there is a need for a better understanding of complex, dynamic interactions between a broad range of implementation-related factors. These interactions and processes should be studied holistically, paying attention to factors related to context, technology, and people. Objective: The main objective of this mixed-method study was to holistically evaluate the implementation strategies and outcomes of an eMental health intervention in an organization for forensic mental health care. Methods: First, desk research was performed on 18 documents on the implementation process. Second, the intervention’s use by 721 patients and 172 therapists was analyzed via log data. Third, semistructured interviews were conducted with all 18 therapists of one outpatient clinic to identify broad factors that influence implementation outcomes. The interviews were analyzed via a combination of deductive analysis using the nonadoption, abandonment, scale-up, spread, and sustainability framework and inductive, open coding. Results: The timeline generated via desk research showed that implementation strategies focused on technical skills training of therapists. Log data analyses demonstrated that 1019 modules were started, and 18.65% (721/3865) of patients of the forensic hospital started at least one module. Of these patients, 18.0% (130/721) completed at least one module. Of the therapists using the module, 54.1% (93/172 sent at least one feedback message to a patient. The median number of feedback messages sent per therapist was 1, with a minimum of 0 and a maximum of 460. Interviews showed that therapists did not always introduce the intervention to patients and using the intervention was not part of their daily routine. Also, therapists indicated patients often did not have the required conscientiousness and literacy levels. Furthermore, they had mixed opinions about the design of the intervention. Important organization-related factors were the need for more support and better integration in organizational structures. Finally, therapists stated that despite its current low use, the intervention had the potential to improve the quality of treatment. Conclusions: Synthesis of different types of data showed that implementation outcomes were mostly disappointing. Implementation strategies focused on technical training of therapists, while little attention was paid to changes in the organization, design of the technology, and patient awareness. A more holistic approach toward implementation strategies—with more attention to the organization, patients, technology, and training therapists—might have resulted in better implementation outcomes. Overall, adaptivity appears to be an important concept in eHealth implementation: a technology should be easily adaptable to an individual patient, therapists should be trained to deal flexibly with an eMental health intervention in their treatment, and organizations should adapt their implementation strategies and structures to embed a new eHealth intervention.


  • Open Access

    Evaluating the implementation of a personal health record for chronic primary and secondary care: a mixed methods approach

    by Floor Sieverink, Saskia Kelders, Annemarie Braakman-Jansen, Julia van Gemert-Pijnen

    Background: Personal health records (PHRs) provide the opportunity for self-management support, enhancing communication between patients and caregivers, and maintaining and/or improving the quality of chronic disease management. Their implementation is a multi-level and complex process, requiring a holistic approach that takes into account the technology, its users and the context of implementation. The aim of this research is to evaluate the fidelity of a PHR in chronic care (the degree to which it was implemented as intended) in order to explain the found effects. Methods: A convergent parallel mixed methods design was used, where qualitative and quantitative data were collected in parallel, analyzed separately, and finally merged. Log data of 536 users were used to gain insight into the actual long-term use of the PHR (the dose). Focus group meetings among caregivers (n = 13) were conducted to assess program differentiation (or intended use). Interviews with caregivers (n = 28) and usability tests with potential end-users (n = 13) of the PHR were used to understand the responsiveness and the differences and similarities between the intended and actual use of the PHR. Results: The results of the focus groups showed that services for coaching are strongly associated with monitoring health values and education. However, the PHR was not used that way during the study period. In the interviews, caregivers indicated that they were ignorant on how to deploy the PHR in current working routines. Therefore, they find it difficult to motivate their patients in using the PHR. Participants in the usability study indicate that they would value a PHR in the future, given that the usability will be improved and that the caregivers will use it in daily practice as well. Conclusions: In this study, actual use of the PHRs by patients was influenced by the responsiveness of caregivers. This responsiveness is likely to be strongly influenced by the perceived support when defining the differentiation and delivery of the PHR. A mixed-methods approach to understand intervention fidelity was of added value in providing explanations for the found effects that could not be revealed by solely focusing on the effectiveness of the technology in an experimental trial.


  • Open Access

    Integrating People, Context, and Technology in the Implementation of a Web-Based Intervention in Forensic Mental Health Care: Mixed-Methods Study (Preprint)

    by Hanneke Kip, Floor Sieverink, Lisette J E W C van Gemert-Pijnen, Yvonne H A Bouman, Saskia M Kelders

    BACKGROUND While eMental health interventions can have many potential benefits for mental health care, implementation outcomes are often disappointing. In order to improve these outcomes, there is a need for a better understanding of complex, dynamic interactions between a broad range of implementation-related factors. These interactions and processes should be studied holistically, paying attention to factors related to context, technology, and people. OBJECTIVE The main objective of this mixed-method study was to holistically evaluate the implementation strategies and outcomes of an eMental health intervention in an organization for forensic mental health care. METHODS First, desk research was performed on 18 documents on the implementation process. Second, the intervention’s use by 721 patients and 172 therapists was analyzed via log data. Third, semistructured interviews were conducted with all 18 therapists of one outpatient clinic to identify broad factors that influence implementation outcomes. The interviews were analyzed via a combination of deductive analysis using the nonadoption, abandonment, scale-up, spread, and sustainability framework and inductive, open coding. RESULTS The timeline generated via desk research showed that implementation strategies focused on technical skills training of therapists. Log data analyses demonstrated that 1019 modules were started, and 18.65% (721/3865) of patients of the forensic hospital started at least one module. Of these patients, 18.0% (130/721) completed at least one module. Of the therapists using the module, 54.1% (93/172 sent at least one feedback message to a patient. The median number of feedback messages sent per therapist was 1, with a minimum of 0 and a maximum of 460. Interviews showed that therapists did not always introduce the intervention to patients and using the intervention was not part of their daily routine. Also, therapists indicated patients often did not have the required conscientiousness and literacy levels. Furthermore, they had mixed opinions about the design of the intervention. Important organization-related factors were the need for more support and better integration in organizational structures. Finally, therapists stated that despite its current low use, the intervention had the potential to improve the quality of treatment. CONCLUSIONS Synthesis of different types of data showed that implementation outcomes were mostly disappointing. Implementation strategies focused on technical training of therapists, while little attention was paid to changes in the organization, design of the technology, and patient awareness. A more holistic approach toward implementation strategies—with more attention to the organization, patients, technology, and training therapists—might have resulted in better implementation outcomes. Overall, adaptivity appears to be an important concept in eHealth implementation: a technology should be easily adaptable to an individual patient, therapists should be trained to deal flexibly with an eMental health intervention in their treatment, and organizations should adapt their implementation strategies and structures to embed a new eHealth intervention.

  • Open Access

    Correction for: Opening the Black Box of Electronic Health: Collecting, Analyzing, and Interpreting Log Data

    by Floor Sieverink, Saskia Kelders, Mannes Poel, Lisette van Gemert-Pijnen

  • Top Cited Papers
    Open Access

    Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence

    by Floor Sieverink, Saskia M Kelders, Julia Ewc van Gemert-Pijnen

    Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet


  • Open Access

    Opening the black box for eHealth : a mixed methods approach for the evaluation of personal health records

    by Floor Sieverink

    With the growing prevalence of chronic diseases (such as type 2 diabetes mellitus, congestive heart failure, or COPD) ageing with one or more chronic diseases is becoming normal. Sustainable solutions are therefore needed to effectuate a transformation in health care delivery and to support the shifts from 1) institutionalized (secondary) care to (primary) home care; 2) acute episodic care to a more continuous chronic care; and 3) the patient as a passive recipient of care to an active patient who is able to self-manage. Technology-based innovations (such as eHealth) are major drivers in this transformation of care delivery. Personal Health Records (PHRs) for example, provide the opportunity for self‐management support and maintaining and/or improving the quality of chronic disease management by engaging patients in their own healthcare. However, despite the potential benefits of PHRs in chronic disease management, recent evidence regarding the effectiveness of PHRs for self‐management remains sparse. Most of the evaluations focus on the effectiveness of PHRs as stand‐alone, patient‐centered technologies in experimental trials. However, the implementation of eHealth is a multi‐level and complex process, and such evaluations do not provide insight into process outcomes or how the use of the different components of the technology has contributed to healthier living, improved wellbeing, or a user’s ability to conduct daily tasks. We call this ‘the black box of eHealth’. Creating and implementing sustainable eHealth technologies thus requires a holistic development and evaluation approach that takes into account the triad of the technology, its users and the context of implementation. This thesis focuses on the evaluation of the implementation of an electronic personal health record (PHR) for patients chronic diseases in a mixed methods approach. The first part of this thesis consists of two more fundamental chapters describing a systematic review to gain more insight into the concept of adherence, and a protocol for the analysis of real-time data regarding the use (log data) of the PHR. The second part of this thesis contains three chapters to gain insight into the actual implementation of e-Vita, the relation between the user and the technology and the influence of the context


  • Open Access

    Opening the Black Box of Electronic Health: Collecting, Analyzing, and Interpreting Log Data

    by Floor Sieverink, Saskia Kelders, Mannes Poel, Lisette van Gemert-Pijnen

    In electronic health (eHealth) research, limited insight has been obtained on process outcomes or how the use of technology has contributed to the users' ability to have a healthier life, improved well-being, or activate new attitudes in their daily tasks. As a result, eHealth is often perceived as a black box. To open this black box of eHealth, methodologies must extend beyond the classic effect evaluations. The analyses of log data (anonymous records of real-time actions performed by each user) can provide continuous and objective insights into the actual usage of the technology. However, the possibilities of log data in eHealth research have not been exploited to their fullest extent. The aim of this paper is to describe how log data can be used to improve the evaluation and understand the use of eHealth technology with a broader approach than only descriptive statistics. This paper serves as a starting point for using log data analysis in eHealth research. Here, we describe what log data is and provide an overview of research questions to evaluate the system, the context, the users of a technology, as well as the underpinning theoretical constructs. We also explain the requirements for log data, the starting points for the data preparation, and methods for data collection. Finally, we describe methods for data analysis and draw a conclusion regarding the importance of the results for both scientific and practical applications. The analysis of log data can be of great value for opening the black box of eHealth. A deliberate log data analysis can give new insights into how the usage of the technology contributes to found effects and can thereby help to improve the persuasiveness and effectiveness of eHealth technology and the underpinning behavioral models.


  • Open Access

    The Added Value of Log File Analyses of the Use of a Personal Health Record for Patients With Type 2 Diabetes Mellitus

    by Floor Sieverink, Saskia M. Kelders, Louise M. A. Braakman-Jansen, Julia E. W. C. van Gemert-Pijnen

    Background: The electronic personal health record (PHR) is a promising technology for improving the quality of chronic disease management. Until now, evaluations of such systems have provided only little insight into why a particular outcome occurred. The aim of this study is to gain insight into the navigation process (what functionalities are used, and in what sequence) of e-Vita, a PHR for patients with type 2 diabetes mellitus (T2DM), to increase the efficiency of the system and improve the long-term adherence. Method: Log data of the first visits in the first 6 weeks after the release of a renewed version of e-Vita were analyzed to identify the usage patterns that emerge when users explore a new application. Results: After receiving the invitation, 28% of all registered users visited e-Vita. In total, 70 unique usage patterns could be identified. When users visited the education service first, 93% of all users ended their session. Most users visited either 1 or 5 or more services during their first session, but the distribution of the routes was diffuse. Conclusions: In conclusion, log file analyses can provide valuable prompts for improving the system design of a PHR. In this way, the match between the system and its users and the long-term adherence has the potential to increase.