Thomas Pronk
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Thomas Pronk has a total of 32 co-authors. Here are the top co-authors by number of shared publications:
- Reinout Wiers
Developmental Psychology, University of Amsterdam
10 shared publications - Marilisa Boffo
Department of Psychology, Education, and Child Studies, Erasmus School of Social and Behavioural Sciences, Erasmus University Rotterdam, Rotterdam, The Netherlands
4 shared publications Jaap M. J. Murre
Department of Psychology, Faculty of Social and Behavioural Sciences, University of Amsterdam, Amsterdam, The Netherlands
3 shared publicationsBert Molenkamp
Department of Psychology, Faculty of Social and Behavioural Sciences, University of Amsterdam, Amsterdam, The Netherlands
2 shared publicationsDylan Molenaar
Faculty of Social and Behavioural Sciences, Department of Psychology, University of Amsterdam, Amsterdam, The Netherlands
2 shared publications- Helle Larsen
Developmental Psychology, University of Amsterdam, Amsterdam, The Netherlands
2 shared publications
Latest Publications
- Open Access
- 9 June 2026
- Published by Dutch Research Council (NWO)
A holistic approach to professional technical digital research is possible
What does research look like in a world where data, software, and AI are an integral part of the research process? This post explores why closer collaboration between research software engineers, data stewards, and other digital Research Technical Professionals is essential for enabling robust, reproducible, and future-ready research.
- 9 June 2026
- Published by Dutch Research Council (NWO)
Open AccessA holistic approach to professional technical digital research is possible
What does research look like in a world where data, software, and AI are an integral part of the research process? This post explores why closer collaboration between research software engineers, data stewards, and other digital Research Technical Professionals is essential for enabling robust, reproducible, and future-ready research.
- Open Access
- 18 June 2023
- Published by Elsevier in Addictive Behaviors
- Vol. 145, 107778
Losing sight of Luck: Automatic approach tendencies toward gambling cues in Canadian moderate- to high-risk gamblers – A replication study
- 18 June 2023
- Published by Elsevier in Addictive Behaviors
- Vol. 145, 107778
Open AccessLosing sight of Luck: Automatic approach tendencies toward gambling cues in Canadian moderate- to high-risk gamblers – A replication study
- Open Access
- 16 June 2022
- Published by Springer Nature in Behavior Research Methods
- Vol. 55  (4) , 1641-1652
Can we measure individual differences in cognitive measures reliably via smartphones? A comparison of the flanker effect across device types and samples
Research deployed via the internet and administered via smartphones could have access to more diverse samples than lab-based research. Diverse samples could have relatively high variation in their traits and so yield relatively reliable measurements of individual differences in these traits. Several cognitive tasks that originated from the experimental research tradition have been reported to yield relatively low reliabilities (Hedge et al., 2018) in samples with restricted variance (students). This issue could potentially be addressed by smartphone-mediated administration in diverse samples. We formulate several criteria to determine whether a cognitive task is suitable for individual differences research on commodity smartphones: no very brief or precise stimulus timing, relative response times (RTs), a maximum of two response options, and a small number of graphical stimuli. The flanker task meets these criteria. We compared the reliability of individual differences in the flanker effect across samples and devices in a preregistered study. We found no evidence that a more diverse sample yields higher reliabilities. We also found no evidence that commodity smartphones yield lower reliabilities than commodity laptops. Hence, diverse samples might not improve reliability above student samples, but smartphones may well measure individual differences with cognitive tasks reliably. Exploratively, we examined different reliability coefficients, split-half reliabilities, and the development of reliability estimates as a function of task length.
- 16 June 2022
- Published by Springer Nature in Behavior Research Methods
- Vol. 55  (4) , 1641-1652
Open AccessCan we measure individual differences in cognitive measures reliably via smartphones? A comparison of the flanker effect across device types and samples
Research deployed via the internet and administered via smartphones could have access to more diverse samples than lab-based research. Diverse samples could have relatively high variation in their traits and so yield relatively reliable measurements of individual differences in these traits. Several cognitive tasks that originated from the experimental research tradition have been reported to yield relatively low reliabilities (Hedge et al., 2018) in samples with restricted variance (students). This issue could potentially be addressed by smartphone-mediated administration in diverse samples. We formulate several criteria to determine whether a cognitive task is suitable for individual differences research on commodity smartphones: no very brief or precise stimulus timing, relative response times (RTs), a maximum of two response options, and a small number of graphical stimuli. The flanker task meets these criteria. We compared the reliability of individual differences in the flanker effect across samples and devices in a preregistered study. We found no evidence that a more diverse sample yields higher reliabilities. We also found no evidence that commodity smartphones yield lower reliabilities than commodity laptops. Hence, diverse samples might not improve reliability above student samples, but smartphones may well measure individual differences with cognitive tasks reliably. Exploratively, we examined different reliability coefficients, split-half reliabilities, and the development of reliability estimates as a function of task length.
- Open Access
- 7 December 2021
- Published by Center for Open Science in PsyArXiv
Can we Measure Individual Differences in Cognitive Measures Reliably via Smartphones? A Comparison of the Flanker Effect Across Device Types and Samples
Research deployed via the internet and administered via smartphones could have access to more diverse samples than lab-based research. Diverse samples could have relatively high variation in their traits and so yield relatively reliable measurements of individual differences in these traits. Cognitive tasks have been reported to yield relatively low reliabities (Hedge et al., 2018), which could potentially be addressed by smartphone-mediated administration in diverse samples. We formulate several criteria to determine whether a cognitive task is suitable for individual differences research on commodity smartphones: no very brief or precise stimulus timing, relative response times (RTs), a maximum of two response options, and a small number of graphical stimuli. The Flanker Task meets these criteria. We compared the reliability of individual differences in the Flanker Effect across samples and devices in a pre-registered study. We found no evidence that a more diverse sample yields higher reliabilities. We also found no evidence that commodity smartphones yield lower reliabilities than commodity laptops. Hence, diverse samples might not improve reliability above student samples, but smartphones may well measure individual differences with cognitive tasks reliably. Exploratively, we examined different reliability coefficients, split-half reliabilities, and the development of reliability estimates as a function of task length.
- 7 December 2021
- Published by Center for Open Science in PsyArXiv
Open AccessCan we Measure Individual Differences in Cognitive Measures Reliably via Smartphones? A Comparison of the Flanker Effect Across Device Types and Samples
Research deployed via the internet and administered via smartphones could have access to more diverse samples than lab-based research. Diverse samples could have relatively high variation in their traits and so yield relatively reliable measurements of individual differences in these traits. Cognitive tasks have been reported to yield relatively low reliabities (Hedge et al., 2018), which could potentially be addressed by smartphone-mediated administration in diverse samples. We formulate several criteria to determine whether a cognitive task is suitable for individual differences research on commodity smartphones: no very brief or precise stimulus timing, relative response times (RTs), a maximum of two response options, and a small number of graphical stimuli. The Flanker Task meets these criteria. We compared the reliability of individual differences in the Flanker Effect across samples and devices in a pre-registered study. We found no evidence that a more diverse sample yields higher reliabilities. We also found no evidence that commodity smartphones yield lower reliabilities than commodity laptops. Hence, diverse samples might not improve reliability above student samples, but smartphones may well measure individual differences with cognitive tasks reliably. Exploratively, we examined different reliability coefficients, split-half reliabilities, and the development of reliability estimates as a function of task length.
- Open Access
- 7 June 2021
- Published by Springer Nature in Psychonomic Bulletin & Review
- Vol. 29  (1) , 44-54
Methods to split cognitive task data for estimating split-half reliability: A comprehensive review and systematic assessment
Estimating the reliability of cognitive task datasets is commonly done via split-half methods. We review four methods that differ in how the trials are split into parts: a first-second half split, an odd-even trial split, a permutated split, and a Monte Carlo-based split. Additionally, each splitting method could be combined with stratification by task design. These methods are reviewed in terms of the degree to which they are confounded with four effects that may occur in cognitive tasks: effects of time, task design, trial sampling, and non-linear scoring. Based on the theoretical review, we recommend Monte Carlo splitting (possibly in combination with stratification by task design) as being the most robust method with respect to the four confounds considered. Next, we estimated the reliabilities of the main outcome variables from four cognitive task datasets, each (typically) scored with a different non-linear algorithm, by systematically applying each splitting method. Differences between methods were interpreted in terms of confounding effects inflating or attenuating reliability estimates. For three task datasets, our findings were consistent with our model of confounding effects. Evidence for confounding effects was strong for time and task design and weak for non-linear scoring. When confounding effects occurred, they attenuated reliability estimates. For one task dataset, findings were inconsistent with our model but they may offer indicators for assessing whether a split-half reliability estimate is appropriate. Additionally, we make suggestions on further research of reliability estimation, supported by a compendium R package that implements each of the splitting methods reviewed here.
- 7 June 2021
- Published by Springer Nature in Psychonomic Bulletin & Review
- Vol. 29  (1) , 44-54
Open AccessMethods to split cognitive task data for estimating split-half reliability: A comprehensive review and systematic assessment
Estimating the reliability of cognitive task datasets is commonly done via split-half methods. We review four methods that differ in how the trials are split into parts: a first-second half split, an odd-even trial split, a permutated split, and a Monte Carlo-based split. Additionally, each splitting method could be combined with stratification by task design. These methods are reviewed in terms of the degree to which they are confounded with four effects that may occur in cognitive tasks: effects of time, task design, trial sampling, and non-linear scoring. Based on the theoretical review, we recommend Monte Carlo splitting (possibly in combination with stratification by task design) as being the most robust method with respect to the four confounds considered. Next, we estimated the reliabilities of the main outcome variables from four cognitive task datasets, each (typically) scored with a different non-linear algorithm, by systematically applying each splitting method. Differences between methods were interpreted in terms of confounding effects inflating or attenuating reliability estimates. For three task datasets, our findings were consistent with our model of confounding effects. Evidence for confounding effects was strong for time and task design and weak for non-linear scoring. When confounding effects occurred, they attenuated reliability estimates. For one task dataset, findings were inconsistent with our model but they may offer indicators for assessing whether a split-half reliability estimate is appropriate. Additionally, we make suggestions on further research of reliability estimation, supported by a compendium R package that implements each of the splitting methods reviewed here.
- Open Access
- 28 October 2020
- Published by Center for Open Science in PsyArXiv
Methods to Split Cognitive Task Data for Estimating Split-Half Reliability: A Comprehensive Review and Systematic Assessment
Estimating the reliability of cognitive task datasets is commonly done via split-half methods. We review five different splitting methods: first-second half, odd-even trials, stratified, permutated, and Monte Carlo. These methods are reviewed in terms of the degree to which they are confounded with four effects that may occur in cognitive tasks: effects of time, task design, trial sampling, and non-linear scoring. We estimated the reliabilities of main outcome variables, using four cognitive task datasets, each (typically) scored with a different non-linear algorithm, by systematically applying each splitting method. Differences between methods were interpreted in terms of confounding effects inflating or attenuating reliability estimates. For three task datasets, our findings were consistent with our model. Evidence for confounding effects was strong for time and task design and weak for non-linear scoring. When confounding effects occurred, they attenuated reliability estimates. For one task dataset, findings were inconsistent with our model but they may offer indicators for assessing whether a split-half reliability estimate is appropriate. We offer suggestions regarding which splitting methods may be considered most robust and accurate. Additionally, we make suggestions on further research of reliability estimation, supported by a compendium R package that implements each of the splitting methods reviewed here.
- 28 October 2020
- Published by Center for Open Science in PsyArXiv
Open AccessMethods to Split Cognitive Task Data for Estimating Split-Half Reliability: A Comprehensive Review and Systematic Assessment
Estimating the reliability of cognitive task datasets is commonly done via split-half methods. We review five different splitting methods: first-second half, odd-even trials, stratified, permutated, and Monte Carlo. These methods are reviewed in terms of the degree to which they are confounded with four effects that may occur in cognitive tasks: effects of time, task design, trial sampling, and non-linear scoring. We estimated the reliabilities of main outcome variables, using four cognitive task datasets, each (typically) scored with a different non-linear algorithm, by systematically applying each splitting method. Differences between methods were interpreted in terms of confounding effects inflating or attenuating reliability estimates. For three task datasets, our findings were consistent with our model. Evidence for confounding effects was strong for time and task design and weak for non-linear scoring. When confounding effects occurred, they attenuated reliability estimates. For one task dataset, findings were inconsistent with our model but they may offer indicators for assessing whether a split-half reliability estimate is appropriate. We offer suggestions regarding which splitting methods may be considered most robust and accurate. Additionally, we make suggestions on further research of reliability estimation, supported by a compendium R package that implements each of the splitting methods reviewed here.
- Open Access
- 1 June 2020
- Published by Springer Nature in Behavior Research Methods
- Vol. 52  (3) , 1371-1382
Mental chronometry in the pocket? Timing accuracy of web applications on touchscreen and keyboard devices
Web applications can implement procedures for studying the speed of mental processes (mental chronometry) and can be administered via web browsers on most commodity desktops, laptops, smartphones, and tablets. This approach to conducting mental chronometry offers various opportunities, such as increased scale, ease of data collection, and access to specific samples. However, validity and reliability may be threatened by less accurate timing than specialized software and hardware can offer. We examined how accurately web applications time stimuli and register response times (RTs) on commodity touchscreen and keyboard devices running a range of popular web browsers. Additionally, we explored the accuracy of a range of technical innovations for timing stimuli, presenting stimuli, and estimating stimulus duration. The results offer some guidelines as to what methods may be most accurate and what mental chronometry paradigms may suitably be administered via web applications. In controlled circumstances, as can be realized in a lab setting, very accurate stimulus timing and moderately accurate RT measurements could be achieved on both touchscreen and keyboard devices, though RTs were consistently overestimated. In uncontrolled circumstances, such as researchers may encounter online, stimulus presentation may be less accurate, especially when brief durations are requested (of up to 100 ms). Differences in RT overestimation between devices might not substantially affect the reliability with which group differences can be found, but they may affect reliability for individual differences. In the latter case, measurement via absolute RTs can be more affected than measurement via relative RTs (i.e., differences in a participant’s RTs between conditions).
- 1 June 2020
- Published by Springer Nature in Behavior Research Methods
- Vol. 52  (3) , 1371-1382
Open AccessMental chronometry in the pocket? Timing accuracy of web applications on touchscreen and keyboard devices
Web applications can implement procedures for studying the speed of mental processes (mental chronometry) and can be administered via web browsers on most commodity desktops, laptops, smartphones, and tablets. This approach to conducting mental chronometry offers various opportunities, such as increased scale, ease of data collection, and access to specific samples. However, validity and reliability may be threatened by less accurate timing than specialized software and hardware can offer. We examined how accurately web applications time stimuli and register response times (RTs) on commodity touchscreen and keyboard devices running a range of popular web browsers. Additionally, we explored the accuracy of a range of technical innovations for timing stimuli, presenting stimuli, and estimating stimulus duration. The results offer some guidelines as to what methods may be most accurate and what mental chronometry paradigms may suitably be administered via web applications. In controlled circumstances, as can be realized in a lab setting, very accurate stimulus timing and moderately accurate RT measurements could be achieved on both touchscreen and keyboard devices, though RTs were consistently overestimated. In uncontrolled circumstances, such as researchers may encounter online, stimulus presentation may be less accurate, especially when brief durations are requested (of up to 100 ms). Differences in RT overestimation between devices might not substantially affect the reliability with which group differences can be found, but they may affect reliability for individual differences. In the latter case, measurement via absolute RTs can be more affected than measurement via relative RTs (i.e., differences in a participant’s RTs between conditions).
- Open Access
- 8 May 2020
- Published by JMIR Publications Inc. in JMIR Mental Health
- Vol. 7  (5) , e16342
Combining Web-Based Attentional Bias Modification and Approach Bias Modification as a Self-Help Smoking Intervention for Adult Smokers Seeking Online Help: Double-Blind Randomized Controlled Trial
Background: Automatically activated cognitive motivational processes such as the tendency to attend to or approach smoking-related stimuli (ie, attentional and approach bias) have been related to smoking behaviors. Therefore, these cognitive biases are thought to play a role in maintaining smoking behaviors. Cognitive biases can be modified with cognitive bias modification (CBM), which holds promise as an easy-access and low-cost online intervention. However, little is known about the effectiveness of online interventions combining two varieties of CBM. Targeting multiple cognitive biases may improve treatment outcomes because these biases have been shown to be relatively independent. Objective: This study aimed to test the individual and combined effects of two web-based CBM varieties—attentional bias modification (AtBM) and approach bias modification (ApBM)—in a double-blind randomized controlled trial (RCT) with a 2 (AtBM: active versus sham) × 2 (ApBM: active versus sham) factorial design. Methods: A total of 504 adult smokers seeking online help to quit smoking were randomly assigned to 1 of 4 experimental conditions to receive 11 fully automated CBM training sessions. To increase participants’ intrinsic motivation to change their smoking behaviors, all participants first received brief, automated, tailored feedback. The primary outcome was point prevalence abstinence during the study period. Secondary outcomes included daily cigarette use and attentional and approach bias. All outcomes were repeatedly self-assessed online from baseline to the 3-month follow-up. For the examination of training effects on outcome changes, an intention-to-treat analysis with a multilevel modeling (MLM) approach was adopted. Results: Only 10.7% (54/504) of the participants completed all 11 training sessions, and 8.3% (42/504) of the participants reached the 3-month follow-up assessment. MLM showed that over time, neither AtBM or ApBM nor a combination of both differed from their respective sham training in point prevalence abstinence rates (P=.17, P=.56, and P=.14, respectively), and in changes in daily cigarette use (P=.26, P=.08, and P=.13, respectively), attentional bias (P=.07, P=.81, and P=.15, respectively), and approach bias (P=.57, P=.22, and P=.40, respectively), while daily cigarette use decreased over time across conditions for all participants (P<.001). Conclusions: This RCT provides no support for the effectiveness of combining AtBM and ApBM in a self-help web-based smoking cessation intervention. However, this study had a very high dropout rate and a very low frequency of training usage, indicating an overall low acceptability of the intervention, which precludes any definite conclusion on its efficacy. We discuss how this study can inform future designs and settings of online CBM interventions. Trial Registration: Netherlands Trial Register NTR4678; https://www.trialregister.nl/trial/4678
- 8 May 2020
- Published by JMIR Publications Inc. in JMIR Mental Health
- Vol. 7  (5) , e16342
Open AccessCombining Web-Based Attentional Bias Modification and Approach Bias Modification as a Self-Help Smoking Intervention for Adult Smokers Seeking Online Help: Double-Blind Randomized Controlled Trial
Background: Automatically activated cognitive motivational processes such as the tendency to attend to or approach smoking-related stimuli (ie, attentional and approach bias) have been related to smoking behaviors. Therefore, these cognitive biases are thought to play a role in maintaining smoking behaviors. Cognitive biases can be modified with cognitive bias modification (CBM), which holds promise as an easy-access and low-cost online intervention. However, little is known about the effectiveness of online interventions combining two varieties of CBM. Targeting multiple cognitive biases may improve treatment outcomes because these biases have been shown to be relatively independent. Objective: This study aimed to test the individual and combined effects of two web-based CBM varieties—attentional bias modification (AtBM) and approach bias modification (ApBM)—in a double-blind randomized controlled trial (RCT) with a 2 (AtBM: active versus sham) × 2 (ApBM: active versus sham) factorial design. Methods: A total of 504 adult smokers seeking online help to quit smoking were randomly assigned to 1 of 4 experimental conditions to receive 11 fully automated CBM training sessions. To increase participants’ intrinsic motivation to change their smoking behaviors, all participants first received brief, automated, tailored feedback. The primary outcome was point prevalence abstinence during the study period. Secondary outcomes included daily cigarette use and attentional and approach bias. All outcomes were repeatedly self-assessed online from baseline to the 3-month follow-up. For the examination of training effects on outcome changes, an intention-to-treat analysis with a multilevel modeling (MLM) approach was adopted. Results: Only 10.7% (54/504) of the participants completed all 11 training sessions, and 8.3% (42/504) of the participants reached the 3-month follow-up assessment. MLM showed that over time, neither AtBM or ApBM nor a combination of both differed from their respective sham training in point prevalence abstinence rates (P=.17, P=.56, and P=.14, respectively), and in changes in daily cigarette use (P=.26, P=.08, and P=.13, respectively), attentional bias (P=.07, P=.81, and P=.15, respectively), and approach bias (P=.57, P=.22, and P=.40, respectively), while daily cigarette use decreased over time across conditions for all participants (P<.001). Conclusions: This RCT provides no support for the effectiveness of combining AtBM and ApBM in a self-help web-based smoking cessation intervention. However, this study had a very high dropout rate and a very low frequency of training usage, indicating an overall low acceptability of the intervention, which precludes any definite conclusion on its efficacy. We discuss how this study can inform future designs and settings of online CBM interventions. Trial Registration: Netherlands Trial Register NTR4678; https://www.trialregister.nl/trial/4678
- Open Access
- 17 October 2019
- Published by JMIR Publications Inc. in JMIR Preprints
Combining Web-Based Attentional Bias Modification and Approach Bias Modification as a Self-Help Smoking Intervention for Adult Smokers Seeking Online Help: Double-Blind Randomized Controlled Trial (Preprint)
BACKGROUND Automatically activated cognitive motivational processes such as the tendency to attend to or approach smoking-related stimuli (ie, attentional and approach bias) have been related to smoking behaviors. Therefore, these cognitive biases are thought to play a role in maintaining smoking behaviors. Cognitive biases can be modified with cognitive bias modification (CBM), which holds promise as an easy-access and low-cost online intervention. However, little is known about the effectiveness of online interventions combining two varieties of CBM. Targeting multiple cognitive biases may improve treatment outcomes because these biases have been shown to be relatively independent. OBJECTIVE This study aimed to test the individual and combined effects of two web-based CBM varieties—attentional bias modification (AtBM) and approach bias modification (ApBM)—in a double-blind randomized controlled trial (RCT) with a 2 (AtBM: active versus sham) × 2 (ApBM: active versus sham) factorial design. METHODS A total of 504 adult smokers seeking online help to quit smoking were randomly assigned to 1 of 4 experimental conditions to receive 11 fully automated CBM training sessions. To increase participants’ intrinsic motivation to change their smoking behaviors, all participants first received brief, automated, tailored feedback. The primary outcome was point prevalence abstinence during the study period. Secondary outcomes included daily cigarette use and attentional and approach bias. All outcomes were repeatedly self-assessed online from baseline to the 3-month follow-up. For the examination of training effects on outcome changes, an intention-to-treat analysis with a multilevel modeling (MLM) approach was adopted. RESULTS Only 10.7% (54/504) of the participants completed all 11 training sessions, and 8.3% (42/504) of the participants reached the 3-month follow-up assessment. MLM showed that over time, neither AtBM or ApBM nor a combination of both differed from their respective sham training in point prevalence abstinence rates (P=.17, P=.56, and P=.14, respectively), and in changes in daily cigarette use (P=.26, P=.08, and P=.13, respectively), attentional bias (P=.07, P=.81, and P=.15, respectively), and approach bias (P=.57, P=.22, and P=.40, respectively), while daily cigarette use decreased over time across conditions for all participants (P<.001). CONCLUSIONS This RCT provides no support for the effectiveness of combining AtBM and ApBM in a self-help web-based smoking cessation intervention. However, this study had a very high dropout rate and a very low frequency of training usage, indicating an overall low acceptability of the intervention, which precludes any definite conclusion on its efficacy. We discuss how this study can inform future designs and settings of online CBM interventions. CLINICALTRIAL Netherlands Trial Register NTR4678; https://www.trialregister.nl/trial/4678
- 17 October 2019
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessCombining Web-Based Attentional Bias Modification and Approach Bias Modification as a Self-Help Smoking Intervention for Adult Smokers Seeking Online Help: Double-Blind Randomized Controlled Trial (Preprint)
BACKGROUND Automatically activated cognitive motivational processes such as the tendency to attend to or approach smoking-related stimuli (ie, attentional and approach bias) have been related to smoking behaviors. Therefore, these cognitive biases are thought to play a role in maintaining smoking behaviors. Cognitive biases can be modified with cognitive bias modification (CBM), which holds promise as an easy-access and low-cost online intervention. However, little is known about the effectiveness of online interventions combining two varieties of CBM. Targeting multiple cognitive biases may improve treatment outcomes because these biases have been shown to be relatively independent. OBJECTIVE This study aimed to test the individual and combined effects of two web-based CBM varieties—attentional bias modification (AtBM) and approach bias modification (ApBM)—in a double-blind randomized controlled trial (RCT) with a 2 (AtBM: active versus sham) × 2 (ApBM: active versus sham) factorial design. METHODS A total of 504 adult smokers seeking online help to quit smoking were randomly assigned to 1 of 4 experimental conditions to receive 11 fully automated CBM training sessions. To increase participants’ intrinsic motivation to change their smoking behaviors, all participants first received brief, automated, tailored feedback. The primary outcome was point prevalence abstinence during the study period. Secondary outcomes included daily cigarette use and attentional and approach bias. All outcomes were repeatedly self-assessed online from baseline to the 3-month follow-up. For the examination of training effects on outcome changes, an intention-to-treat analysis with a multilevel modeling (MLM) approach was adopted. RESULTS Only 10.7% (54/504) of the participants completed all 11 training sessions, and 8.3% (42/504) of the participants reached the 3-month follow-up assessment. MLM showed that over time, neither AtBM or ApBM nor a combination of both differed from their respective sham training in point prevalence abstinence rates (P=.17, P=.56, and P=.14, respectively), and in changes in daily cigarette use (P=.26, P=.08, and P=.13, respectively), attentional bias (P=.07, P=.81, and P=.15, respectively), and approach bias (P=.57, P=.22, and P=.40, respectively), while daily cigarette use decreased over time across conditions for all participants (P<.001). CONCLUSIONS This RCT provides no support for the effectiveness of combining AtBM and ApBM in a self-help web-based smoking cessation intervention. However, this study had a very high dropout rate and a very low frequency of training usage, indicating an overall low acceptability of the intervention, which precludes any definite conclusion on its efficacy. We discuss how this study can inform future designs and settings of online CBM interventions. CLINICALTRIAL Netherlands Trial Register NTR4678; https://www.trialregister.nl/trial/4678
- Open Access
Mental Chronometry in the Pocket? Timing Accuracy of Web Applications on Touchscreen and Keyboard Devices
Web applications can implement procedures for studying the speed of mental processes (mental chronometry). As web applications, these procedures can be administered via web-browsers on most commodity desktops, laptops, smartphones, and tablets. This approach to conducting mental chronometry offers various opportunities, such as increased scale, ease of data collection, and access to specific samples. However, validity and reliability may be threatened due to web applications on commodity devices having less accurate timing than specialized software and hardware. We have examined how accurately web applications time stimuli and register response times on commodity touchscreen and keyboard devices running a range of popular web-browsers. Additionally, we have explored the accuracy of a range of technical innovations for timing stimuli, presenting stimuli, and estimating stimulus duration. Results offer some guidelines as to what kind of methods may be most accurate, and what kind of mental chronometry paradigms may suitably be administered via web applications. In controlled circumstances, as can be realized in a lab setting, very accurate stimulus timing and moderately accurate Reaction Time (RT) measurements could be achieved on both touchscreen and keyboard devices. In uncontrolled circumstances, as may be encountered online, short stimulus durations (of up to 100 ms) may be inaccurate, and RT measurement may be affected by the occurrence of bi-modally distributed RT overestimations.
Open AccessMental Chronometry in the Pocket? Timing Accuracy of Web Applications on Touchscreen and Keyboard Devices
Web applications can implement procedures for studying the speed of mental processes (mental chronometry). As web applications, these procedures can be administered via web-browsers on most commodity desktops, laptops, smartphones, and tablets. This approach to conducting mental chronometry offers various opportunities, such as increased scale, ease of data collection, and access to specific samples. However, validity and reliability may be threatened due to web applications on commodity devices having less accurate timing than specialized software and hardware. We have examined how accurately web applications time stimuli and register response times on commodity touchscreen and keyboard devices running a range of popular web-browsers. Additionally, we have explored the accuracy of a range of technical innovations for timing stimuli, presenting stimuli, and estimating stimulus duration. Results offer some guidelines as to what kind of methods may be most accurate, and what kind of mental chronometry paradigms may suitably be administered via web applications. In controlled circumstances, as can be realized in a lab setting, very accurate stimulus timing and moderately accurate Reaction Time (RT) measurements could be achieved on both touchscreen and keyboard devices. In uncontrolled circumstances, as may be encountered online, short stimulus durations (of up to 100 ms) may be inaccurate, and RT measurement may be affected by the occurrence of bi-modally distributed RT overestimations.