Michiel Pieter Bron
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Michiel Pieter Bron has a total of 23 co-authors. Here are the top co-authors by number of shared publications:
- Elena Jalsovec
Department of Methodology and Statistics, Faculty of Social and Behavioural Sciences, Utrecht University, Utrecht, The Netherlands
2 shared publications - Elizabeth M. Grandfield
Utrecht University
2 shared publications - Elize Herrewijnen
National Police Lab AI, Utrecht University, The Netherlands
2 shared publications - Felix Weijdema
Utrecht University Library, Utrecht University, Utrecht, The Netherlands
2 shared publications - Floris Bex
Utrecht University
2 shared publications - Jelle Jasper Teijema
Department of Methodology and Statistics, Faculty of Social and Behavioral Sciences, Utrecht University, the Netherlands
2 shared publications
Latest Publications
- Open Access
- 15 October 2025
- Published by Taylor & Francis in European Journal of Psychotraumatology
- Vol. 16 (1) , 2546214
The hunt for the last relevant paper: blending the best of humans and AI
Background: The exponential growth of research literature makes it increasingly difficult to identify all relevant studies for systematic reviews and meta-analyses. While traditional search methods are labour-intensive, modern AI-aided approaches have the potential to act as a powerful 'super-assistant' during both the searching and screening phases.Objective: This paper evaluates how a combined, open-source approach - merging traditional and AI-aided search and screening methods - can help identify all relevant literature up to the 'last relevant paper' for a systematic review on post-traumatic stress symptom (PTSS) trajectories after traumatic events.Method: We applied eight search strategies, including database searches, snowballing, full-text retrieval, and semantic search via OpenAlex. All records were screened using a combination of human reviewers, active learning, and large language models (LLMs) for quality control.Results: On top of replicating the original 6,701 search results, we identified an additional 3,822 records using AI-aided methods. The combination of AI tools and human screening led to 126 relevant studies, with each method uncovering papers the others missed. Notably, machine-aided techniques helped find studies with missing keywords, unusual phrasing, or limited indexing. Across all AI-assisted strategies, 10 additional studies were identified, and while the overall yield was modest, these papers were unique and relevant and would likely have been missed using traditional methods.Conclusions: Our findings demonstrate that even when returns are low, AI-aided approaches can meaningfully enhance coverage and offer a scalable path forward when combined with screening prioritisation. A transparent, hybrid workflow where AI serves as a 'super-assistant' can meaningfully extend the reach of systematic reviews and increase the quality of the findings, but is not ready to replace humans fully.
- 15 October 2025
- Published by Taylor & Francis in European Journal of Psychotraumatology
- Vol. 16 (1) , 2546214
Open AccessThe hunt for the last relevant paper: blending the best of humans and AI
Background: The exponential growth of research literature makes it increasingly difficult to identify all relevant studies for systematic reviews and meta-analyses. While traditional search methods are labour-intensive, modern AI-aided approaches have the potential to act as a powerful 'super-assistant' during both the searching and screening phases.Objective: This paper evaluates how a combined, open-source approach - merging traditional and AI-aided search and screening methods - can help identify all relevant literature up to the 'last relevant paper' for a systematic review on post-traumatic stress symptom (PTSS) trajectories after traumatic events.Method: We applied eight search strategies, including database searches, snowballing, full-text retrieval, and semantic search via OpenAlex. All records were screened using a combination of human reviewers, active learning, and large language models (LLMs) for quality control.Results: On top of replicating the original 6,701 search results, we identified an additional 3,822 records using AI-aided methods. The combination of AI tools and human screening led to 126 relevant studies, with each method uncovering papers the others missed. Notably, machine-aided techniques helped find studies with missing keywords, unusual phrasing, or limited indexing. Across all AI-assisted strategies, 10 additional studies were identified, and while the overall yield was modest, these papers were unique and relevant and would likely have been missed using traditional methods.Conclusions: Our findings demonstrate that even when returns are low, AI-aided approaches can meaningfully enhance coverage and offer a scalable path forward when combined with screening prioritisation. A transparent, hybrid workflow where AI serves as a 'super-assistant' can meaningfully extend the reach of systematic reviews and increase the quality of the findings, but is not ready to replace humans fully.
- Open Access
- 13 October 2025
- Published by The Open Journal in Journal of Open Source Software
- Vol. 10 (114) , 8253
Explabox: A Python Toolkit for Standardized Auditing and Explanation of Text Models
Developed to meet the practical machine learning (ML) auditing requirements of the Netherlands National Police, Explabox is an open-source Python toolkit that implements a standardized four-step analysis workflow: explore, examine, explain, and expose. The framework transforms models and data (ingestibles) into interpretable reports and visualizations (digestibles), covering everything from data statistics and performance metrics to local and global explanations, and sensitivity testing for fairness, robustness, and security. Designed for developers, testers, and auditors, Explabox operationalizes the entire audit lifecycle in a reproducible manner. The initial release is focused on text classification and regression models, with plans for future expansion.
- 13 October 2025
- Published by The Open Journal in Journal of Open Source Software
- Vol. 10 (114) , 8253
Open AccessExplabox: A Python Toolkit for Standardized Auditing and Explanation of Text Models
Developed to meet the practical machine learning (ML) auditing requirements of the Netherlands National Police, Explabox is an open-source Python toolkit that implements a standardized four-step analysis workflow: explore, examine, explain, and expose. The framework transforms models and data (ingestibles) into interpretable reports and visualizations (digestibles), covering everything from data statistics and performance metrics to local and global explanations, and sensitivity testing for fairness, robustness, and security. Designed for developers, testers, and auditors, Explabox operationalizes the entire audit lifecycle in a reproducible manner. The initial release is focused on text classification and regression models, with plans for future expansion.
- Open Access
- 9 May 2025
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Information Systems
- Vol. 43 (3) , 1-51
Using Chao’s Estimator as a Stopping Criterion for Technology-Assisted Review
Technology-Assisted Review aims to reduce the human effort required for screening processes such as abstract screening for Systematic Literature Reviews. Human reviewers label documents as relevant or irrelevant during this process, while the system incrementally updates a prediction model based on the reviewers’ previous decisions. After each model update, the system proposes new documents it deems relevant, to prioritize relevant documents over irrelevant ones. A stopping criterion is necessary to guide users in stopping the review process to minimize the number of missed relevant documents and the number of read irrelevant documents. In this article, we propose and evaluate a new ensemble-based Active Learning strategy and a stopping criterion based on Chao’s Population Size Estimator that estimates the prevalence of relevant documents in the dataset. Our simulation study demonstrates that this criterion performs well on several datasets and is compared to other methods presented in the literature.
- 9 May 2025
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Information Systems
- Vol. 43 (3) , 1-51
Open AccessUsing Chao’s Estimator as a Stopping Criterion for Technology-Assisted Review
Technology-Assisted Review aims to reduce the human effort required for screening processes such as abstract screening for Systematic Literature Reviews. Human reviewers label documents as relevant or irrelevant during this process, while the system incrementally updates a prediction model based on the reviewers’ previous decisions. After each model update, the system proposes new documents it deems relevant, to prioritize relevant documents over irrelevant ones. A stopping criterion is necessary to guide users in stopping the review process to minimize the number of missed relevant documents and the number of read irrelevant documents. In this article, we propose and evaluate a new ensemble-based Active Learning strategy and a stopping criterion based on Chao’s Population Size Estimator that estimates the prevalence of relevant documents in the dataset. Our simulation study demonstrates that this criterion performs well on several datasets and is compared to other methods presented in the literature.
- Open Access
- 5 February 2025
- Published by Center for Open Science in PsyArXiv
The Hunt for the Last Relevant Paper: Blending the best of humans and AI
The rapid expansion of research literature makes capturing all relevant studies for systematic reviews and meta-analyses increasingly challenging. Traditional search methods are time-intensive and heavily reliant on manual screening, yet more modern machine-aided strategies may also miss certain studies. This paper explores a collaborative, open-source approach for blending both approaches to identify all relevant literature up to the “last relevant paper” for a systematic review of post-traumatic stress symptom (PTSS) trajectories. We compared the results from eight search strategies, including conventional database searches, snowballing, full-text searches via the Dimensions database, and machine-aided methods of semantic vectorization with cosine similarity matching via the OpenAlex database. Thereafter, we combined human screening efforts with active learning–aided screening plus a large language model (LLMs) based quality check. In total, 3.822 records were added on top of the 6.701 records identified with replicating the initial search. Machine-aided methods found papers overlooked by traditional techniques—particularly papers missing conventional keywords, published in unindexed journals, or featuring unconventional phrasing. The human-AI screening approach resulted in 127 relevant studies. Active learning and LLMs were used to increase the quality of the labels, with both methods adding relevant papers overlooked by the human screeners. In conclusion, our findings also make it evident that even with exhaustive effort and sophisticated technologies, there remains the possibility that certain papers will still be missed. The evolving nature of academic publishing, varying terminologies, and publication delays mean that the pursuit of the "last relevant paper" is inherently a never-ending process.
- 5 February 2025
- Published by Center for Open Science in PsyArXiv
Open AccessThe Hunt for the Last Relevant Paper: Blending the best of humans and AI
The rapid expansion of research literature makes capturing all relevant studies for systematic reviews and meta-analyses increasingly challenging. Traditional search methods are time-intensive and heavily reliant on manual screening, yet more modern machine-aided strategies may also miss certain studies. This paper explores a collaborative, open-source approach for blending both approaches to identify all relevant literature up to the “last relevant paper” for a systematic review of post-traumatic stress symptom (PTSS) trajectories. We compared the results from eight search strategies, including conventional database searches, snowballing, full-text searches via the Dimensions database, and machine-aided methods of semantic vectorization with cosine similarity matching via the OpenAlex database. Thereafter, we combined human screening efforts with active learning–aided screening plus a large language model (LLMs) based quality check. In total, 3.822 records were added on top of the 6.701 records identified with replicating the initial search. Machine-aided methods found papers overlooked by traditional techniques—particularly papers missing conventional keywords, published in unindexed journals, or featuring unconventional phrasing. The human-AI screening approach resulted in 127 relevant studies. Active learning and LLMs were used to increase the quality of the labels, with both methods adding relevant papers overlooked by the human screeners. In conclusion, our findings also make it evident that even with exhaustive effort and sophisticated technologies, there remains the possibility that certain papers will still be missed. The evolving nature of academic publishing, varying terminologies, and publication delays mean that the pursuit of the "last relevant paper" is inherently a never-ending process.
- Open Access
The Explabox: Model-Agnostic Machine Learning Transparency & Analysis
We present the Explabox: an open-source toolkit for transparent and responsible machine learning (ML) model development and usage. Explabox aids in achieving explainable, fair and robust models by employing a four-step strategy: explore, examine, explain and expose. These steps offer model-agnostic analyses that transform complex 'ingestibles' (models and data) into interpretable 'digestibles'. The toolkit encompasses digestibles for descriptive statistics, performance metrics, model behavior explanations (local and global), and robustness, security, and fairness assessments. Implemented in Python, Explabox supports multiple interaction modes and builds on open-source packages. It empowers model developers and testers to operationalize explainability, fairness, auditability, and security. The initial release focuses on text data and models, with plans for expansion. Explabox's code and documentation are available open-source at https://explabox.readthedocs.io/.
Open AccessThe Explabox: Model-Agnostic Machine Learning Transparency & Analysis
We present the Explabox: an open-source toolkit for transparent and responsible machine learning (ML) model development and usage. Explabox aids in achieving explainable, fair and robust models by employing a four-step strategy: explore, examine, explain and expose. These steps offer model-agnostic analyses that transform complex 'ingestibles' (models and data) into interpretable 'digestibles'. The toolkit encompasses digestibles for descriptive statistics, performance metrics, model behavior explanations (local and global), and robustness, security, and fairness assessments. Implemented in Python, Explabox supports multiple interaction modes and builds on open-source packages. It empowers model developers and testers to operationalize explainability, fairness, auditability, and security. The initial release focuses on text data and models, with plans for expansion. Explabox's code and documentation are available open-source at https://explabox.readthedocs.io/.