Sophia Braumann
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Sophia Braumann has a total of 13 co-authors. Here are the top co-authors by number of shared publications:
Janneke van de Pol
Department of Education Utrecht University Utrecht The Netherlands
2 shared publicationsTamara van Gog
Department of Education Utrecht University Utrecht The Netherlands
2 shared publicationsAnique B. H. de Bruin
Department of Educational Development and Research Maastricht University Maastricht MD The Netherlands
1 shared publication- Anique B. H. de Bruin
Department of Educational Development and Research, School of Health Professions Education (SHE), Maastricht University, Maastricht, The Netherlands
1 shared publication Anique B.H. de Bruin
1 shared publicationEllen Kok
1 shared publication
Latest Publications
- Open Access
- 16 January 2024
- Published by Wiley in Applied Cognitive Psychology
- Vol. 38 (1)
Causal diagramming to improve students' monitoring accuracy and text comprehension: Effects of diagram standards and self‐scoring instructions
Students' monitoring of their text comprehension must be accurate for self‐regulated learning to be effective. Completing causal diagrams after reading (i.e., diagramming) already improves students' monitoring accuracy to some extent. We investigated whether providing secondary school students with a standard (i.e., correctly completed) diagram and self‐scoring instructions would further improve their monitoring accuracy and text comprehension in a delayed (Experiment 1; n = 98) or immediate (Experiment 2; n = 177) diagramming design. Self‐scoring instructions did not improve monitoring accuracy or text comprehension compared to the control condition(s) in either experiment. Presumably, students self‐scored their diagrams even without instructions to do so. In contrast to findings from prior diagramming research without standards, an explorative analysis suggests that delayed and immediate diagramming did not produce differences in monitoring accuracy. Immediate diagramming, however, led to better text comprehension than delayed diagramming and may therefore be preferable over delayed diagramming under certain conditions.
- 16 January 2024
- Published by Wiley in Applied Cognitive Psychology
- Vol. 38 (1)
Open AccessCausal diagramming to improve students' monitoring accuracy and text comprehension: Effects of diagram standards and self‐scoring instructions
Students' monitoring of their text comprehension must be accurate for self‐regulated learning to be effective. Completing causal diagrams after reading (i.e., diagramming) already improves students' monitoring accuracy to some extent. We investigated whether providing secondary school students with a standard (i.e., correctly completed) diagram and self‐scoring instructions would further improve their monitoring accuracy and text comprehension in a delayed (Experiment 1; n = 98) or immediate (Experiment 2; n = 177) diagramming design. Self‐scoring instructions did not improve monitoring accuracy or text comprehension compared to the control condition(s) in either experiment. Presumably, students self‐scored their diagrams even without instructions to do so. In contrast to findings from prior diagramming research without standards, an explorative analysis suggests that delayed and immediate diagramming did not produce differences in monitoring accuracy. Immediate diagramming, however, led to better text comprehension than delayed diagramming and may therefore be preferable over delayed diagramming under certain conditions.
- Open Access
- 16 January 2024
- Published by Wiley in British Journal of Educational Technology
- Vol. 55 (4) , 1354-1375
Towards adaptive support for self‐regulated learning of causal relations: Evaluating four Dutch word vector models
Advances in computational language models increasingly enable adaptive support for self‐regulated learning (SRL) in digital learning environments (DLEs; eg, via automated feedback). However, the accuracy of those models is a common concern for educational stakeholders (eg, policymakers, researchers, teachers and learners themselves). We compared the accuracy of four Dutch language models (ie, spaCy medium, spaCy large, FastText and ConceptNet NumberBatch) in the context of secondary school students' learning of causal relations from expository texts, scaffolded by causal diagram completion. Since machine learning relies on human‐labelled data for the best results, we used a dataset with 10,193 students' causal diagram answers, compiled over a decade of research using a diagram completion intervention to enhance students' monitoring of their text comprehension. The language models were used in combination with four popular machine learning classifiers (ie, logistic regression, random forests, support vector machine and neural networks) to evaluate their performance on automatically scoring students' causal diagrams in terms of the correctness of events and their sequence (ie, the causal structure). Five performance metrics were studied, namely accuracy, precision, recall, F 1 and the area under the curve of the receiver operating characteristic (ROC‐AUC). The spaCy medium model combined with the neural network classifier achieved the best performance for the correctness of causal events in four of the five metrics, while the ConceptNet NumberBatch model worked best for the correctness of the causal sequence. These evaluation results provide a criterion for model adoption to adaptively support SRL of causal relations in DLEs. Practitioner notes: What is already known about this topic Accurate monitoring is a prerequisite for effective self‐regulation. Students struggle to accurately monitor their comprehension of causal relations in texts. Completing causal diagrams improves students' monitoring accuracy, but there is room for further improvement. Automatic scoring could be used to provide adaptive support during diagramming. What this paper adds Comparison of four Dutch word vector models combined with four machine learning classifiers for the automatic scoring of students' causal diagrams. Five performance metrics to evaluate the above solutions. Evaluation of the word vector models for estimating the semantic similarity between student and model answers. Implications for practice and/or policy High‐quality word vector models could (em)power adaptive support during causal diagramming via automatic scoring. The evaluated solutions can be embedded in digital learning environments (DLEs). Criteria for model adoption to adaptively support SRL of causal relations in DLEs. The increased saliency of (in)correct answers via automatic scoring might help to improve students' monitoring accuracy.
- 16 January 2024
- Published by Wiley in British Journal of Educational Technology
- Vol. 55 (4) , 1354-1375
Open AccessTowards adaptive support for self‐regulated learning of causal relations: Evaluating four Dutch word vector models
Advances in computational language models increasingly enable adaptive support for self‐regulated learning (SRL) in digital learning environments (DLEs; eg, via automated feedback). However, the accuracy of those models is a common concern for educational stakeholders (eg, policymakers, researchers, teachers and learners themselves). We compared the accuracy of four Dutch language models (ie, spaCy medium, spaCy large, FastText and ConceptNet NumberBatch) in the context of secondary school students' learning of causal relations from expository texts, scaffolded by causal diagram completion. Since machine learning relies on human‐labelled data for the best results, we used a dataset with 10,193 students' causal diagram answers, compiled over a decade of research using a diagram completion intervention to enhance students' monitoring of their text comprehension. The language models were used in combination with four popular machine learning classifiers (ie, logistic regression, random forests, support vector machine and neural networks) to evaluate their performance on automatically scoring students' causal diagrams in terms of the correctness of events and their sequence (ie, the causal structure). Five performance metrics were studied, namely accuracy, precision, recall, F 1 and the area under the curve of the receiver operating characteristic (ROC‐AUC). The spaCy medium model combined with the neural network classifier achieved the best performance for the correctness of causal events in four of the five metrics, while the ConceptNet NumberBatch model worked best for the correctness of the causal sequence. These evaluation results provide a criterion for model adoption to adaptively support SRL of causal relations in DLEs. Practitioner notes: What is already known about this topic Accurate monitoring is a prerequisite for effective self‐regulation. Students struggle to accurately monitor their comprehension of causal relations in texts. Completing causal diagrams improves students' monitoring accuracy, but there is room for further improvement. Automatic scoring could be used to provide adaptive support during diagramming. What this paper adds Comparison of four Dutch word vector models combined with four machine learning classifiers for the automatic scoring of students' causal diagrams. Five performance metrics to evaluate the above solutions. Evaluation of the word vector models for estimating the semantic similarity between student and model answers. Implications for practice and/or policy High‐quality word vector models could (em)power adaptive support during causal diagramming via automatic scoring. The evaluated solutions can be embedded in digital learning environments (DLEs). Criteria for model adoption to adaptively support SRL of causal relations in DLEs. The increased saliency of (in)correct answers via automatic scoring might help to improve students' monitoring accuracy.
- Open Access
- 14 November 2023
- Published by Elsevier in Contemporary Educational Psychology
- Vol. 76
The role of feedback on students’ diagramming: Effects on monitoring accuracy and text comprehension
- 14 November 2023
- Published by Elsevier in Contemporary Educational Psychology
- Vol. 76
Open AccessThe role of feedback on students’ diagramming: Effects on monitoring accuracy and text comprehension