Jenny Tarvainen
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Jenny Tarvainen has a total of 16 co-authors. Here are the top co-authors by number of shared publications:
- Ari Huhta
Jyväskylän yliopisto
1 shared publication - Eva Brooks
Aalborg University, Aalborg, Denmark
1 shared publication - Ida Toivanen
University of Jyväskylä, Jyväskylä, Finland
1 shared publication - Jeanette Sjöberg
Halmstad University
1 shared publication - Judit Háhn
University of Jyväskylä
1 shared publication - Kristín Björnsdóttir
Háskóli Íslands - Menntavísindasvið
1 shared publication
Latest Publications
- 1 December 2025
- Published by The Association for Language Testing and Assessment of Australia and New Zealand in Studies in Language Assessment
- Vol. 14 (2)
Automatic language proficiency assessment of written texts: Training a CEFR classifier in L2 Finnish
This paper explores automatic assessment of written language proficiency. We have trained a CEFR-classifier for texts that have been written by Finnish as a second or foreign language (L2) learners. The aim of the study is to investigate to what extent we can model human ratings with the available L2 data for Finnish, whether the accuracy of the predictions varies at the different CEFR levels, and whether we can explain the discovered misclassifications. The FinBERT model was trained on the largest available CEFR-annotated datasets for L2 Finnish: ICLFI, LAS2, CEFLING, and TOPLING, which represent different kinds of genres, first language backgrounds, ages, and genders. The results are promising, with an F1-score of 72.7% and a .86 Pearson correlation between machine predictions and human assessors. Learners’ gender was not related to classification accuracy but learners’ L1 background may have some effect. However, text length seemed to cause misclassifications as unusually short or long samples were often assessed lower / higher than expected. While more annotated data is needed to train a more accurate model for higher-stakes assessment purposes, the open-source model developed in the study is likely useful for formative feedback purposes and paves the way for further work in the future.
- 1 December 2025
- Published by The Association for Language Testing and Assessment of Australia and New Zealand in Studies in Language Assessment
- Vol. 14 (2)
Automatic language proficiency assessment of written texts: Training a CEFR classifier in L2 Finnish
This paper explores automatic assessment of written language proficiency. We have trained a CEFR-classifier for texts that have been written by Finnish as a second or foreign language (L2) learners. The aim of the study is to investigate to what extent we can model human ratings with the available L2 data for Finnish, whether the accuracy of the predictions varies at the different CEFR levels, and whether we can explain the discovered misclassifications. The FinBERT model was trained on the largest available CEFR-annotated datasets for L2 Finnish: ICLFI, LAS2, CEFLING, and TOPLING, which represent different kinds of genres, first language backgrounds, ages, and genders. The results are promising, with an F1-score of 72.7% and a .86 Pearson correlation between machine predictions and human assessors. Learners’ gender was not related to classification accuracy but learners’ L1 background may have some effect. However, text length seemed to cause misclassifications as unusually short or long samples were often assessed lower / higher than expected. While more annotated data is needed to train a more accurate model for higher-stakes assessment purposes, the open-source model developed in the study is likely useful for formative feedback purposes and paves the way for further work in the future.
- 26 May 2025
- Published by Springer Nature
- p. 194-218
“Do As Your Teacher Tells You!” How Is AI Use Regulated in Nordic Higher Education Institutions?
- 26 May 2025
- Published by Springer Nature
- p. 194-218
“Do As Your Teacher Tells You!” How Is AI Use Regulated in Nordic Higher Education Institutions?