Itsuki Aomi
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Itsuki Aomi has a total of 7 co-authors. Here are the top co-authors by number of shared publications:
- Maomi Ueno
University of Electro-Communications, Tokyo, Japan
2 shared publications Emiko Tsutsumi
The University of Electro-Communications
1 shared publication- Emiko Tsutsumi
Hosei University
1 shared publication Maomi Ueno
The University of Electro-Communications
1 shared publicationMasaki Uto
The University of Electro-Communications
1 shared publication- Masaki Uto
The University of Electro-Communications, Chofu, Japan
1 shared publication
Latest Publications
- Open Access
- 6 March 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Learning Technologies
- Vol. 16 (6) , 983-1000
Integration of Prediction Scores From Various Automated Essay Scoring Models Using Item Response Theory
In automated essay scoring (AES), essays are automatically graded without human raters. Many AES models based on various manually designed features or various architectures of deep neural networks have been proposed over the past few decades. Each AES model has unique advantages and characteristics. Therefore, rather than using a single AES model, appropriate integration of predictions from various AES models is expected to achieve higher scoring accuracy. In the present paper, we propose a method that uses item response theory to integrate prediction scores from various AES models while taking into account differences in the characteristics of scoring behavior among models. It is found that the proposed method achieves higher accuracy than that of individual AES models and conventional score-integration methods. Furthermore, the proposed method facilitates interpreting each AES model's scoring characteristics and score-integration mechanism.
- 6 March 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Learning Technologies
- Vol. 16 (6) , 983-1000
Open AccessIntegration of Prediction Scores From Various Automated Essay Scoring Models Using Item Response Theory
In automated essay scoring (AES), essays are automatically graded without human raters. Many AES models based on various manually designed features or various architectures of deep neural networks have been proposed over the past few decades. Each AES model has unique advantages and characteristics. Therefore, rather than using a single AES model, appropriate integration of predictions from various AES models is expected to achieve higher scoring accuracy. In the present paper, we propose a method that uses item response theory to integrate prediction scores from various AES models while taking into account differences in the characteristics of scoring behavior among models. It is found that the proposed method achieves higher accuracy than that of individual AES models and conventional score-integration methods. Furthermore, the proposed method facilitates interpreting each AES model's scoring characteristics and score-integration mechanism.
- Open Access
Bayesian Network Model Averaging Classifiers by Subbagging
When applied to classification problems, Bayesian networks are often used to infer a class variable when given feature variables. Earlier reports have described that the classification accuracy of Bayesian network structures achieved by maximizing the marginal likelihood (ML) is lower than that achieved by maximizing the conditional log likelihood (CLL) of a class variable given the feature variables. Nevertheless, because ML has asymptotic consistency, the performance of Bayesian network structures achieved by maximizing ML is not necessarily worse than that achieved by maximizing CLL for large data. However, the error of learning structures by maximizing the ML becomes much larger for small sample sizes. That large error degrades the classification accuracy. As a method to resolve this shortcoming, model averaging has been proposed to marginalize the class variable posterior over all structures. However, the posterior standard error of each structure in the model averaging becomes large as the sample size becomes small; it subsequently degrades the classification accuracy. The main idea of this study is to improve the classification accuracy using subbagging, which is modified bagging using random sampling without replacement, to reduce the posterior standard error of each structure in model averaging. Moreover, to guarantee asymptotic consistency, we use the K-best method with the ML score. The experimentally obtained results demonstrate that our proposed method provides more accurate classification than earlier BNC methods and the other state-of-the-art ensemble methods do.
Open AccessBayesian Network Model Averaging Classifiers by Subbagging
When applied to classification problems, Bayesian networks are often used to infer a class variable when given feature variables. Earlier reports have described that the classification accuracy of Bayesian network structures achieved by maximizing the marginal likelihood (ML) is lower than that achieved by maximizing the conditional log likelihood (CLL) of a class variable given the feature variables. Nevertheless, because ML has asymptotic consistency, the performance of Bayesian network structures achieved by maximizing ML is not necessarily worse than that achieved by maximizing CLL for large data. However, the error of learning structures by maximizing the ML becomes much larger for small sample sizes. That large error degrades the classification accuracy. As a method to resolve this shortcoming, model averaging has been proposed to marginalize the class variable posterior over all structures. However, the posterior standard error of each structure in the model averaging becomes large as the sample size becomes small; it subsequently degrades the classification accuracy. The main idea of this study is to improve the classification accuracy using subbagging, which is modified bagging using random sampling without replacement, to reduce the posterior standard error of each structure in model averaging. Moreover, to guarantee asymptotic consistency, we use the K-best method with the ML score. The experimentally obtained results demonstrate that our proposed method provides more accurate classification than earlier BNC methods and the other state-of-the-art ensemble methods do.
- 12 June 2021
- Published by Springer Nature
- p. 54-59
Integration of Automated Essay Scoring Models Using Item Response Theory
- 12 June 2021
- Published by Springer Nature
- p. 54-59
Integration of Automated Essay Scoring Models Using Item Response Theory