Ani Grubišić
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Ani Grubišić has a total of 35 co-authors. Here are the top co-authors by number of shared publications:
- Branko Žitko
University of Split, Faculty of Science Split Croatia
12 shared publications - Ines Šarić-Grgić
Faculty of Science, University of Split, Split, Croatia
11 shared publications - Angelina Gašpar
University of Split
8 shared publications Slavomir Stankov
University of Split
8 shared publications- Daniel Vasić
University of Mostar, Mostar, Bosnia and Herzegovina
6 shared publications Branko Žitko
University of Split, Croatia
4 shared publications
Latest Publications
- Open Access
- 6 September 2026
- Published by Elsevier in Knowledge-Based Systems
- Vol. 352
Rule-based semantic hypergraph parsing from textual annotations
- 6 September 2026
- Published by Elsevier in Knowledge-Based Systems
- Vol. 352
Open AccessRule-based semantic hypergraph parsing from textual annotations
- Open Access
- 9 June 2025
- Published by Wiley in Journal of Computer Assisted Learning
- Vol. 41 (4)
Usability Evaluation of an Adaptive Courseware Approach in the Natural Language‐Based Intelligent Tutoring System‐Tutomat
Background: Adaptive educational systems have gained increasing attention due to their ability to personalise educational content based on individual learner progress. Prior research highlights that intelligent tutoring systems (ITSs) and adaptive courseware models improve learning outcomes by dynamically adjusting instructional materials. However, despite advancements in adaptive learning environments, usability remains a critical factor influencing their effectiveness and adoption. Therefore, a need exists to evaluate the usability of adaptive tutoring systems to ensure they provide optimal user experience whilst maintaining high instructional effectiveness.Objectives: This study examines the usability and learning experience of Tutomat, an adaptive courseware system designed for automated, real‐time content adaptation. Specifically, it aims to examine usability based on user interactions and feedback, assess learning effectiveness and engagement through pre‐test/post‐test comparisons and user feedback, identify key usability challenges and propose improvements for enhancing user experience.Methods: A mixed‐methods usability evaluation was conducted with 14 participants, applying both quantitative and qualitative research designs. The quantitative study used pre‐test/post‐test comparisons and System Usability Scale (SUS) scores to measure knowledge acquisition and usability perceptions. The qualitative study involved scenario‐based usability testing, where participants completed eight structured tasks. Data analysis included Wilcoxon Signed‐Ranks tests for learning gains, descriptive statistics for usability scores and analysis for qualitative feedback.Results: Findings indicate that Tutomat significantly improved student knowledge, as demonstrated by pre‐test/post‐test comparisons (W = 0, p < 0.05). The SUS score of 68.21 suggests acceptable usability, though strict answer validation and unclear navigation caused user frustration. Scenario‐based testing identified usability challenges, particularly in feature discoverability and response flexibility, which impacted the user experience. Participants valued adaptive feedback and structured content but expressed concerns regarding interface design limitations.Conclusion: This study highlights the importance of usability in adaptive educational systems, demonstrating that real‐time adaptive courseware can enhance learning engagement when designed with user‐centred principles. The findings provide practical design recommendations for improving usability in ITSs, emphasising enhanced response flexibility, improved feedback mechanisms and clearer navigation features. Future research should explore longitudinal usability assessments to evaluate long‐term user engagement and learning retention in adaptive environments.
- 9 June 2025
- Published by Wiley in Journal of Computer Assisted Learning
- Vol. 41 (4)
Open AccessUsability Evaluation of an Adaptive Courseware Approach in the Natural Language‐Based Intelligent Tutoring System‐Tutomat
Background: Adaptive educational systems have gained increasing attention due to their ability to personalise educational content based on individual learner progress. Prior research highlights that intelligent tutoring systems (ITSs) and adaptive courseware models improve learning outcomes by dynamically adjusting instructional materials. However, despite advancements in adaptive learning environments, usability remains a critical factor influencing their effectiveness and adoption. Therefore, a need exists to evaluate the usability of adaptive tutoring systems to ensure they provide optimal user experience whilst maintaining high instructional effectiveness.Objectives: This study examines the usability and learning experience of Tutomat, an adaptive courseware system designed for automated, real‐time content adaptation. Specifically, it aims to examine usability based on user interactions and feedback, assess learning effectiveness and engagement through pre‐test/post‐test comparisons and user feedback, identify key usability challenges and propose improvements for enhancing user experience.Methods: A mixed‐methods usability evaluation was conducted with 14 participants, applying both quantitative and qualitative research designs. The quantitative study used pre‐test/post‐test comparisons and System Usability Scale (SUS) scores to measure knowledge acquisition and usability perceptions. The qualitative study involved scenario‐based usability testing, where participants completed eight structured tasks. Data analysis included Wilcoxon Signed‐Ranks tests for learning gains, descriptive statistics for usability scores and analysis for qualitative feedback.Results: Findings indicate that Tutomat significantly improved student knowledge, as demonstrated by pre‐test/post‐test comparisons (W = 0, p < 0.05). The SUS score of 68.21 suggests acceptable usability, though strict answer validation and unclear navigation caused user frustration. Scenario‐based testing identified usability challenges, particularly in feature discoverability and response flexibility, which impacted the user experience. Participants valued adaptive feedback and structured content but expressed concerns regarding interface design limitations.Conclusion: This study highlights the importance of usability in adaptive educational systems, demonstrating that real‐time adaptive courseware can enhance learning engagement when designed with user‐centred principles. The findings provide practical design recommendations for improving usability in ITSs, emphasising enhanced response flexibility, improved feedback mechanisms and clearer navigation features. Future research should explore longitudinal usability assessments to evaluate long‐term user engagement and learning retention in adaptive environments.
- 10 May 2025
- Published by Springer Nature in Language Resources and Evaluation
- Vol. 59 (3) , 2781-2809
Human–machine interaction in building an English reference dataset for natural language processing tasks
- 10 May 2025
- Published by Springer Nature in Language Resources and Evaluation
- Vol. 59 (3) , 2781-2809
Human–machine interaction in building an English reference dataset for natural language processing tasks
- Open Access
- 13 November 2024
- Published by Springer Nature in User Modeling and User-Adapted Interaction
- Vol. 34 (5) , 2115
Correction: Twenty-Five Years of Bayesian knowledge tracing: a systematic review
- 13 November 2024
- Published by Springer Nature in User Modeling and User-Adapted Interaction
- Vol. 34 (5) , 2115
Open AccessCorrection: Twenty-Five Years of Bayesian knowledge tracing: a systematic review
- 27 January 2024
- Published by Springer Nature in User Modeling and User-Adapted Interaction
- Vol. 34 (4) , 1127-1173
Twenty-five years of Bayesian knowledge tracing: a systematic review
- 27 January 2024
- Published by Springer Nature in User Modeling and User-Adapted Interaction
- Vol. 34 (4) , 1127-1173
Twenty-five years of Bayesian knowledge tracing: a systematic review
- 9 October 2023
- Published by Springer Nature in Technology, Knowledge and Learning
- Vol. 29 (1) , 453-481
Perceptions of Digital Learning and Teaching: The Case of a Croatian University Transition to an Emergency Digital Environment
- 9 October 2023
- Published by Springer Nature in Technology, Knowledge and Learning
- Vol. 29 (1) , 453-481
Perceptions of Digital Learning and Teaching: The Case of a Croatian University Transition to an Emergency Digital Environment
- 21 September 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 3, 1-6
Exploring Student Engagement in Online Programming Courses: A Two-Level K-means Analysis
This research examines student clustering in online Programming course using a two-level K-means clustering algorithm. The study identifies two distinct clusters, Cluster1 and Cluster0, based on student engagement and performance. Results reveal that Cluster1 demonstrates significantly higher levels of engagement and performance compared to Cluster0 across 10 out of the 11 analyzed features, as validated by t-tests. The accuracy of the clustering model is evaluated using the Silhouette score (0.65) and Confusion matrix (78%). These findings emphasize the efficacy of clustering algorithms in discerning varying levels of student engagement and performance in online Programming courses, thereby offering valuable insights for educators and practitioners.
- 21 September 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 3, 1-6
Exploring Student Engagement in Online Programming Courses: A Two-Level K-means Analysis
This research examines student clustering in online Programming course using a two-level K-means clustering algorithm. The study identifies two distinct clusters, Cluster1 and Cluster0, based on student engagement and performance. Results reveal that Cluster1 demonstrates significantly higher levels of engagement and performance compared to Cluster0 across 10 out of the 11 analyzed features, as validated by t-tests. The accuracy of the clustering model is evaluated using the Silhouette score (0.65) and Confusion matrix (78%). These findings emphasize the efficacy of clustering algorithms in discerning varying levels of student engagement and performance in online Programming courses, thereby offering valuable insights for educators and practitioners.
- Open Access
- 28 August 2023
- Published by Pensoft Publishers in JUCS - Journal of Universal Computer Science
- Vol. 29 (8) , 866-891
The evaluation of a semi-automatic authoring tool for knowledge extraction in the AC&NL Tutor
This paper describes and evaluates the performance of a semi-automatic authoring tool (SAAT) for knowledge extraction in the AC&NL Tutor, highlighting its strengths and weaknesses. We assessed the accuracy of automatic annotation tasks (Part-of-Speech tagging, Name Entity Recognition, Dependency parsing, and Coreference Resolution) performed on a dataset of 160 sentences from unstructured Wikipedia text on a computer. We compared the automatic annotations to the gold standard, created after human post-editing and validation. Human-error analysis included 3769 words, 582 subsentences, 1129 questions, 917 propositions, 1020 concepts, and 667 relations. It resulted in the error type classification and the set of custom rules further used for automatic error identification and correction. The results showed that an average of 68.7% of the error corrections referred to CoreNLP performance and 31.3% to the SAAT extraction algorithms. Our main contributions include an integrated approach to the comprehensive pre-processing of the text, knowledge extraction and visualization; the consolidated evaluation of natural language processing tasks and knowledge extraction output (sentences, subsentences, questions, concept maps) and the newly developed reference dataset.
- 28 August 2023
- Published by Pensoft Publishers in JUCS - Journal of Universal Computer Science
- Vol. 29 (8) , 866-891
Open AccessThe evaluation of a semi-automatic authoring tool for knowledge extraction in the AC&NL Tutor
This paper describes and evaluates the performance of a semi-automatic authoring tool (SAAT) for knowledge extraction in the AC&NL Tutor, highlighting its strengths and weaknesses. We assessed the accuracy of automatic annotation tasks (Part-of-Speech tagging, Name Entity Recognition, Dependency parsing, and Coreference Resolution) performed on a dataset of 160 sentences from unstructured Wikipedia text on a computer. We compared the automatic annotations to the gold standard, created after human post-editing and validation. Human-error analysis included 3769 words, 582 subsentences, 1129 questions, 917 propositions, 1020 concepts, and 667 relations. It resulted in the error type classification and the set of custom rules further used for automatic error identification and correction. The results showed that an average of 68.7% of the error corrections referred to CoreNLP performance and 31.3% to the SAAT extraction algorithms. Our main contributions include an integrated approach to the comprehensive pre-processing of the text, knowledge extraction and visualization; the consolidated evaluation of natural language processing tasks and knowledge extraction output (sentences, subsentences, questions, concept maps) and the newly developed reference dataset.
- 10 July 2023
- Published by Springer Nature in Language Resources and Evaluation
- Vol. 57 (4) , 1431-1461
Evaluation of a rule-based approach to automatic factual question generation using syntactic and semantic analysis
- 10 July 2023
- Published by Springer Nature in Language Resources and Evaluation
- Vol. 57 (4) , 1431-1461
Evaluation of a rule-based approach to automatic factual question generation using syntactic and semantic analysis
- 22 May 2023
- Published by Springer Nature
- p. 220-232
KEMMRL: Knowledge Extraction Model for Morphologically Rich Languages
- 22 May 2023
- Published by Springer Nature
- p. 220-232
KEMMRL: Knowledge Extraction Model for Morphologically Rich Languages