Jakub Klikowski
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Jakub Klikowski has a total of 14 co-authors. Here are the top co-authors by number of shared publications:
- Michał Woźniak
Wrocław University of Science and Technology
6 shared publications - Robert Burduk
Wrocław University of Science and Technology
2 shared publications - Andrzej Grzybowski
Department of Ophthalmology University of Warmia and Mazury Olsztyn Poland
1 shared publication - Anna Maino
Manchester Royal Eye Hospital, Manchester M13 9WL, UK
1 shared publication - Arkadiusz Bryłkowski
Department of Systems and Computer Networks Wrocław University of Science and Technology Wrocław Poland
1 shared publication - Barbara Bobowska
Wrocław University of Science and Technology
1 shared publication
Latest Publications
- Open Access
Artificial Intelligence vs. Human Cognition: A Comparative Analysis of ChatGPT and Candidates Sitting the European Board of Ophthalmology Diploma Examination
Background/Objectives: This paper aims to assess ChatGPT’s performance in answering European Board of Ophthalmology Diploma (EBOD) examination papers and to compare these results to pass benchmarks and candidate results. Methods: This cross-sectional study used a sample of past exam papers from 2012, 2013, 2020–2023 EBOD examinations. This study analyzed ChatGPT’s responses to 440 multiple choice questions (MCQs), each containing five true/false statements (2200 statements in total) and 48 single best answer (SBA) questions. Results: ChatGPT, for MCQs, scored on average 64.39%. ChatGPT’s strongest metric performance for MCQs was precision (68.76%). ChatGPT performed best at answering pathology MCQs (Grubbs test p < 0.05). Optics and refraction had the lowest-scoring MCQ performance across all metrics. ChatGPT-3.5 Turbo performed worse than human candidates and ChatGPT-4o on easy questions (75% vs. 100% accuracy) but outperformed humans and ChatGPT-4o on challenging questions (50% vs. 28% accuracy). ChatGPT’s SBA performance averaged 28.43%, with the highest score and strongest performance in precision (29.36%). Pathology SBA questions were consistently the lowest-scoring topic across most metrics. ChatGPT demonstrated a nonsignificant tendency to select option 1 more frequently (p = 0.19). When answering SBAs, human candidates scored higher than ChatGPT in all metric areas measured. Conclusions: ChatGPT performed stronger for true/false questions, scoring a pass mark in most instances. Performance was poorer for SBA questions, suggesting that ChatGPT’s ability in information retrieval is better than that in knowledge integration. ChatGPT could become a valuable tool in ophthalmic education, allowing exam boards to test their exam papers to ensure they are pitched at the right level, marking open-ended questions and providing detailed feedback.
Open AccessArtificial Intelligence vs. Human Cognition: A Comparative Analysis of ChatGPT and Candidates Sitting the European Board of Ophthalmology Diploma Examination
Background/Objectives: This paper aims to assess ChatGPT’s performance in answering European Board of Ophthalmology Diploma (EBOD) examination papers and to compare these results to pass benchmarks and candidate results. Methods: This cross-sectional study used a sample of past exam papers from 2012, 2013, 2020–2023 EBOD examinations. This study analyzed ChatGPT’s responses to 440 multiple choice questions (MCQs), each containing five true/false statements (2200 statements in total) and 48 single best answer (SBA) questions. Results: ChatGPT, for MCQs, scored on average 64.39%. ChatGPT’s strongest metric performance for MCQs was precision (68.76%). ChatGPT performed best at answering pathology MCQs (Grubbs test p < 0.05). Optics and refraction had the lowest-scoring MCQ performance across all metrics. ChatGPT-3.5 Turbo performed worse than human candidates and ChatGPT-4o on easy questions (75% vs. 100% accuracy) but outperformed humans and ChatGPT-4o on challenging questions (50% vs. 28% accuracy). ChatGPT’s SBA performance averaged 28.43%, with the highest score and strongest performance in precision (29.36%). Pathology SBA questions were consistently the lowest-scoring topic across most metrics. ChatGPT demonstrated a nonsignificant tendency to select option 1 more frequently (p = 0.19). When answering SBAs, human candidates scored higher than ChatGPT in all metric areas measured. Conclusions: ChatGPT performed stronger for true/false questions, scoring a pass mark in most instances. Performance was poorer for SBA questions, suggesting that ChatGPT’s ability in information retrieval is better than that in knowledge integration. ChatGPT could become a valuable tool in ophthalmic education, allowing exam boards to test their exam papers to ensure they are pitched at the right level, marking open-ended questions and providing detailed feedback.
- Open Access
Large Language Models in Legislative Content Analysis: A Dataset from the Polish Parliament
Large language models (LLMs) are among the best methods for processing natural language, partly due to their versatility. At the same time, domain-specific LLMs are more practical in real-life applications. This work introduces a novel natural language dataset created by acquired data from official legislative authorities' websites. The study focuses on formulating three natural language processing (NLP) tasks to evaluate the effectiveness of LLMs on legislative content analysis within the context of the Polish legal system. Key findings highlight the potential of LLMs in automating and enhancing legislative content analysis while emphasizing specific challenges, such as understanding legal context. The research contributes to the advancement of NLP in the legal field, particularly in the Polish language. It has been demonstrated that even commonly accessible data can be practically utilized for legislative content analysis.
Open AccessLarge Language Models in Legislative Content Analysis: A Dataset from the Polish Parliament
Large language models (LLMs) are among the best methods for processing natural language, partly due to their versatility. At the same time, domain-specific LLMs are more practical in real-life applications. This work introduces a novel natural language dataset created by acquired data from official legislative authorities' websites. The study focuses on formulating three natural language processing (NLP) tasks to evaluate the effectiveness of LLMs on legislative content analysis within the context of the Polish legal system. Key findings highlight the potential of LLMs in automating and enhancing legislative content analysis while emphasizing specific challenges, such as understanding legal context. The research contributes to the advancement of NLP in the legal field, particularly in the Polish language. It has been demonstrated that even commonly accessible data can be practically utilized for legislative content analysis.
- 27 August 2023
- Published by Springer Nature
- p. 91-100
Analysis of Extractive Text Summarization Methods as a Binary Classification Problem
- 27 August 2023
- Published by Springer Nature
- p. 91-100
Analysis of Extractive Text Summarization Methods as a Binary Classification Problem
- 18 July 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-8
Concept drift detector based on centroid distance analysis
The interest in data stream mining is continuously growing due to the increasing volume of data arriving at high speed produced by various systems. Processing and classification to gain valuable information from this kind of data require special treatment. The main problem is the non-stationary nature of data streams, which reveals in concept drifts - changes in sample characteristics describing classes. There are many approaches to mitigate the adverse effects of this phenomenon. However, one of the most popular techniques is drift detection. This work will propose a new drift detection approach based on the distance analysis between the subsequent data chunk centroids. The original solution in this methodology is to gather and preserve information about the data characteristics starting from the previous drift detection or data stream beginning. Two variants of the proposed method were compared with state-of-the-art concept drift detection algorithms. The evaluation was made on a comprehensive set of synthetic streams with different concept drift types and selected real streams. The evaluated results subjected to statistical analysis showed that the proposed concept drift detection algorithm could improve the classification of tested classifiers with a statistically significant advantage over the compared drift detection methods.
- 18 July 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-8
Concept drift detector based on centroid distance analysis
The interest in data stream mining is continuously growing due to the increasing volume of data arriving at high speed produced by various systems. Processing and classification to gain valuable information from this kind of data require special treatment. The main problem is the non-stationary nature of data streams, which reveals in concept drifts - changes in sample characteristics describing classes. There are many approaches to mitigate the adverse effects of this phenomenon. However, one of the most popular techniques is drift detection. This work will propose a new drift detection approach based on the distance analysis between the subsequent data chunk centroids. The original solution in this methodology is to gather and preserve information about the data characteristics starting from the previous drift detection or data stream beginning. Two variants of the proposed method were compared with state-of-the-art concept drift detection algorithms. The evaluation was made on a comprehensive set of synthetic streams with different concept drift types and selected real streams. The evaluated results subjected to statistical analysis showed that the proposed concept drift detection algorithm could improve the classification of tested classifiers with a statistically significant advantage over the compared drift detection methods.
- 18 April 2022
- Published by Elsevier in Applied Soft Computing
- Vol. 122, 108855
Deterministic Sampling Classifier with weighted Bagging for drifted imbalanced data stream classification
- 18 April 2022
- Published by Elsevier in Applied Soft Computing
- Vol. 122, 108855
Deterministic Sampling Classifier with weighted Bagging for drifted imbalanced data stream classification
- 18 August 2021
- Published by Springer Nature
- p. 23-33
Distance Metrics in Clustering and Weighted Scoring Algorithm
- 18 August 2021
- Published by Springer Nature
- p. 23-33
Distance Metrics in Clustering and Weighted Scoring Algorithm
- 9 June 2021
- Published by Springer Nature
- p. 40-49
Clustering and Weighted Scoring Algorithm Based on Estimating the Number of Clusters
- 9 June 2021
- Published by Springer Nature
- p. 40-49
Clustering and Weighted Scoring Algorithm Based on Estimating the Number of Clusters
- 1 April 2021
- Published by Elsevier in Journal of Computational Science
- Vol. 51
Hellinger Distance Weighted Ensemble for imbalanced data stream classification
- 1 April 2021
- Published by Elsevier in Journal of Computational Science
- Vol. 51
Hellinger Distance Weighted Ensemble for imbalanced data stream classification
- 15 June 2020
- Published by Springer Nature
- Vol. 12140, 117-127
Employing One-Class SVM Classifier Ensemble for Imbalanced Data Stream Classification
The classification of imbalanced data streams is gaining more and more interest. However, apart from the problem that one of the class is not well represented, there are problems typical for data stream classification, such as limited resources, lack of access to the true labels and the possibility of occurrence of the concept drift. Possibility of concept drift appearing enforces design in the method adaptation mechanism. In this article, we propose the OCEIS classifier (One-Class support vector machine classifier Ensemble for Imbalanced data Stream). The main idea is to supply the committee with one-class classifiers trained on clustered data for each class separately. The results obtained from experiments carried out on synthetic and real data show that the proposed method achieves results at a similar level as the state of the art methods compared with it.
- 15 June 2020
- Published by Springer Nature
- Vol. 12140, 117-127
Employing One-Class SVM Classifier Ensemble for Imbalanced Data Stream Classification
The classification of imbalanced data streams is gaining more and more interest. However, apart from the problem that one of the class is not well represented, there are problems typical for data stream classification, such as limited resources, lack of access to the true labels and the possibility of occurrence of the concept drift. Possibility of concept drift appearing enforces design in the method adaptation mechanism. In this article, we propose the OCEIS classifier (One-Class support vector machine classifier Ensemble for Imbalanced data Stream). The main idea is to supply the committee with one-class classifiers trained on clustered data for each class separately. The results obtained from experiments carried out on synthetic and real data show that the proposed method achieves results at a similar level as the state of the art methods compared with it.
- 28 March 2020
- Published by Springer Nature
- p. 402-413
Imbalanced Data Stream Classification Using Hybrid Data Preprocessing
- 28 March 2020
- Published by Springer Nature
- p. 402-413
Imbalanced Data Stream Classification Using Hybrid Data Preprocessing