Argyro Kavadella
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Argyro Kavadella has a total of 29 co-authors. Here are the top co-authors by number of shared publications:
- Eleftherios G. Kaklamanos
School of Dentistry, European University Cyprus , 6 Diogenous str., Nicosia 2404
4 shared publications - Kostis Giannakopoulos
School of Dentistry, European University Cyprus, Nicosia 2404, Cyprus
4 shared publications - Vassilis Stamatopoulos
Athena Research Center
4 shared publications - Akhilanand Chaurasia
Department of Oral Medicine and Radiology, King George’s Medical University, Lucknow, India
2 shared publications - Anas Aaqel Salim Salim Al-Ani
School of Dentistry, European University Cyprus, 6 Diogenis StEngomi, Nicosia, CY
2 shared publications - Marco Antonio Dias da Silva
Research Group of Teleducation and Teledentistry, Federal University of Campina Grande, Campina Grande, Brazil
2 shared publications
Latest Publications
- Open Access
- 9 February 2026
- Published by Springer Nature in BMC Medical Education
- Vol. 26 (1)
Dental students’ knowledge, perceptions, and educational needs regarding artificial intelligence: a multinational cross-sectional survey
To explore undergraduate dental students’ AI knowledge, perceptions, and concerns, and to identify their educational needs based on these findings. A
- 9 February 2026
- Published by Springer Nature in BMC Medical Education
- Vol. 26 (1)
Open AccessDental students’ knowledge, perceptions, and educational needs regarding artificial intelligence: a multinational cross-sectional survey
To explore undergraduate dental students’ AI knowledge, perceptions, and concerns, and to identify their educational needs based on these findings. A
- Open Access
Fusion, Gemination or a Morphological Variation? A Case Report on a Diagnostically Challenging Mandibular Molar
Background/Objectives: Dental anomalies can manifest as a consequence of developmental defects and/or genetic influences, which disrupt the normal functioning of the oral cavity and present in various forms. Cases of fusion, gemination and concrescence are rare dental anomalies which are seen in the area of the mandibular molars. Case report: This case report concerns a 69-year-old Greek male patient who presented in the dental office asking for comprehensive oral treatment. During the clinical examination, a morphologically atypical molar was identified in the area of #37–38 presented with a large crown in the mesio-distal dimension (‘double’ crown). Panoramic and periapical radiographs offered valuable insights on the morphology of the irregular tooth, as they revealed the crown and root morphology, including the two pulp chambers and the three parallel roots of the tooth. Discussion: A plausible hypothesis identifies the atypical tooth as a third molar exhibiting morphological variation, a common characteristic of third molars. Additional diagnostic considerations—while supposing the existence of a supernumerary fourth molar—include the developmental anomalies of gemination, concrescence and fusion, as the clinical and radiographic features of the tooth display elements associated with all three. Conclusions: Considering the patient’s history, clinical and radiographic findings and the relevant literature, fusion is determined to be the most probable diagnosis. Early identification of the atypical tooth is essential to facilitate the implementation of appropriate preventive measures and to support informed treatment planning, should invasive procedures such as endodontic or surgical intervention be required in the future.
Open AccessFusion, Gemination or a Morphological Variation? A Case Report on a Diagnostically Challenging Mandibular Molar
Background/Objectives: Dental anomalies can manifest as a consequence of developmental defects and/or genetic influences, which disrupt the normal functioning of the oral cavity and present in various forms. Cases of fusion, gemination and concrescence are rare dental anomalies which are seen in the area of the mandibular molars. Case report: This case report concerns a 69-year-old Greek male patient who presented in the dental office asking for comprehensive oral treatment. During the clinical examination, a morphologically atypical molar was identified in the area of #37–38 presented with a large crown in the mesio-distal dimension (‘double’ crown). Panoramic and periapical radiographs offered valuable insights on the morphology of the irregular tooth, as they revealed the crown and root morphology, including the two pulp chambers and the three parallel roots of the tooth. Discussion: A plausible hypothesis identifies the atypical tooth as a third molar exhibiting morphological variation, a common characteristic of third molars. Additional diagnostic considerations—while supposing the existence of a supernumerary fourth molar—include the developmental anomalies of gemination, concrescence and fusion, as the clinical and radiographic features of the tooth display elements associated with all three. Conclusions: Considering the patient’s history, clinical and radiographic findings and the relevant literature, fusion is determined to be the most probable diagnosis. Early identification of the atypical tooth is essential to facilitate the implementation of appropriate preventive measures and to support informed treatment planning, should invasive procedures such as endodontic or surgical intervention be required in the future.
- Top Cited PapersOpen Access
- 13 February 2025
- Published by Wiley in European Journal of Dental Education
- Vol. 29 (2) , 285-303
Development of Evidence‐Based Guidelines for the Integration of Generative AI in University Education Through a Multidisciplinary, Consensus‐Based Approach
Introduction: The introduction highlights the transformative impact of generative artificial intelligence (GenAI) on higher education (HE), emphasising its potential to enhance student learning and instructor efficiency while also addressing significant challenges such as accuracy, privacy, and ethical concerns. By exploring the benefits and risks of AI integration, the introduction underscores the urgent need for evidence‐based, inclusive, and adaptable frameworks to guide universities in leveraging GenAI responsibly and effectively in academic environments. Aims: This paper presents a comprehensive process for developing cross‐disciplinary and consensus‐based guidelines, based on the latest evidence for the integration of GenAI at European University Cyprus (EUC). In response to the rapid adoption of AI tools such as LLMs in HE, a task group at EUC created a structured framework to guide the ethical and effective use of GenAI in academia, one that was intended to be flexible enough to incorporate new developments and not infringe on instructors' academic freedoms, while also addressing ethical and practical concerns. Results: The framework development was informed by extensive literature reviews and consultations. Key pillars of the framework include: addressing the risks and opportunities presented by GenAI; promoting transparent communication; ensuring responsible use by students and educators; safeguarding academic integrity. The guidelines emphasise the balance between, on the one hand, leveraging AI to enhance educational experiences, and, on the other maintaining critical thinking and originality. The framework also includes practical recommendations for AI usage, classroom integration, and policy formulation, ensuring that AI augments rather than replaces human judgement in educational settings. Conclusions: The iterative development process, including the use of GenAI tools for refining the guidelines, illustrates a hands‐on approach to AI adoption in HE, and the resulting guidelines may serve as a model for other higher education institutions (HEIs) aiming to integrate AI tools while upholding educational quality and ethical standards.
- 13 February 2025
- Published by Wiley in European Journal of Dental Education
- Vol. 29 (2) , 285-303
Top Cited PapersOpen AccessDevelopment of Evidence‐Based Guidelines for the Integration of Generative AI in University Education Through a Multidisciplinary, Consensus‐Based Approach
Introduction: The introduction highlights the transformative impact of generative artificial intelligence (GenAI) on higher education (HE), emphasising its potential to enhance student learning and instructor efficiency while also addressing significant challenges such as accuracy, privacy, and ethical concerns. By exploring the benefits and risks of AI integration, the introduction underscores the urgent need for evidence‐based, inclusive, and adaptable frameworks to guide universities in leveraging GenAI responsibly and effectively in academic environments. Aims: This paper presents a comprehensive process for developing cross‐disciplinary and consensus‐based guidelines, based on the latest evidence for the integration of GenAI at European University Cyprus (EUC). In response to the rapid adoption of AI tools such as LLMs in HE, a task group at EUC created a structured framework to guide the ethical and effective use of GenAI in academia, one that was intended to be flexible enough to incorporate new developments and not infringe on instructors' academic freedoms, while also addressing ethical and practical concerns. Results: The framework development was informed by extensive literature reviews and consultations. Key pillars of the framework include: addressing the risks and opportunities presented by GenAI; promoting transparent communication; ensuring responsible use by students and educators; safeguarding academic integrity. The guidelines emphasise the balance between, on the one hand, leveraging AI to enhance educational experiences, and, on the other maintaining critical thinking and originality. The framework also includes practical recommendations for AI usage, classroom integration, and policy formulation, ensuring that AI augments rather than replaces human judgement in educational settings. Conclusions: The iterative development process, including the use of GenAI tools for refining the guidelines, illustrates a hands‐on approach to AI adoption in HE, and the resulting guidelines may serve as a model for other higher education institutions (HEIs) aiming to integrate AI tools while upholding educational quality and ethical standards.
- 19 July 2024
- Published by Wiley in European Journal of Dental Education
- Vol. 28 (4) , 923-924
Guest Editorial
- 19 July 2024
- Published by Wiley in European Journal of Dental Education
- Vol. 28 (4) , 923-924
Guest Editorial
- Top Cited PapersOpen Access
- 8 April 2024
- Published by Wiley in European Journal of Dental Education
- Vol. 28 (4) , 865-876
Artificial intelligence chatbots and large language models in dental education: Worldwide survey of educators
Introduction: Interest is growing in the potential of artificial intelligence (AI) chatbots and large language models like OpenAI's ChatGPT and Google's Gemini, particularly in dental education. To explore dental educators‘ perceptions of AI chatbots and large language models, specifically their potential benefits and challenges for dental education.Materials and Methods: A global cross‐sectional survey was conducted in May–June 2023 using a 31‐item online‐questionnaire to assess dental educators' perceptions of AI chatbots like ChatGPT and their influence on dental education. Dental educators, representing diverse backgrounds, were asked about their use of AI, its perceived impact, barriers to using chatbots, and the future role of AI in this field.Results: 428 dental educators (survey views = 1516; response rate = 28%) with a median [25/75th percentiles] age of 45 [37, 56] and 16 [8, 25] years of experience participated, with the majority from the Americas (54%), followed by Europe (26%) and Asia (10%). Thirty‐one percent of respondents already use AI tools, with 64% recognising their potential in dental education. Perception of AI's potential impact on dental education varied by region, with Africa (4[4–5]), Asia (4[4–5]), and the Americas (4[3–5]) perceiving more potential than Europe (3[3–4]). Educators stated that AI chatbots could enhance knowledge acquisition (74.3%), research (68.5%), and clinical decision‐making (63.6%) but expressed concern about AI's potential to reduce human interaction (53.9%). Dental educators' chief concerns centred around the absence of clear guidelines and training for using AI chatbots.Conclusion: A positive yet cautious view towards AI chatbot integration in dental curricula is prevalent, underscoring the need for clear implementation guidelines.
- 8 April 2024
- Published by Wiley in European Journal of Dental Education
- Vol. 28 (4) , 865-876
Top Cited PapersOpen AccessArtificial intelligence chatbots and large language models in dental education: Worldwide survey of educators
Introduction: Interest is growing in the potential of artificial intelligence (AI) chatbots and large language models like OpenAI's ChatGPT and Google's Gemini, particularly in dental education. To explore dental educators‘ perceptions of AI chatbots and large language models, specifically their potential benefits and challenges for dental education.Materials and Methods: A global cross‐sectional survey was conducted in May–June 2023 using a 31‐item online‐questionnaire to assess dental educators' perceptions of AI chatbots like ChatGPT and their influence on dental education. Dental educators, representing diverse backgrounds, were asked about their use of AI, its perceived impact, barriers to using chatbots, and the future role of AI in this field.Results: 428 dental educators (survey views = 1516; response rate = 28%) with a median [25/75th percentiles] age of 45 [37, 56] and 16 [8, 25] years of experience participated, with the majority from the Americas (54%), followed by Europe (26%) and Asia (10%). Thirty‐one percent of respondents already use AI tools, with 64% recognising their potential in dental education. Perception of AI's potential impact on dental education varied by region, with Africa (4[4–5]), Asia (4[4–5]), and the Americas (4[3–5]) perceiving more potential than Europe (3[3–4]). Educators stated that AI chatbots could enhance knowledge acquisition (74.3%), research (68.5%), and clinical decision‐making (63.6%) but expressed concern about AI's potential to reduce human interaction (53.9%). Dental educators' chief concerns centred around the absence of clear guidelines and training for using AI chatbots.Conclusion: A positive yet cautious view towards AI chatbot integration in dental curricula is prevalent, underscoring the need for clear implementation guidelines.
- Top Cited PapersOpen Access
- 31 January 2024
- Published by JMIR Publications Inc. in JMIR Medical Education
- Vol. 10, e51344
Evaluation of ChatGPT’s Real-Life Implementation in Undergraduate Dental Education: Mixed Methods Study
Background: The recent artificial intelligence tool ChatGPT seems to offer a range of benefits in academic education while also raising concerns. Relevant literature encompasses issues of plagiarism and academic dishonesty, as well as pedagogy and educational affordances; yet, no real-life implementation of ChatGPT in the educational process has been reported to our knowledge so far. Objective: This mixed methods study aimed to evaluate the implementation of ChatGPT in the educational process, both quantitatively and qualitatively. Methods: In March 2023, a total of 77 second-year dental students of the European University Cyprus were divided into 2 groups and asked to compose a learning assignment on “Radiation Biology and Radiation Protection in the Dental Office,” working collaboratively in small subgroups, as part of the educational semester program of the Dentomaxillofacial Radiology module. Careful planning ensured a seamless integration of ChatGPT, addressing potential challenges. One group searched the internet for scientific resources to perform the task and the other group used ChatGPT for this purpose. Both groups developed a PowerPoint (Microsoft Corp) presentation based on their research and presented it in class. The ChatGPT group students additionally registered all interactions with the language model during the prompting process and evaluated the final outcome; they also answered an open-ended evaluation questionnaire, including questions on their learning experience. Finally, all students undertook a knowledge examination on the topic, and the grades between the 2 groups were compared statistically, whereas the free-text comments of the questionnaires were thematically analyzed. Results: Out of the 77 students, 39 were assigned to the ChatGPT group and 38 to the literature research group. Seventy students undertook the multiple choice question knowledge examination, and examination grades ranged from 5 to 10 on the 0-10 grading scale. The Mann-Whitney U test showed that students of the ChatGPT group performed significantly better (P=.045) than students of the literature research group. The evaluation questionnaires revealed the benefits (human-like interface, immediate response, and wide knowledge base), the limitations (need for rephrasing the prompts to get a relevant answer, general content, false citations, and incapability to provide images or videos), and the prospects (in education, clinical practice, continuing education, and research) of ChatGPT. Conclusions: Students using ChatGPT for their learning assignments performed significantly better in the knowledge examination than their fellow students who used the literature research methodology. Students adapted quickly to the technological environment of the language model, recognized its opportunities and limitations, and used it creatively and efficiently. Implications for practice: the study underscores the adaptability of students to technological innovations including ChatGPT and its potential to enhance educational outcomes. Educators should consider integrating ChatGPT into curriculum design; awareness programs are warranted to educate both students and educators about the limitations of ChatGPT, encouraging critical engagement and responsible use.
- 31 January 2024
- Published by JMIR Publications Inc. in JMIR Medical Education
- Vol. 10, e51344
Top Cited PapersOpen AccessEvaluation of ChatGPT’s Real-Life Implementation in Undergraduate Dental Education: Mixed Methods Study
Background: The recent artificial intelligence tool ChatGPT seems to offer a range of benefits in academic education while also raising concerns. Relevant literature encompasses issues of plagiarism and academic dishonesty, as well as pedagogy and educational affordances; yet, no real-life implementation of ChatGPT in the educational process has been reported to our knowledge so far. Objective: This mixed methods study aimed to evaluate the implementation of ChatGPT in the educational process, both quantitatively and qualitatively. Methods: In March 2023, a total of 77 second-year dental students of the European University Cyprus were divided into 2 groups and asked to compose a learning assignment on “Radiation Biology and Radiation Protection in the Dental Office,” working collaboratively in small subgroups, as part of the educational semester program of the Dentomaxillofacial Radiology module. Careful planning ensured a seamless integration of ChatGPT, addressing potential challenges. One group searched the internet for scientific resources to perform the task and the other group used ChatGPT for this purpose. Both groups developed a PowerPoint (Microsoft Corp) presentation based on their research and presented it in class. The ChatGPT group students additionally registered all interactions with the language model during the prompting process and evaluated the final outcome; they also answered an open-ended evaluation questionnaire, including questions on their learning experience. Finally, all students undertook a knowledge examination on the topic, and the grades between the 2 groups were compared statistically, whereas the free-text comments of the questionnaires were thematically analyzed. Results: Out of the 77 students, 39 were assigned to the ChatGPT group and 38 to the literature research group. Seventy students undertook the multiple choice question knowledge examination, and examination grades ranged from 5 to 10 on the 0-10 grading scale. The Mann-Whitney U test showed that students of the ChatGPT group performed significantly better (P=.045) than students of the literature research group. The evaluation questionnaires revealed the benefits (human-like interface, immediate response, and wide knowledge base), the limitations (need for rephrasing the prompts to get a relevant answer, general content, false citations, and incapability to provide images or videos), and the prospects (in education, clinical practice, continuing education, and research) of ChatGPT. Conclusions: Students using ChatGPT for their learning assignments performed significantly better in the knowledge examination than their fellow students who used the literature research methodology. Students adapted quickly to the technological environment of the language model, recognized its opportunities and limitations, and used it creatively and efficiently. Implications for practice: the study underscores the adaptability of students to technological innovations including ChatGPT and its potential to enhance educational outcomes. Educators should consider integrating ChatGPT into curriculum design; awareness programs are warranted to educate both students and educators about the limitations of ChatGPT, encouraging critical engagement and responsible use.
- Top Cited PapersOpen Access
- 28 December 2023
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 25, e51580
Evaluation of the Performance of Generative AI Large Language Models ChatGPT, Google Bard, and Microsoft Bing Chat in Supporting Evidence-Based Dentistry: Comparative Mixed Methods Study
Background: The increasing application of generative artificial intelligence large language models (LLMs) in various fields, including dentistry, raises questions about their accuracy. Objective: This study aims to comparatively evaluate the answers provided by 4 LLMs, namely Bard (Google LLC), ChatGPT-3.5 and ChatGPT-4 (OpenAI), and Bing Chat (Microsoft Corp), to clinically relevant questions from the field of dentistry. Methods: The LLMs were queried with 20 open-type, clinical dentistry–related questions from different disciplines, developed by the respective faculty of the School of Dentistry, European University Cyprus. The LLMs’ answers were graded 0 (minimum) to 10 (maximum) points against strong, traditionally collected scientific evidence, such as guidelines and consensus statements, using a rubric, as if they were examination questions posed to students, by 2 experienced faculty members. The scores were statistically compared to identify the best-performing model using the Friedman and Wilcoxon tests. Moreover, the evaluators were asked to provide a qualitative evaluation of the comprehensiveness, scientific accuracy, clarity, and relevance of the LLMs’ answers. Results: Overall, no statistically significant difference was detected between the scores given by the 2 evaluators; therefore, an average score was computed for every LLM. Although ChatGPT-4 statistically outperformed ChatGPT-3.5 (P=.008), Bing Chat (P=.049), and Bard (P=.045), all models occasionally exhibited inaccuracies, generality, outdated content, and a lack of source references. The evaluators noted instances where the LLMs delivered irrelevant information, vague answers, or information that was not fully accurate. Conclusions: This study demonstrates that although LLMs hold promising potential as an aid in the implementation of evidence-based dentistry, their current limitations can lead to potentially harmful health care decisions if not used judiciously. Therefore, these tools should not replace the dentist’s critical thinking and in-depth understanding of the subject matter. Further research, clinical validation, and model improvements are necessary for these tools to be fully integrated into dental practice. Dental practitioners must be aware of the limitations of LLMs, as their imprudent use could potentially impact patient care. Regulatory measures should be established to oversee the use of these evolving technologies.
- 28 December 2023
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 25, e51580
Top Cited PapersOpen AccessEvaluation of the Performance of Generative AI Large Language Models ChatGPT, Google Bard, and Microsoft Bing Chat in Supporting Evidence-Based Dentistry: Comparative Mixed Methods Study
Background: The increasing application of generative artificial intelligence large language models (LLMs) in various fields, including dentistry, raises questions about their accuracy. Objective: This study aims to comparatively evaluate the answers provided by 4 LLMs, namely Bard (Google LLC), ChatGPT-3.5 and ChatGPT-4 (OpenAI), and Bing Chat (Microsoft Corp), to clinically relevant questions from the field of dentistry. Methods: The LLMs were queried with 20 open-type, clinical dentistry–related questions from different disciplines, developed by the respective faculty of the School of Dentistry, European University Cyprus. The LLMs’ answers were graded 0 (minimum) to 10 (maximum) points against strong, traditionally collected scientific evidence, such as guidelines and consensus statements, using a rubric, as if they were examination questions posed to students, by 2 experienced faculty members. The scores were statistically compared to identify the best-performing model using the Friedman and Wilcoxon tests. Moreover, the evaluators were asked to provide a qualitative evaluation of the comprehensiveness, scientific accuracy, clarity, and relevance of the LLMs’ answers. Results: Overall, no statistically significant difference was detected between the scores given by the 2 evaluators; therefore, an average score was computed for every LLM. Although ChatGPT-4 statistically outperformed ChatGPT-3.5 (P=.008), Bing Chat (P=.049), and Bard (P=.045), all models occasionally exhibited inaccuracies, generality, outdated content, and a lack of source references. The evaluators noted instances where the LLMs delivered irrelevant information, vague answers, or information that was not fully accurate. Conclusions: This study demonstrates that although LLMs hold promising potential as an aid in the implementation of evidence-based dentistry, their current limitations can lead to potentially harmful health care decisions if not used judiciously. Therefore, these tools should not replace the dentist’s critical thinking and in-depth understanding of the subject matter. Further research, clinical validation, and model improvements are necessary for these tools to be fully integrated into dental practice. Dental practitioners must be aware of the limitations of LLMs, as their imprudent use could potentially impact patient care. Regulatory measures should be established to oversee the use of these evolving technologies.
- Open Access
- 4 August 2023
- Published by JMIR Publications Inc. in JMIR Preprints
Evaluation of the Performance of Generative AI Large Language Models ChatGPT, Google Bard, and Microsoft Bing Chat in Supporting Evidence-Based Dentistry: Comparative Mixed Methods Study (Preprint)
BACKGROUND The increasing application of generative artificial intelligence large language models (LLMs) in various fields, including dentistry, raises questions about their accuracy. OBJECTIVE This study aims to comparatively evaluate the answers provided by 4 LLMs, namely Bard (Google LLC), ChatGPT-3.5 and ChatGPT-4 (OpenAI), and Bing Chat (Microsoft Corp), to clinically relevant questions from the field of dentistry. METHODS The LLMs were queried with 20 open-type, clinical dentistry–related questions from different disciplines, developed by the respective faculty of the School of Dentistry, European University Cyprus. The LLMs’ answers were graded 0 (minimum) to 10 (maximum) points against strong, traditionally collected scientific evidence, such as guidelines and consensus statements, using a rubric, as if they were examination questions posed to students, by 2 experienced faculty members. The scores were statistically compared to identify the best-performing model using the Friedman and Wilcoxon tests. Moreover, the evaluators were asked to provide a qualitative evaluation of the comprehensiveness, scientific accuracy, clarity, and relevance of the LLMs’ answers. RESULTS Overall, no statistically significant difference was detected between the scores given by the 2 evaluators; therefore, an average score was computed for every LLM. Although ChatGPT-4 statistically outperformed ChatGPT-3.5 (P=.008), Bing Chat (P=.049), and Bard (P=.045), all models occasionally exhibited inaccuracies, generality, outdated content, and a lack of source references. The evaluators noted instances where the LLMs delivered irrelevant information, vague answers, or information that was not fully accurate. CONCLUSIONS This study demonstrates that although LLMs hold promising potential as an aid in the implementation of evidence-based dentistry, their current limitations can lead to potentially harmful health care decisions if not used judiciously. Therefore, these tools should not replace the dentist’s critical thinking and in-depth understanding of the subject matter. Further research, clinical validation, and model improvements are necessary for these tools to be fully integrated into dental practice. Dental practitioners must be aware of the limitations of LLMs, as their imprudent use could potentially impact patient care. Regulatory measures should be established to oversee the use of these evolving technologies. CLINICALTRIAL
- 4 August 2023
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessEvaluation of the Performance of Generative AI Large Language Models ChatGPT, Google Bard, and Microsoft Bing Chat in Supporting Evidence-Based Dentistry: Comparative Mixed Methods Study (Preprint)
BACKGROUND The increasing application of generative artificial intelligence large language models (LLMs) in various fields, including dentistry, raises questions about their accuracy. OBJECTIVE This study aims to comparatively evaluate the answers provided by 4 LLMs, namely Bard (Google LLC), ChatGPT-3.5 and ChatGPT-4 (OpenAI), and Bing Chat (Microsoft Corp), to clinically relevant questions from the field of dentistry. METHODS The LLMs were queried with 20 open-type, clinical dentistry–related questions from different disciplines, developed by the respective faculty of the School of Dentistry, European University Cyprus. The LLMs’ answers were graded 0 (minimum) to 10 (maximum) points against strong, traditionally collected scientific evidence, such as guidelines and consensus statements, using a rubric, as if they were examination questions posed to students, by 2 experienced faculty members. The scores were statistically compared to identify the best-performing model using the Friedman and Wilcoxon tests. Moreover, the evaluators were asked to provide a qualitative evaluation of the comprehensiveness, scientific accuracy, clarity, and relevance of the LLMs’ answers. RESULTS Overall, no statistically significant difference was detected between the scores given by the 2 evaluators; therefore, an average score was computed for every LLM. Although ChatGPT-4 statistically outperformed ChatGPT-3.5 (P=.008), Bing Chat (P=.049), and Bard (P=.045), all models occasionally exhibited inaccuracies, generality, outdated content, and a lack of source references. The evaluators noted instances where the LLMs delivered irrelevant information, vague answers, or information that was not fully accurate. CONCLUSIONS This study demonstrates that although LLMs hold promising potential as an aid in the implementation of evidence-based dentistry, their current limitations can lead to potentially harmful health care decisions if not used judiciously. Therefore, these tools should not replace the dentist’s critical thinking and in-depth understanding of the subject matter. Further research, clinical validation, and model improvements are necessary for these tools to be fully integrated into dental practice. Dental practitioners must be aware of the limitations of LLMs, as their imprudent use could potentially impact patient care. Regulatory measures should be established to oversee the use of these evolving technologies. CLINICALTRIAL
- Open Access
- 28 July 2023
- Published by JMIR Publications Inc. in JMIR Preprints
Evaluation of ChatGPT’s Real-Life Implementation in Undergraduate Dental Education: Mixed Methods Study (Preprint)
BACKGROUND The recent artificial intelligence tool ChatGPT seems to offer a range of benefits in academic education while also raising concerns. Relevant literature encompasses issues of plagiarism and academic dishonesty, as well as pedagogy and educational affordances; yet, no real-life implementation of ChatGPT in the educational process has been reported to our knowledge so far. OBJECTIVE This mixed methods study aimed to evaluate the implementation of ChatGPT in the educational process, both quantitatively and qualitatively. METHODS In March 2023, a total of 77 second-year dental students of the European University Cyprus were divided into 2 groups and asked to compose a learning assignment on “Radiation Biology and Radiation Protection in the Dental Office,” working collaboratively in small subgroups, as part of the educational semester program of the Dentomaxillofacial Radiology module. Careful planning ensured a seamless integration of ChatGPT, addressing potential challenges. One group searched the internet for scientific resources to perform the task and the other group used ChatGPT for this purpose. Both groups developed a PowerPoint (Microsoft Corp) presentation based on their research and presented it in class. The ChatGPT group students additionally registered all interactions with the language model during the prompting process and evaluated the final outcome; they also answered an open-ended evaluation questionnaire, including questions on their learning experience. Finally, all students undertook a knowledge examination on the topic, and the grades between the 2 groups were compared statistically, whereas the free-text comments of the questionnaires were thematically analyzed. RESULTS Out of the 77 students, 39 were assigned to the ChatGPT group and 38 to the literature research group. Seventy students undertook the multiple choice question knowledge examination, and examination grades ranged from 5 to 10 on the 0-10 grading scale. The Mann-Whitney U test showed that students of the ChatGPT group performed significantly better (P=.045) than students of the literature research group. The evaluation questionnaires revealed the benefits (human-like interface, immediate response, and wide knowledge base), the limitations (need for rephrasing the prompts to get a relevant answer, general content, false citations, and incapability to provide images or videos), and the prospects (in education, clinical practice, continuing education, and research) of ChatGPT. CONCLUSIONS Students using ChatGPT for their learning assignments performed significantly better in the knowledge examination than their fellow students who used the literature research methodology. Students adapted quickly to the technological environment of the language model, recognized its opportunities and limitations, and used it creatively and efficiently. Implications for practice: the study underscores the adaptability of students to technological innovations including ChatGPT and its potential to enhance educational outcomes. Educators should consider integrating ChatGPT into curriculum design; awareness programs are warranted to educate both students and educators about the limitations of ChatGPT, encouraging critical engagement and responsible use.
- 28 July 2023
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessEvaluation of ChatGPT’s Real-Life Implementation in Undergraduate Dental Education: Mixed Methods Study (Preprint)
BACKGROUND The recent artificial intelligence tool ChatGPT seems to offer a range of benefits in academic education while also raising concerns. Relevant literature encompasses issues of plagiarism and academic dishonesty, as well as pedagogy and educational affordances; yet, no real-life implementation of ChatGPT in the educational process has been reported to our knowledge so far. OBJECTIVE This mixed methods study aimed to evaluate the implementation of ChatGPT in the educational process, both quantitatively and qualitatively. METHODS In March 2023, a total of 77 second-year dental students of the European University Cyprus were divided into 2 groups and asked to compose a learning assignment on “Radiation Biology and Radiation Protection in the Dental Office,” working collaboratively in small subgroups, as part of the educational semester program of the Dentomaxillofacial Radiology module. Careful planning ensured a seamless integration of ChatGPT, addressing potential challenges. One group searched the internet for scientific resources to perform the task and the other group used ChatGPT for this purpose. Both groups developed a PowerPoint (Microsoft Corp) presentation based on their research and presented it in class. The ChatGPT group students additionally registered all interactions with the language model during the prompting process and evaluated the final outcome; they also answered an open-ended evaluation questionnaire, including questions on their learning experience. Finally, all students undertook a knowledge examination on the topic, and the grades between the 2 groups were compared statistically, whereas the free-text comments of the questionnaires were thematically analyzed. RESULTS Out of the 77 students, 39 were assigned to the ChatGPT group and 38 to the literature research group. Seventy students undertook the multiple choice question knowledge examination, and examination grades ranged from 5 to 10 on the 0-10 grading scale. The Mann-Whitney U test showed that students of the ChatGPT group performed significantly better (P=.045) than students of the literature research group. The evaluation questionnaires revealed the benefits (human-like interface, immediate response, and wide knowledge base), the limitations (need for rephrasing the prompts to get a relevant answer, general content, false citations, and incapability to provide images or videos), and the prospects (in education, clinical practice, continuing education, and research) of ChatGPT. CONCLUSIONS Students using ChatGPT for their learning assignments performed significantly better in the knowledge examination than their fellow students who used the literature research methodology. Students adapted quickly to the technological environment of the language model, recognized its opportunities and limitations, and used it creatively and efficiently. Implications for practice: the study underscores the adaptability of students to technological innovations including ChatGPT and its potential to enhance educational outcomes. Educators should consider integrating ChatGPT into curriculum design; awareness programs are warranted to educate both students and educators about the limitations of ChatGPT, encouraging critical engagement and responsible use.