Jonathan Kam
Jonathan Kam has a total of 136 co-authors. Here are the top co-authors by number of shared publications:
Matthew Winter
Nepean Urology Research Group Kingswood New South Wales Australia
11 shared publicationsYuigi Yuminaga
Gosford District Hospital and Gosford Private Hospital, Gosford, Australia
10 shared publicationsRaymond Ko
Nepean Urology Research Group Kingswood New South Wales Australia
9 shared publicationsBertram Canagasingham
Nepean Urology Research Group Kingswood New South Wales Australia
8 shared publicationsMohamed Khadra
Nepean Urology Research Group Kingswood New South Wales Australia
8 shared publicationsMohan Arianayagam
Nepean Urology Research Group Kingswood New South Wales Australia
8 shared publications
Latest Publications
- Open Access
- 19 November 2026
- Published by Wiley in Trends in Urology & Men's Health
- Vol. 17 (6)
Explain Like I'm Five: Readability of Prostate Cancer Information Can Be Improved by Using Free and Publicly Available Generative Artificial Intelligence Models, Regardless of Prompt
Men with prostate cancer have well‐documented unmet informational needs, yet educational materials often fail to meet recommended readability standards. Freely available generative artificial intelligence (GenAI) chatbots offer a potential solution, though the relative performance of different large language models (LLMs) and prompting strategies remains unclear. This study aims to evaluate the ability of publicly available GenAI chatbots to improve the readability of prostate cancer‐related medical information and determine whether prompt type influences readability outcomes. Eight commonly searched prostate cancer questions were identified through literature review, Google Trends analysis, and ChatGPT‐assisted topic generation. Original responses to these questions were used as source material and submitted to nine freely available GenAI chatbots (ChatGPT 5.2 Instant, DeepSeek V3.2, Grok 4.1 Auto, Qwen3‐Max, Microsoft Copilot Smart, Mistral Le Chat Research, Meta AI [Llama 4], Claude Sonnet 4.5, and Google Gemini 3 Fast). Four readability‐improvement prompts were tested: ‘Explain this in simple terms’, ‘Explain this in plain language’, ‘Explain this like I'm five’, and an engineered prompt designed to maximise readability while preserving content. Responses were analysed using the Flesch‐Kincaid Reading Ease (FKRE) score. Linear mixed‐effects models and estimated marginal means were used to compare prompt, chatbot, and content performance. A total of 285 chatbot responses were analysed. Across all models and prompts, readability improved by a mean of 19.64 points (SD 7.59) compared with baseline. All prompting strategies significantly improved readability (all p ≤ 0.005). The prompt ‘Explain this like I'm five’ produced the greatest improvement, increasing FKRE scores by a mean of 27.70 points (95% CI 15.70–39.69; p < 0.001). All chatbot models significantly improved readability compared with baseline (all p < 0.001). Grok 4.1 Auto achieved the highest overall readability score (mean FKRE 71.81) and greatest mean improvement (+23.33 points), while ChatGPT 5.2 Instant and DeepSeek V3.2 consistently improved readability across all tested prompts and content. Readability improvements varied according to subject matter, with the largest gains observed for bladder function (+29.86 points; p = 0.004) and diagnosis (+27.84 points; p = 0.006). Freely available GenAI chatbots can meaningfully improve the readability of prostate cancer‐related medical information using simple prompts. ‘Explain this like I'm five’ produced the greatest readability gains, though this prompt may reduce clinical nuance and accuracy—an important consideration for medical practitioners. When the most effective lay prompt is uncertain, a curated prompt may offer a reasonable alternative. Further research is required to evaluate the safety, accuracy, and completeness of AI‐simplified prostate cancer content, and to explore how patient eHealth literacy influences engagement with these tools.
- 19 November 2026
- Published by Wiley in Trends in Urology & Men's Health
- Vol. 17 (6)
Open AccessExplain Like I'm Five: Readability of Prostate Cancer Information Can Be Improved by Using Free and Publicly Available Generative Artificial Intelligence Models, Regardless of Prompt
Men with prostate cancer have well‐documented unmet informational needs, yet educational materials often fail to meet recommended readability standards. Freely available generative artificial intelligence (GenAI) chatbots offer a potential solution, though the relative performance of different large language models (LLMs) and prompting strategies remains unclear. This study aims to evaluate the ability of publicly available GenAI chatbots to improve the readability of prostate cancer‐related medical information and determine whether prompt type influences readability outcomes. Eight commonly searched prostate cancer questions were identified through literature review, Google Trends analysis, and ChatGPT‐assisted topic generation. Original responses to these questions were used as source material and submitted to nine freely available GenAI chatbots (ChatGPT 5.2 Instant, DeepSeek V3.2, Grok 4.1 Auto, Qwen3‐Max, Microsoft Copilot Smart, Mistral Le Chat Research, Meta AI [Llama 4], Claude Sonnet 4.5, and Google Gemini 3 Fast). Four readability‐improvement prompts were tested: ‘Explain this in simple terms’, ‘Explain this in plain language’, ‘Explain this like I'm five’, and an engineered prompt designed to maximise readability while preserving content. Responses were analysed using the Flesch‐Kincaid Reading Ease (FKRE) score. Linear mixed‐effects models and estimated marginal means were used to compare prompt, chatbot, and content performance. A total of 285 chatbot responses were analysed. Across all models and prompts, readability improved by a mean of 19.64 points (SD 7.59) compared with baseline. All prompting strategies significantly improved readability (all p ≤ 0.005). The prompt ‘Explain this like I'm five’ produced the greatest improvement, increasing FKRE scores by a mean of 27.70 points (95% CI 15.70–39.69; p < 0.001). All chatbot models significantly improved readability compared with baseline (all p < 0.001). Grok 4.1 Auto achieved the highest overall readability score (mean FKRE 71.81) and greatest mean improvement (+23.33 points), while ChatGPT 5.2 Instant and DeepSeek V3.2 consistently improved readability across all tested prompts and content. Readability improvements varied according to subject matter, with the largest gains observed for bladder function (+29.86 points; p = 0.004) and diagnosis (+27.84 points; p = 0.006). Freely available GenAI chatbots can meaningfully improve the readability of prostate cancer‐related medical information using simple prompts. ‘Explain this like I'm five’ produced the greatest readability gains, though this prompt may reduce clinical nuance and accuracy—an important consideration for medical practitioners. When the most effective lay prompt is uncertain, a curated prompt may offer a reasonable alternative. Further research is required to evaluate the safety, accuracy, and completeness of AI‐simplified prostate cancer content, and to explore how patient eHealth literacy influences engagement with these tools.
- Open Access
- 28 January 2026
- Published by Wiley in BJU International
- Vol. 138 (S2) , S74-S80
Focal therapy using a novel cooled laser device for prostate cancer: early trial results
Objectives: To determine the short‐term oncological results and safety of the ProFocal Laser Therapy for Prostate Tissue Ablation (PFLT‐PC) trial, the first phase II clinical trial of ProFocal® (Medlogical Innovations, Sydney, Australia), a novel, cooled laser focal therapy (cLFT) device for prostate cancer (PCa) treatment. Patients and Methods: Men with localised PCa, prostate‐specific antigen (PSA) level ≤15 ng/mL, T stage ≤T2c, International Society of Urological Pathology (ISUP) score 2–3 concordant with multiparametric magnetic resonance imaging (mpMRI) visible disease were recruited for this trial (Australian and New Zealand Clinical Trial Registry [ACTRN]12618001774213p) at Nepean Hospital, Australia. The cLFT was performed under general anaesthesia as a day procedure. Primary outcome was adequacy of tissue ablation assessed by mpMRI within 72 h and biopsy at 3 months. Secondary outcomes of functional measures were assessed using validated questionnaires (International Prostate Symptom Score, Sexual Health Inventory for Men [SHIM], Expanded Prostate cancer Index Composite [EPIC], 12‐item Short‐Form Health Survey). Complications and adverse events within 90 days were reported using Clavien–Dindo classification grading. Results: A total of 100 patients were recruited. The median (interquartile range [IQR]) age was 66 (60–72) years, PSA level 5.9 (3.9–7.6) ng/mL, prostate volume 39 (30–51) mL and MRI lesion volume 0.84 (0.57–1.2) mL. The median (IQR) treatment time was 60 (47–70) min. In all, 84% had no ISUP Grade Group ≥2 PCa in their 3‐month treatment zone biopsies. Erectile dysfunction was reported in 12% of the men, with a 15% mean decline in the SHIM and EPIC‐sexual domains scores. There was a 4.5% decrease on EPIC‐urinary domain scores. There was no decline in any other functional measures. This study's main limitations were the absence of a control group and the short follow‐up. Conclusions: The PFLT‐PC trial demonstrates that at 3 months, cLFT using the ProFocal device provides an 84% treatment success with low morbidity.
- 28 January 2026
- Published by Wiley in BJU International
- Vol. 138 (S2) , S74-S80
Open AccessFocal therapy using a novel cooled laser device for prostate cancer: early trial results
Objectives: To determine the short‐term oncological results and safety of the ProFocal Laser Therapy for Prostate Tissue Ablation (PFLT‐PC) trial, the first phase II clinical trial of ProFocal® (Medlogical Innovations, Sydney, Australia), a novel, cooled laser focal therapy (cLFT) device for prostate cancer (PCa) treatment. Patients and Methods: Men with localised PCa, prostate‐specific antigen (PSA) level ≤15 ng/mL, T stage ≤T2c, International Society of Urological Pathology (ISUP) score 2–3 concordant with multiparametric magnetic resonance imaging (mpMRI) visible disease were recruited for this trial (Australian and New Zealand Clinical Trial Registry [ACTRN]12618001774213p) at Nepean Hospital, Australia. The cLFT was performed under general anaesthesia as a day procedure. Primary outcome was adequacy of tissue ablation assessed by mpMRI within 72 h and biopsy at 3 months. Secondary outcomes of functional measures were assessed using validated questionnaires (International Prostate Symptom Score, Sexual Health Inventory for Men [SHIM], Expanded Prostate cancer Index Composite [EPIC], 12‐item Short‐Form Health Survey). Complications and adverse events within 90 days were reported using Clavien–Dindo classification grading. Results: A total of 100 patients were recruited. The median (interquartile range [IQR]) age was 66 (60–72) years, PSA level 5.9 (3.9–7.6) ng/mL, prostate volume 39 (30–51) mL and MRI lesion volume 0.84 (0.57–1.2) mL. The median (IQR) treatment time was 60 (47–70) min. In all, 84% had no ISUP Grade Group ≥2 PCa in their 3‐month treatment zone biopsies. Erectile dysfunction was reported in 12% of the men, with a 15% mean decline in the SHIM and EPIC‐sexual domains scores. There was a 4.5% decrease on EPIC‐urinary domain scores. There was no decline in any other functional measures. This study's main limitations were the absence of a control group and the short follow‐up. Conclusions: The PFLT‐PC trial demonstrates that at 3 months, cLFT using the ProFocal device provides an 84% treatment success with low morbidity.
- Open Access
- 6 March 2025
- Published by Wiley in BJU International
- Vol. 135 (6) , 987-993
Reduced prostate cancer screening has a negative impact on stage migration: the Australian experience
Objectives: To determine if Australian prostate cancer screening has declined since the Royal Australasian College of General Practitioners (RACGP) recommended against prostate cancer screening in 2009 and correlate screening trends with more advanced disease at radical prostatectomy (RP) in Australia. Patients and methods: Histopathology of patients undergoing RP from 2007 to 2018 in the state of New South Wales (NSW), Australia was accessed from a prospectively maintained pathology database by Douglass Hanly Moir, the largest pathology provider in NSW. Prostate‐specific antigen (PSA) testing rates were obtained via the Medicare Statistics database (Australian Government). Population data were obtained from the Australian Institute of Health and Welfare and Bureau of Statistics. Results: Prostate‐specific antigen testing decreased significantly in NSW, Australia dropping from 8470 to 4910 tests per 100 000 males from 2009 to 2018, approximately a 5% annual percentage decrease. Histopathology of 17 375 patients who underwent RP during this time showed a 5.4% annual increase in non‐organ‐confined disease at RP, which was irrespective of Gleason Grade. There was a strong correlation between the decrease in PSA testing with an increase in non‐organ‐confined disease at RP. Conclusions: In conclusion, the RACGP guidelines recommending against prostate cancer screening in 2009 correlates strongly with more advanced disease found at RP. This could indicate that patients were presenting later with more advanced disease. However, the increasing use of surveillance of low‐grade and favourable intermediate‐risk disease and also the potential increasing use of surgery for higher‐volume or ‐grade prostate cancer at diagnosis could impact on the interpretation of our findings. Most international guidelines, as well as the Prostate Cancer Foundation of Australia Guidelines, have now recommended prostate cancer screening in men aged 50–69 years and it is commendable that the latest 2024 RACGP guidelines have been updated to reflect the new evidence supporting prostate cancer screening.
- 6 March 2025
- Published by Wiley in BJU International
- Vol. 135 (6) , 987-993
Open AccessReduced prostate cancer screening has a negative impact on stage migration: the Australian experience
Objectives: To determine if Australian prostate cancer screening has declined since the Royal Australasian College of General Practitioners (RACGP) recommended against prostate cancer screening in 2009 and correlate screening trends with more advanced disease at radical prostatectomy (RP) in Australia. Patients and methods: Histopathology of patients undergoing RP from 2007 to 2018 in the state of New South Wales (NSW), Australia was accessed from a prospectively maintained pathology database by Douglass Hanly Moir, the largest pathology provider in NSW. Prostate‐specific antigen (PSA) testing rates were obtained via the Medicare Statistics database (Australian Government). Population data were obtained from the Australian Institute of Health and Welfare and Bureau of Statistics. Results: Prostate‐specific antigen testing decreased significantly in NSW, Australia dropping from 8470 to 4910 tests per 100 000 males from 2009 to 2018, approximately a 5% annual percentage decrease. Histopathology of 17 375 patients who underwent RP during this time showed a 5.4% annual increase in non‐organ‐confined disease at RP, which was irrespective of Gleason Grade. There was a strong correlation between the decrease in PSA testing with an increase in non‐organ‐confined disease at RP. Conclusions: In conclusion, the RACGP guidelines recommending against prostate cancer screening in 2009 correlates strongly with more advanced disease found at RP. This could indicate that patients were presenting later with more advanced disease. However, the increasing use of surveillance of low‐grade and favourable intermediate‐risk disease and also the potential increasing use of surgery for higher‐volume or ‐grade prostate cancer at diagnosis could impact on the interpretation of our findings. Most international guidelines, as well as the Prostate Cancer Foundation of Australia Guidelines, have now recommended prostate cancer screening in men aged 50–69 years and it is commendable that the latest 2024 RACGP guidelines have been updated to reflect the new evidence supporting prostate cancer screening.
- Top Cited PapersOpen Access
- 14 August 2024
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 26, e55939
Evaluating the Efficacy of ChatGPT as a Patient Education Tool in Prostate Cancer: Multimetric Assessment
Background: Artificial intelligence (AI) chatbots, such as ChatGPT, have made significant progress. These chatbots, particularly popular among health care professionals and patients, are transforming patient education and disease experience with personalized information. Accurate, timely patient education is crucial for informed decision-making, especially regarding prostate-specific antigen screening and treatment options. However, the accuracy and reliability of AI chatbots’ medical information must be rigorously evaluated. Studies testing ChatGPT’s knowledge of prostate cancer are emerging, but there is a need for ongoing evaluation to ensure the quality and safety of information provided to patients. Objective: This study aims to evaluate the quality, accuracy, and readability of ChatGPT-4’s responses to common prostate cancer questions posed by patients. Methods: Overall, 8 questions were formulated with an inductive approach based on information topics in peer-reviewed literature and Google Trends data. Adapted versions of the Patient Education Materials Assessment Tool for AI (PEMAT-AI), Global Quality Score, and DISCERN-AI tools were used by 4 independent reviewers to assess the quality of the AI responses. The 8 AI outputs were judged by 7 expert urologists, using an assessment framework developed to assess accuracy, safety, appropriateness, actionability, and effectiveness. The AI responses’ readability was assessed using established algorithms (Flesch Reading Ease score, Gunning Fog Index, Flesch-Kincaid Grade Level, The Coleman-Liau Index, and Simple Measure of Gobbledygook [SMOG] Index). A brief tool (Reference Assessment AI [REF-AI]) was developed to analyze the references provided by AI outputs, assessing for reference hallucination, relevance, and quality of references. Results: The PEMAT-AI understandability score was very good (mean 79.44%, SD 10.44%), the DISCERN-AI rating was scored as “good” quality (mean 13.88, SD 0.93), and the Global Quality Score was high (mean 4.46/5, SD 0.50). Natural Language Assessment Tool for AI had pooled mean accuracy of 3.96 (SD 0.91), safety of 4.32 (SD 0.86), appropriateness of 4.45 (SD 0.81), actionability of 4.05 (SD 1.15), and effectiveness of 4.09 (SD 0.98). The readability algorithm consensus was “difficult to read” (Flesch Reading Ease score mean 45.97, SD 8.69; Gunning Fog Index mean 14.55, SD 4.79), averaging an 11th-grade reading level, equivalent to 15- to 17-year-olds (Flesch-Kincaid Grade Level mean 12.12, SD 4.34; The Coleman-Liau Index mean 12.75, SD 1.98; SMOG Index mean 11.06, SD 3.20). REF-AI identified 2 reference hallucinations, while the majority (28/30, 93%) of references appropriately supplemented the text. Most references (26/30, 86%) were from reputable government organizations, while a handful were direct citations from scientific literature. Conclusions: Our analysis found that ChatGPT-4 provides generally good responses to common prostate cancer queries, making it a potentially valuable tool for patient education in prostate cancer care. Objective quality assessment tools indicated that the natural language processing outputs were generally reliable and appropriate, but there is room for improvement.
- 14 August 2024
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 26, e55939
Top Cited PapersOpen AccessEvaluating the Efficacy of ChatGPT as a Patient Education Tool in Prostate Cancer: Multimetric Assessment
Background: Artificial intelligence (AI) chatbots, such as ChatGPT, have made significant progress. These chatbots, particularly popular among health care professionals and patients, are transforming patient education and disease experience with personalized information. Accurate, timely patient education is crucial for informed decision-making, especially regarding prostate-specific antigen screening and treatment options. However, the accuracy and reliability of AI chatbots’ medical information must be rigorously evaluated. Studies testing ChatGPT’s knowledge of prostate cancer are emerging, but there is a need for ongoing evaluation to ensure the quality and safety of information provided to patients. Objective: This study aims to evaluate the quality, accuracy, and readability of ChatGPT-4’s responses to common prostate cancer questions posed by patients. Methods: Overall, 8 questions were formulated with an inductive approach based on information topics in peer-reviewed literature and Google Trends data. Adapted versions of the Patient Education Materials Assessment Tool for AI (PEMAT-AI), Global Quality Score, and DISCERN-AI tools were used by 4 independent reviewers to assess the quality of the AI responses. The 8 AI outputs were judged by 7 expert urologists, using an assessment framework developed to assess accuracy, safety, appropriateness, actionability, and effectiveness. The AI responses’ readability was assessed using established algorithms (Flesch Reading Ease score, Gunning Fog Index, Flesch-Kincaid Grade Level, The Coleman-Liau Index, and Simple Measure of Gobbledygook [SMOG] Index). A brief tool (Reference Assessment AI [REF-AI]) was developed to analyze the references provided by AI outputs, assessing for reference hallucination, relevance, and quality of references. Results: The PEMAT-AI understandability score was very good (mean 79.44%, SD 10.44%), the DISCERN-AI rating was scored as “good” quality (mean 13.88, SD 0.93), and the Global Quality Score was high (mean 4.46/5, SD 0.50). Natural Language Assessment Tool for AI had pooled mean accuracy of 3.96 (SD 0.91), safety of 4.32 (SD 0.86), appropriateness of 4.45 (SD 0.81), actionability of 4.05 (SD 1.15), and effectiveness of 4.09 (SD 0.98). The readability algorithm consensus was “difficult to read” (Flesch Reading Ease score mean 45.97, SD 8.69; Gunning Fog Index mean 14.55, SD 4.79), averaging an 11th-grade reading level, equivalent to 15- to 17-year-olds (Flesch-Kincaid Grade Level mean 12.12, SD 4.34; The Coleman-Liau Index mean 12.75, SD 1.98; SMOG Index mean 11.06, SD 3.20). REF-AI identified 2 reference hallucinations, while the majority (28/30, 93%) of references appropriately supplemented the text. Most references (26/30, 86%) were from reputable government organizations, while a handful were direct citations from scientific literature. Conclusions: Our analysis found that ChatGPT-4 provides generally good responses to common prostate cancer queries, making it a potentially valuable tool for patient education in prostate cancer care. Objective quality assessment tools indicated that the natural language processing outputs were generally reliable and appropriate, but there is room for improvement.
- Open Access
- 5 June 2024
- Published by MDPI AG in Société Internationale d’Urologie Journal
- Vol. 5 (3) , 192-199
Quality and Readability of Google Search Information on HoLEP for Benign Prostate Hyperplasia
Objective: To assess the quality and readability of online information on holmium laser enucleation of the prostate in managing benign prostate hyperplasia using the most-used search engine worldwide, Google. Methods: Google search terms “Holmium laser surgery” and “enlarged prostate” were used to generate 150 search results. Two independent authors (i) excluded any paywall, scientific literature, or advertisement and (ii) conducted an independent assessment on information quality, which was based on DISCERN, QUEST, and JAMA criteria, and readability, which was based on the FKG, GFI, SMOG, and FRE scores on qualified webpages. A third author was involved if there were any discrepancies between the assessments. Results: 107 qualified webpages were included in the data analysis. The median DISCERN score was 42 out of 80 (IQR 35–49). The median JAMA score was 0 out of 4 (IQR 0–1). The median QUEST score was 9 out of 28 (IQR 9–12). Using the non-parametric ANOVA and post hoc Games–Howell test, significant differences were identified between rankings of webpages. Sponsorship had no influence on the quality of webpages. The overall readability level required a minimum reading level of grade 11. Linear regression analysis showed that a higher ranked webpage is a positive predictor for all three quality assessment tools. Conclusions: The overall quality of online information on HoLEP is poor. We identify that the top-ranked google searches have a higher DISCERN score and are a positive predictor for DISCERN/QUEST/JAMA. Quality online information can benefit patients but should be used in conjunction with professional medical consultation.
- 5 June 2024
- Published by MDPI AG in Société Internationale d’Urologie Journal
- Vol. 5 (3) , 192-199
Open AccessQuality and Readability of Google Search Information on HoLEP for Benign Prostate Hyperplasia
Objective: To assess the quality and readability of online information on holmium laser enucleation of the prostate in managing benign prostate hyperplasia using the most-used search engine worldwide, Google. Methods: Google search terms “Holmium laser surgery” and “enlarged prostate” were used to generate 150 search results. Two independent authors (i) excluded any paywall, scientific literature, or advertisement and (ii) conducted an independent assessment on information quality, which was based on DISCERN, QUEST, and JAMA criteria, and readability, which was based on the FKG, GFI, SMOG, and FRE scores on qualified webpages. A third author was involved if there were any discrepancies between the assessments. Results: 107 qualified webpages were included in the data analysis. The median DISCERN score was 42 out of 80 (IQR 35–49). The median JAMA score was 0 out of 4 (IQR 0–1). The median QUEST score was 9 out of 28 (IQR 9–12). Using the non-parametric ANOVA and post hoc Games–Howell test, significant differences were identified between rankings of webpages. Sponsorship had no influence on the quality of webpages. The overall readability level required a minimum reading level of grade 11. Linear regression analysis showed that a higher ranked webpage is a positive predictor for all three quality assessment tools. Conclusions: The overall quality of online information on HoLEP is poor. We identify that the top-ranked google searches have a higher DISCERN score and are a positive predictor for DISCERN/QUEST/JAMA. Quality online information can benefit patients but should be used in conjunction with professional medical consultation.
- Open Access
- 6 March 2024
- Published by MDPI AG in Preprints.org
Quality and Readability of Google Search Information on HoLEP for Benign Prostate Hyperplasia
Objective To assess the quality and readability of online information on holmium laser enucleation of the prostate in management of benign prostate hyperplasia using the most used search engine worldwide, google. Methods The google search term “Holmium laser surgery” and “enlarged prostate” was used and the initial 150 webpages were reviewed. Webpages that were paywall, scientific literature, and/or promoted advertisements were excluded. Quality assessment tools - DISCERN, QUEST, and JAMA criteria were used, while readability tools like FKG, GFI, SMOG, and FRE score were used. Two authors independently reviewed the included sites for further analysis; for any discrepancy, a third author would be involved. Results 107 webpages were included in the data analysis. The median DISCERN score was 42 out of 80 (IQR 35-49). The median JAMA score was 0 out of 4 (IQR 0-1). The median QUEST score was 9 out of 28 (IQR 9-12). Using the non-parametric ANOVA and post-hoc test, significant differences were identified between rankings of webpages. Sponsorship had no influence on quality of webpages. Overall readability level required a minimum reading level of grade 11. Linear regression analysis showed a higher rank webpage is a positive predictor for all three quality assessment tools. Conclusion The overall quality of online information regarding HoLEP is poor. We identify that top ranked google searches have a higher DISCERN score and is a positive predictor for DISCERN/QUEST/JAMA. Quality online information can be used to benefit patients but should be used in conjunction with consultation from a medical professional.
- 6 March 2024
- Published by MDPI AG in Preprints.org
Open AccessQuality and Readability of Google Search Information on HoLEP for Benign Prostate Hyperplasia
Objective To assess the quality and readability of online information on holmium laser enucleation of the prostate in management of benign prostate hyperplasia using the most used search engine worldwide, google. Methods The google search term “Holmium laser surgery” and “enlarged prostate” was used and the initial 150 webpages were reviewed. Webpages that were paywall, scientific literature, and/or promoted advertisements were excluded. Quality assessment tools - DISCERN, QUEST, and JAMA criteria were used, while readability tools like FKG, GFI, SMOG, and FRE score were used. Two authors independently reviewed the included sites for further analysis; for any discrepancy, a third author would be involved. Results 107 webpages were included in the data analysis. The median DISCERN score was 42 out of 80 (IQR 35-49). The median JAMA score was 0 out of 4 (IQR 0-1). The median QUEST score was 9 out of 28 (IQR 9-12). Using the non-parametric ANOVA and post-hoc test, significant differences were identified between rankings of webpages. Sponsorship had no influence on quality of webpages. Overall readability level required a minimum reading level of grade 11. Linear regression analysis showed a higher rank webpage is a positive predictor for all three quality assessment tools. Conclusion The overall quality of online information regarding HoLEP is poor. We identify that top ranked google searches have a higher DISCERN score and is a positive predictor for DISCERN/QUEST/JAMA. Quality online information can be used to benefit patients but should be used in conjunction with consultation from a medical professional.
- Open Access
- 5 January 2024
- Published by JMIR Publications Inc. in JMIR Preprints
Evaluating the Efficacy of ChatGPT as a Patient Education Tool in Prostate Cancer: Multimetric Assessment (Preprint)
BACKGROUND Artificial intelligence (AI) chatbots, such as ChatGPT, have made significant progress. These chatbots, particularly popular among health care professionals and patients, are transforming patient education and disease experience with personalized information. Accurate, timely patient education is crucial for informed decision-making, especially regarding prostate-specific antigen screening and treatment options. However, the accuracy and reliability of AI chatbots’ medical information must be rigorously evaluated. Studies testing ChatGPT’s knowledge of prostate cancer are emerging, but there is a need for ongoing evaluation to ensure the quality and safety of information provided to patients. OBJECTIVE This study aims to evaluate the quality, accuracy, and readability of ChatGPT-4’s responses to common prostate cancer questions posed by patients. METHODS Overall, 8 questions were formulated with an inductive approach based on information topics in peer-reviewed literature and Google Trends data. Adapted versions of the Patient Education Materials Assessment Tool for AI (PEMAT-AI), Global Quality Score, and DISCERN-AI tools were used by 4 independent reviewers to assess the quality of the AI responses. The 8 AI outputs were judged by 7 expert urologists, using an assessment framework developed to assess accuracy, safety, appropriateness, actionability, and effectiveness. The AI responses’ readability was assessed using established algorithms (Flesch Reading Ease score, Gunning Fog Index, Flesch-Kincaid Grade Level, The Coleman-Liau Index, and Simple Measure of Gobbledygook [SMOG] Index). A brief tool (Reference Assessment AI [REF-AI]) was developed to analyze the references provided by AI outputs, assessing for reference hallucination, relevance, and quality of references. RESULTS The PEMAT-AI understandability score was very good (mean 79.44%, SD 10.44%), the DISCERN-AI rating was scored as “good” quality (mean 13.88, SD 0.93), and the Global Quality Score was high (mean 4.46/5, SD 0.50). Natural Language Assessment Tool for AI had pooled mean accuracy of 3.96 (SD 0.91), safety of 4.32 (SD 0.86), appropriateness of 4.45 (SD 0.81), actionability of 4.05 (SD 1.15), and effectiveness of 4.09 (SD 0.98). The readability algorithm consensus was “difficult to read” (Flesch Reading Ease score mean 45.97, SD 8.69; Gunning Fog Index mean 14.55, SD 4.79), averaging an 11th-grade reading level, equivalent to 15- to 17-year-olds (Flesch-Kincaid Grade Level mean 12.12, SD 4.34; The Coleman-Liau Index mean 12.75, SD 1.98; SMOG Index mean 11.06, SD 3.20). REF-AI identified 2 reference hallucinations, while the majority (28/30, 93%) of references appropriately supplemented the text. Most references (26/30, 86%) were from reputable government organizations, while a handful were direct citations from scientific literature. CONCLUSIONS Our analysis found that ChatGPT-4 provides generally good responses to common prostate cancer queries, making it a potentially valuable tool for patient education in prostate cancer care. Objective quality assessment tools indicated that the natural language processing outputs were generally reliable and appropriate, but there is room for improvement.
- 5 January 2024
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessEvaluating the Efficacy of ChatGPT as a Patient Education Tool in Prostate Cancer: Multimetric Assessment (Preprint)
BACKGROUND Artificial intelligence (AI) chatbots, such as ChatGPT, have made significant progress. These chatbots, particularly popular among health care professionals and patients, are transforming patient education and disease experience with personalized information. Accurate, timely patient education is crucial for informed decision-making, especially regarding prostate-specific antigen screening and treatment options. However, the accuracy and reliability of AI chatbots’ medical information must be rigorously evaluated. Studies testing ChatGPT’s knowledge of prostate cancer are emerging, but there is a need for ongoing evaluation to ensure the quality and safety of information provided to patients. OBJECTIVE This study aims to evaluate the quality, accuracy, and readability of ChatGPT-4’s responses to common prostate cancer questions posed by patients. METHODS Overall, 8 questions were formulated with an inductive approach based on information topics in peer-reviewed literature and Google Trends data. Adapted versions of the Patient Education Materials Assessment Tool for AI (PEMAT-AI), Global Quality Score, and DISCERN-AI tools were used by 4 independent reviewers to assess the quality of the AI responses. The 8 AI outputs were judged by 7 expert urologists, using an assessment framework developed to assess accuracy, safety, appropriateness, actionability, and effectiveness. The AI responses’ readability was assessed using established algorithms (Flesch Reading Ease score, Gunning Fog Index, Flesch-Kincaid Grade Level, The Coleman-Liau Index, and Simple Measure of Gobbledygook [SMOG] Index). A brief tool (Reference Assessment AI [REF-AI]) was developed to analyze the references provided by AI outputs, assessing for reference hallucination, relevance, and quality of references. RESULTS The PEMAT-AI understandability score was very good (mean 79.44%, SD 10.44%), the DISCERN-AI rating was scored as “good” quality (mean 13.88, SD 0.93), and the Global Quality Score was high (mean 4.46/5, SD 0.50). Natural Language Assessment Tool for AI had pooled mean accuracy of 3.96 (SD 0.91), safety of 4.32 (SD 0.86), appropriateness of 4.45 (SD 0.81), actionability of 4.05 (SD 1.15), and effectiveness of 4.09 (SD 0.98). The readability algorithm consensus was “difficult to read” (Flesch Reading Ease score mean 45.97, SD 8.69; Gunning Fog Index mean 14.55, SD 4.79), averaging an 11th-grade reading level, equivalent to 15- to 17-year-olds (Flesch-Kincaid Grade Level mean 12.12, SD 4.34; The Coleman-Liau Index mean 12.75, SD 1.98; SMOG Index mean 11.06, SD 3.20). REF-AI identified 2 reference hallucinations, while the majority (28/30, 93%) of references appropriately supplemented the text. Most references (26/30, 86%) were from reputable government organizations, while a handful were direct citations from scientific literature. CONCLUSIONS Our analysis found that ChatGPT-4 provides generally good responses to common prostate cancer queries, making it a potentially valuable tool for patient education in prostate cancer care. Objective quality assessment tools indicated that the natural language processing outputs were generally reliable and appropriate, but there is room for improvement.
- 9 November 2023
- Published by Wiley in BJU International
- Vol. 133 (S3) , 25-32
Intra‐individual comparison of prostate‐specific membrane antigen positron emission tomography/computed tomography versus bone scan in detecting skeletal metastasis at prostate cancer diagnosis
Objectives: To compare the diagnostic performance and radiological staging impact of 68 Ga‐prostate‐specific membrane antigen positron emission tomography/computed tomography (PSMA PET/CT) compared to 99 Tc whole‐body bone scan (WBBS) for the detection of skeletal metastasis in the primary staging of prostate cancer (PCa). Patients and Methods: A prospective institutional database was retrospectively examined for patients who underwent both PSMA PET and WBBS within a 1 week interval for PCa primary staging. Lesions were categorised as ‘negative’, ‘equivocal’, or ‘definite’ based on nuclear medicine physician interpretation. Metastatic burden was characterised for each imaging modality according to three groups: (i) local disease (no skeletal metastases), (ii) oligometastatic disease (three or fewer skeletal metastases), or (iii) polymetastatic disease (more than three skeletal metastases). Results: There were 667 patients included. The median (interquartile range) prostate‐specific antigen level was 9.2 (6.2–16) ng/mL and 60% of patients were high risk according to a modified D'Amico risk classification. The overall distribution of skeletal metastasis detection changed across the two scans overall ( P = 0.003), being maintained within high‐risk ( P = 0.030) and low‐risk ( P = 0.018) groups. PSMA PET/CT identified more definite skeletal metastases compared to WBBS overall (10.3% vs 7.3%), and according to risk grouping (high: 12% vs 9%, intermediate: 4% vs 1%). Upstaging was more common with PSMA PET/CT than WBBS ( P = 0.001). The maximum standardised uptake value (SUV max ) of the primary tumour was associated with upstaging of skeletal metastases on PSMA PET/CT ( P = 0.025), while age was associated with upstaging on WBBS ( P = 0.021). The SUV max of the primary tumour and metastases were both higher according to extent of metastatic disease ( P = 0.001 and P < 0.001, respectively). Conclusions: More skeletal metastases were detected with PSMA PET/CT than WBBS, resulting in a higher upstaging rate mostly in high‐risk patients. The SUV max of the primary tumour and metastases was associated with upstaging.
- 9 November 2023
- Published by Wiley in BJU International
- Vol. 133 (S3) , 25-32
Intra‐individual comparison of prostate‐specific membrane antigen positron emission tomography/computed tomography versus bone scan in detecting skeletal metastasis at prostate cancer diagnosis
Objectives: To compare the diagnostic performance and radiological staging impact of 68 Ga‐prostate‐specific membrane antigen positron emission tomography/computed tomography (PSMA PET/CT) compared to 99 Tc whole‐body bone scan (WBBS) for the detection of skeletal metastasis in the primary staging of prostate cancer (PCa). Patients and Methods: A prospective institutional database was retrospectively examined for patients who underwent both PSMA PET and WBBS within a 1 week interval for PCa primary staging. Lesions were categorised as ‘negative’, ‘equivocal’, or ‘definite’ based on nuclear medicine physician interpretation. Metastatic burden was characterised for each imaging modality according to three groups: (i) local disease (no skeletal metastases), (ii) oligometastatic disease (three or fewer skeletal metastases), or (iii) polymetastatic disease (more than three skeletal metastases). Results: There were 667 patients included. The median (interquartile range) prostate‐specific antigen level was 9.2 (6.2–16) ng/mL and 60% of patients were high risk according to a modified D'Amico risk classification. The overall distribution of skeletal metastasis detection changed across the two scans overall ( P = 0.003), being maintained within high‐risk ( P = 0.030) and low‐risk ( P = 0.018) groups. PSMA PET/CT identified more definite skeletal metastases compared to WBBS overall (10.3% vs 7.3%), and according to risk grouping (high: 12% vs 9%, intermediate: 4% vs 1%). Upstaging was more common with PSMA PET/CT than WBBS ( P = 0.001). The maximum standardised uptake value (SUV max ) of the primary tumour was associated with upstaging of skeletal metastases on PSMA PET/CT ( P = 0.025), while age was associated with upstaging on WBBS ( P = 0.021). The SUV max of the primary tumour and metastases were both higher according to extent of metastatic disease ( P = 0.001 and P < 0.001, respectively). Conclusions: More skeletal metastases were detected with PSMA PET/CT than WBBS, resulting in a higher upstaging rate mostly in high‐risk patients. The SUV max of the primary tumour and metastases was associated with upstaging.
- 1 March 2023
- Published by Galenos Yayinevi in Journal of Urological Surgery
- Vol. 10 (1) , 77-81
Male Urethral Clear Cell Adenocarcinoma: Case Presentation and Literature Review of a Rare Cancer
- 1 March 2023
- Published by Galenos Yayinevi in Journal of Urological Surgery
- Vol. 10 (1) , 77-81
Male Urethral Clear Cell Adenocarcinoma: Case Presentation and Literature Review of a Rare Cancer