AlHasan AlSammarraie
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
AlHasan AlSammarraie has a total of 7 co-authors. Here are the top co-authors by number of shared publications:
- Ali Al-Saifi
Applab, Doha, Qatar
1 shared publication - Dena Al-Thani
Hamad Bin Khalifa University
1 shared publication Hassan Kamhia
Wareed Medical Content Foundation, Riyadh, Saudi Arabia
1 shared publicationMohamed Aboagla
Department of Medical Oncology - National Cancer Center and Cancer Research, Hamad Medical Corporation, Doha, Qatar
1 shared publicationMowafa Househ
Hamad Bin Khalifa University College of Science and Engineering, Doha, Qatar
1 shared publication- Raian Ali
College of Science and Engineering, Hamad Bin Khalifa University
1 shared publication
Latest Publications
- Open Access
- 25 July 2025
- Published by BMJ in BMJ Health & Care Informatics
- Vol. 32 (1) , e101570
Development and evaluation of an agentic LLM based RAG framework for evidence-based patient education
Objectives: To develop and evaluate an agentic retrieval augmented generation (ARAG) framework using open-source large language models (LLMs) for generating evidence-based Arabic patient education materials (PEMs) and assess the LLMs capabilities as validation agents tasked with blocking harmful content. Methods: We selected 12 LLMs and applied four experimental setups (base, base+prompt engineering, ARAG, and ARAG+prompt engineering). PEM generation quality was assessed via two-stage evaluation (automated LLM, then expert review) using 5 metrics (accuracy, readability, comprehensiveness, appropriateness and safety) against ground truth. Validation agent (VA) performance was evaluated separately using a harmful/safe PEM dataset, measuring blocking accuracy. Results: ARAG-enabled setups yielded the best generation performance for 10/12 LLMs. Arabic-focused models occupied the top 9 ranks. Expert evaluation ranking mirrored the automated ranking. AceGPT-v2-32B with ARAG and prompt engineering (setup 4) was confirmed highest-performing. VA accuracy correlated strongly with model size; only models ≥27B parameters achieved >0.80 accuracy. Fanar-7B performed well in generation but poorly as a VA. Discussion: Arabic-centred models demonstrated advantages for the Arabic PEM generation task. ARAG enhanced generation quality, although context limits impacted large-context models. The validation task highlighted model size as critical for reliable performance. Conclusion: ARAG noticeably improves Arabic PEM generation, particularly with Arabic-centred models like AceGPT-v2-32B. Larger models appear necessary for reliable harmful content validation. Automated evaluation showed potential for ranking systems, aligning with expert judgement for top performers.
- 25 July 2025
- Published by BMJ in BMJ Health & Care Informatics
- Vol. 32 (1) , e101570
Open AccessDevelopment and evaluation of an agentic LLM based RAG framework for evidence-based patient education
Objectives: To develop and evaluate an agentic retrieval augmented generation (ARAG) framework using open-source large language models (LLMs) for generating evidence-based Arabic patient education materials (PEMs) and assess the LLMs capabilities as validation agents tasked with blocking harmful content. Methods: We selected 12 LLMs and applied four experimental setups (base, base+prompt engineering, ARAG, and ARAG+prompt engineering). PEM generation quality was assessed via two-stage evaluation (automated LLM, then expert review) using 5 metrics (accuracy, readability, comprehensiveness, appropriateness and safety) against ground truth. Validation agent (VA) performance was evaluated separately using a harmful/safe PEM dataset, measuring blocking accuracy. Results: ARAG-enabled setups yielded the best generation performance for 10/12 LLMs. Arabic-focused models occupied the top 9 ranks. Expert evaluation ranking mirrored the automated ranking. AceGPT-v2-32B with ARAG and prompt engineering (setup 4) was confirmed highest-performing. VA accuracy correlated strongly with model size; only models ≥27B parameters achieved >0.80 accuracy. Fanar-7B performed well in generation but poorly as a VA. Discussion: Arabic-centred models demonstrated advantages for the Arabic PEM generation task. ARAG enhanced generation quality, although context limits impacted large-context models. The validation task highlighted model size as critical for reliable performance. Conclusion: ARAG noticeably improves Arabic PEM generation, particularly with Arabic-centred models like AceGPT-v2-32B. Larger models appear necessary for reliable harmful content validation. Automated evaluation showed potential for ranking systems, aligning with expert judgement for top performers.
- Open Access
- 6 September 2023
- Published by Association for Computing Machinery (ACM)
- p. 156-164
Designing for User's Digital Wellbeing: Co-creating Nudges with Designers
- 6 September 2023
- Published by Association for Computing Machinery (ACM)
- p. 156-164
Open AccessDesigning for User's Digital Wellbeing: Co-creating Nudges with Designers