ArabLegalEval: A Multitask Benchmark for Assessing Arabic Legal Knowledge in Large Language Models
Authors:
- Faris HijaziFHFaris Hijazi
- Somayah AlharbiSASomayah Alharbi
- Abdulaziz AlHusseinAAAbdulaziz AlHussein
- Harethah ShairahHSHarethah Shairah
- Reem AlzahraniRAReem Alzahrani
- Hebah AlshamlanHAHebah Alshamlan
- George TurkiyyahGTGeorge Turkiyyah
- Omar KnioOKOmar Knio
Top Cited Papers
Open Access
- 1 January 2024
- conference paper
- Published by Association for Computational Linguistics (ACL)
- p. 225-249
Abstract
Faris Hijazi, Somayah Alharbi, Abdulaziz AlHussein, Harethah Shairah, Reem Alzahrani, Hebah Alshamlan, George Turkiyyah, Omar Knio. Proceedings of The Second Arabic Natural Language Processing Conference. 2024.Keywords
All Related Versions
This publication has 9 references indexed in Scilit:
- Better to Ask in English: Cross-Lingual Evaluation of Large Language Models for Healthcare Queries2024
- Large language models as tax attorneys: a case study in legal capabilities emergencePhilosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 2024
- Prediction of Arabic Legal Rulings Using Large Language ModelsElectronics, 2024
- The Implications of ChatGPT For Legal Services and SocietyMichigan Technology Law Review, 2024
- LawBench: Benchmarking Legal Knowledge of Large Language Models2024
- ArabicMMLU: Assessing Massive Multitask Language Understanding in Arabic2024
- Why Are Lawyers Afraid of AI?Communications of the ACM, 2023
- Transforming legal text interactions: leveraging natural language processing and large language models for legal support in Palestinian cooperativesInternational Journal of Information Technology, 2023
- Semantic Answer Similarity for Evaluating Question Answering Models2021