Gerardo Sierra
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Gerardo Sierra has a total of 4 co-authors. Here are the top co-authors by number of shared publications:
- Francisco Fernando Lopez-Ponce
Instituto de Ingeniería, Universidad Nacional Autónoma de México, Avenida Universidad 3000, Mexico City 04510, Mexico
1 shared publication - Gemma Bel-Enguix
Instituto de Ingeniería, Universidad Nacional Autónoma de México, Avenida Universidad 3000, Mexico City, 04510, Mexico City, Mexico, Mexico
1 shared publication - Sergio-Luis Ojeda-Trueba
Instituto de Ingeniería, Universidad Nacional Autónoma de México, Avenida Universidad 3000, Mexico City 04510, Mexico
1 shared publication - Ángel Cadena-Bautista
Instituto de Ingeniería, Universidad Nacional Autónoma de México, Avenida Universidad 3000, Mexico City, 04510, Mexico City, Mexico, Mexico
1 shared publication
Latest Publications
- Open Access
- 7 November 2024
- Published by MDPI AG in Preprints.org
Exploring the Behavior and Performance of Large Language Models: Can LLMs Infer Answers to Questions Involving Restricted Information?
In this paper various LLMs are tested in a specific domain using a Retrieval-Augmented Generation (RAG) system. The study focuses on the performance and behaviour of the models and was conducted in Spanish. A questionnaire based on The Bible, which consist of questions that vary in complexity of reasoning, was created in order to evaluate the reasoning capabilities of each model. The RAG system matches a question with the most similar passage from The Bible and feeds the pair to each LLM. The evaluation aims to determine whether each model can reason solely with the provided information or if it disregards the instructions given and makes use on its pretrained knowledge.
- 7 November 2024
- Published by MDPI AG in Preprints.org
Open AccessExploring the Behavior and Performance of Large Language Models: Can LLMs Infer Answers to Questions Involving Restricted Information?
In this paper various LLMs are tested in a specific domain using a Retrieval-Augmented Generation (RAG) system. The study focuses on the performance and behaviour of the models and was conducted in Spanish. A questionnaire based on The Bible, which consist of questions that vary in complexity of reasoning, was created in order to evaluate the reasoning capabilities of each model. The RAG system matches a question with the most similar passage from The Bible and feeds the pair to each LLM. The evaluation aims to determine whether each model can reason solely with the provided information or if it disregards the instructions given and makes use on its pretrained knowledge.