Hilário Oliveira
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Hilário Oliveira has a total of 74 co-authors. Here are the top co-authors by number of shared publications:
Rinaldo Lima
10 shared publicationsFred Freitas
9 shared publicationsRafael Dueire Lins
8 shared publicationsSteven J. Simske
8 shared publications- Péricles Miranda
Universidade Federal Rural de Pernambuco (UFRPE)
6 shared publications - Rafael Ferreira Mello
Universidade Federal Rural de Pernambuco (UFRPE)
6 shared publications
Latest Publications
- 27 June 2026
- Published by Springer Nature
- p. 3-16
A Synthetic Dataset for Evaluating Grammar Correction in Brazilian Portuguese Using Offline LLMs
- 27 June 2026
- Published by Springer Nature
- p. 3-16
A Synthetic Dataset for Evaluating Grammar Correction in Brazilian Portuguese Using Offline LLMs
- Open Access
- 19 April 2026
- Published by Elsevier in SSRN Electronic Journal
From VEDs to VLMs: Assessing Fine-Tuning Efficiency and Metric Reliability in Brazilian Portuguese Image Captioning
The adaptability and robustness of Visual Language Models (VLMs) to low-resource linguistic contexts remain a critical frontier in multimodal machine learning. This work evaluates the performance of state-of-the-art architectures, including ViTucano, PaliGemma, Phi-3 V, and LLaMA 3.2 V, in the context of Brazilian Portuguese image captioning (IC). By contrasting native human-annotated captions with machine-translated equivalents from the Flickr30K dataset, we delineate the performance gain and drop of using a translated corpus for fine-tuning versus its version annotated by native speakers, along with an additional comparison to the zero-shot setting. Furthermore, we demonstrate that VLMs fine-tuned under restricted conditions significantly outperform Vision Encoder-Decoder (VED) models, with ViTucano 2B, Phi-3 V, and PaliGemma achieving the highest results across translated and native data. Finally, our metrics adequacy analysis suggests that CLIP-Score is more robust than traditional unimodal metrics in distinguishing correct captions from incorrect, randomly selected captions.
- 19 April 2026
- Published by Elsevier in SSRN Electronic Journal
Open AccessFrom VEDs to VLMs: Assessing Fine-Tuning Efficiency and Metric Reliability in Brazilian Portuguese Image Captioning
The adaptability and robustness of Visual Language Models (VLMs) to low-resource linguistic contexts remain a critical frontier in multimodal machine learning. This work evaluates the performance of state-of-the-art architectures, including ViTucano, PaliGemma, Phi-3 V, and LLaMA 3.2 V, in the context of Brazilian Portuguese image captioning (IC). By contrasting native human-annotated captions with machine-translated equivalents from the Flickr30K dataset, we delineate the performance gain and drop of using a translated corpus for fine-tuning versus its version annotated by native speakers, along with an additional comparison to the zero-shot setting. Furthermore, we demonstrate that VLMs fine-tuned under restricted conditions significantly outperform Vision Encoder-Decoder (VED) models, with ViTucano 2B, Phi-3 V, and PaliGemma achieving the highest results across translated and native data. Finally, our metrics adequacy analysis suggests that CLIP-Score is more robust than traditional unimodal metrics in distinguishing correct captions from incorrect, randomly selected captions.
- Open Access
Brazilian Portuguese Image Captioning with Transformers: A Study on Cross-Native-Translated Dataset
Image captioning (IC) refers to the automatic generation of natural language descriptions for images, with applications ranging from social media content generation to assisting individuals with visual impairments. While most research has been focused on English-based models, low-resource languages such as Brazilian Portuguese face significant challenges due to the lack of specialized datasets and models. Several studies create datasets by automatically translating existing ones to mitigate resource scarcity. This work addresses this gap by proposing a cross-native-translated evaluation of Transformer-based vision and language models for Brazilian Portuguese IC. We use a version of Flickr30K comprised of captions manually created by native Brazilian Portuguese speakers and compare it to a version with captions automatically translated from English to Portuguese. The experiments include a cross-context approach, where models trained on one dataset are tested on the other to assess the translation impact. Additionally, we incorporate attention maps for model inference interpretation and use the CLIP-Score metric to evaluate the image-description alignment. Our findings show that Swin-DistilBERTimbau consistently outperforms other models, demonstrating strong generalization across datasets. ViTucano, a Brazilian Portuguese pre-trained VLM, surpasses larger multilingual models (GPT-4o, LLaMa 3.2 Vision) in traditional text-based evaluation metrics, while GPT-4 models achieve the highest CLIP-Score, highlighting improved image-text alignment. Attention analysis reveals systematic biases, including gender misclassification, object enumeration errors, and spatial inconsistencies. The datasets and the models generated and analyzed during the current study are available in: https://github.com/laicsiifes/transformer-caption-ptbr.
Open AccessBrazilian Portuguese Image Captioning with Transformers: A Study on Cross-Native-Translated Dataset
Image captioning (IC) refers to the automatic generation of natural language descriptions for images, with applications ranging from social media content generation to assisting individuals with visual impairments. While most research has been focused on English-based models, low-resource languages such as Brazilian Portuguese face significant challenges due to the lack of specialized datasets and models. Several studies create datasets by automatically translating existing ones to mitigate resource scarcity. This work addresses this gap by proposing a cross-native-translated evaluation of Transformer-based vision and language models for Brazilian Portuguese IC. We use a version of Flickr30K comprised of captions manually created by native Brazilian Portuguese speakers and compare it to a version with captions automatically translated from English to Portuguese. The experiments include a cross-context approach, where models trained on one dataset are tested on the other to assess the translation impact. Additionally, we incorporate attention maps for model inference interpretation and use the CLIP-Score metric to evaluate the image-description alignment. Our findings show that Swin-DistilBERTimbau consistently outperforms other models, demonstrating strong generalization across datasets. ViTucano, a Brazilian Portuguese pre-trained VLM, surpasses larger multilingual models (GPT-4o, LLaMa 3.2 Vision) in traditional text-based evaluation metrics, while GPT-4 models achieve the highest CLIP-Score, highlighting improved image-text alignment. Attention analysis reveals systematic biases, including gender misclassification, object enumeration errors, and spatial inconsistencies. The datasets and the models generated and analyzed during the current study are available in: https://github.com/laicsiifes/transformer-caption-ptbr.
- Open Access
- 20 January 2026
- Published by Sociedade Brasileira de Computação in Journal of the Brazilian Computer Society
- Vol. 32 (1) , 663-676
Brazilian Portuguese Image Captioning with Transformers: A Study on Cross-Native-Translated Dataset
Image captioning (IC) refers to the automatic generation of natural language descriptions for images, with applications ranging from social media content generation to assisting individuals with visual impairments. While most research has been focused on English-based models, low-resource languages such as Brazilian Portuguese face significant challenges due to the lack of specialized datasets and models. Several studies create datasets by automatically translating existing ones to mitigate resource scarcity. This work addresses this gap by proposing a cross-native-translated evaluation of Transformer-based vision and language models for Brazilian Portuguese IC. We use a version of Flickr30K comprised of captions manually created by native Brazilian Portuguese speakers and compare it to a version with captions automatically translated from English to Portuguese. The experiments include a cross-context approach, where models trained on one dataset are tested on the other to assess the translation impact. Additionally, we incorporate attention maps for model inference interpretation and use the CLIP-Score metric to evaluate the image-description alignment. Our findings show that Swin-DistilBERTimbau consistently outperforms other models, demonstrating strong generalization across datasets. ViTucano, a Brazilian Portuguese pre-trained VLM, surpasses larger multilingual models (GPT-4o, LLaMa 3.2 Vision) in traditional text-based evaluation metrics, while GPT-4 models achieve the highest CLIP-Score, highlighting improved image-text alignment. Attention analysis reveals systematic biases, including gender misclassification, object enumeration errors, and spatial inconsistencies.
- 20 January 2026
- Published by Sociedade Brasileira de Computação in Journal of the Brazilian Computer Society
- Vol. 32 (1) , 663-676
Open AccessBrazilian Portuguese Image Captioning with Transformers: A Study on Cross-Native-Translated Dataset
Image captioning (IC) refers to the automatic generation of natural language descriptions for images, with applications ranging from social media content generation to assisting individuals with visual impairments. While most research has been focused on English-based models, low-resource languages such as Brazilian Portuguese face significant challenges due to the lack of specialized datasets and models. Several studies create datasets by automatically translating existing ones to mitigate resource scarcity. This work addresses this gap by proposing a cross-native-translated evaluation of Transformer-based vision and language models for Brazilian Portuguese IC. We use a version of Flickr30K comprised of captions manually created by native Brazilian Portuguese speakers and compare it to a version with captions automatically translated from English to Portuguese. The experiments include a cross-context approach, where models trained on one dataset are tested on the other to assess the translation impact. Additionally, we incorporate attention maps for model inference interpretation and use the CLIP-Score metric to evaluate the image-description alignment. Our findings show that Swin-DistilBERTimbau consistently outperforms other models, demonstrating strong generalization across datasets. ViTucano, a Brazilian Portuguese pre-trained VLM, surpasses larger multilingual models (GPT-4o, LLaMa 3.2 Vision) in traditional text-based evaluation metrics, while GPT-4 models achieve the highest CLIP-Score, highlighting improved image-text alignment. Attention analysis reveals systematic biases, including gender misclassification, object enumeration errors, and spatial inconsistencies.
- 28 October 2025
- Published by Elsevier in Expert Systems with Applications
- Vol. 299
Large Language Models for chatbot applications handling sensitive information
- 28 October 2025
- Published by Elsevier in Expert Systems with Applications
- Vol. 299
Large Language Models for chatbot applications handling sensitive information
- 29 September 2025
- Published by Sociedade Brasileira de Computação
- p. 129-140
Enhancing E-Commerce with a RAG-Powered Conversational Recommender System
Conversational recommender systems have emerged as a promising approach to enhancing user experience in e-commerce by enabling interactive and personalized product discovery. This paper proposes a conversational recommender system for e-commerce that employs retrieval-augmented generation (RAG) to improve product recommendations based on natural language queries. Experiments were conducted using the ESCI-S dataset, an enriched version of the Amazon ESCI shopping queries dataset, to evaluate embedding models and large language models. The goal of this study is to assess the effectiveness of an RAG-based conversational recommender system and to identify optimal configurations for enhanced performance in e-commerce applications.
- 29 September 2025
- Published by Sociedade Brasileira de Computação
- p. 129-140
Enhancing E-Commerce with a RAG-Powered Conversational Recommender System
Conversational recommender systems have emerged as a promising approach to enhancing user experience in e-commerce by enabling interactive and personalized product discovery. This paper proposes a conversational recommender system for e-commerce that employs retrieval-augmented generation (RAG) to improve product recommendations based on natural language queries. Experiments were conducted using the ESCI-S dataset, an enriched version of the Amazon ESCI shopping queries dataset, to evaluate embedding models and large language models. The goal of this study is to assess the effectiveness of an RAG-based conversational recommender system and to identify optimal configurations for enhanced performance in e-commerce applications.
- 29 September 2025
- Published by Sociedade Brasileira de Computação
- p. 141-152
Evaluating Machine Learning Algorithms for Software Effort Estimation from Textual Descriptions of Requirements
A estimativa de esforço no desenvolvimento de software é uma tarefa desafiadora, subjetiva, que exige considerável empenho, impactando diretamente o planejamento e a alocação de recursos. Este trabalho investigou a eficácia de diferentes algoritmos de Aprendizado de Máquina (AM) e arquiteturas de redes neurais profundas na estimativa automática do esforço de desenvolvimento a partir de descrições textuais de requisitos. Foram avaliados algoritmos tradicionais de AM usando TF-IDF, bem como modelos baseados no BERT, em seis conjuntos de dados públicos. Os experimentos analisaram o desempenho dos modelos em dois cenários: intra e inter conjuntos de dados, utilizando a métrica de erro absoluto médio. Os resultados experimentais indicaram que os modelos baseados no BERT obtiveram o melhor desempenho no cenário intra bases de dados, mas apresentaram um declínio mais acentuado no cenário inter bases de dados em comparação com os algoritmos tradicionais.
- 29 September 2025
- Published by Sociedade Brasileira de Computação
- p. 141-152
Evaluating Machine Learning Algorithms for Software Effort Estimation from Textual Descriptions of Requirements
A estimativa de esforço no desenvolvimento de software é uma tarefa desafiadora, subjetiva, que exige considerável empenho, impactando diretamente o planejamento e a alocação de recursos. Este trabalho investigou a eficácia de diferentes algoritmos de Aprendizado de Máquina (AM) e arquiteturas de redes neurais profundas na estimativa automática do esforço de desenvolvimento a partir de descrições textuais de requisitos. Foram avaliados algoritmos tradicionais de AM usando TF-IDF, bem como modelos baseados no BERT, em seis conjuntos de dados públicos. Os experimentos analisaram o desempenho dos modelos em dois cenários: intra e inter conjuntos de dados, utilizando a métrica de erro absoluto médio. Os resultados experimentais indicaram que os modelos baseados no BERT obtiveram o melhor desempenho no cenário intra bases de dados, mas apresentaram um declínio mais acentuado no cenário inter bases de dados em comparação com os algoritmos tradicionais.
- Open Access
- 29 September 2025
- Published by Sociedade Brasileira de Computação
- p. 101-112
Benchmarking Large Language Models for Text-to-SQL in Brazilian Portuguese and English
This work assessed the performance of seventeen large language models, including open-source and proprietary models, on the Text-to-SQL task in both Brazilian Portuguese and English. Two schema representation strategies were considered: textual descriptions and representations using data definition language. Experimental results on the Spider dataset demonstrated the superior performance of proprietary models, particularly the Gemini-2.5-Flash-preview, as measured by the Execution Accuracy and Exact Match metrics. Among the open-source models, Qwen-2.5-Coder-14B achieved the highest performance. An error analysis of the best-performing model revealed strong proficiency in handling clauses such as SELECT and AND/OR, while considerable challenges persisted in generating more complex constructs, including GROUP BY with HAVING and set operators like UNION and INTERSECT.
- 29 September 2025
- Published by Sociedade Brasileira de Computação
- p. 101-112
Open AccessBenchmarking Large Language Models for Text-to-SQL in Brazilian Portuguese and English
This work assessed the performance of seventeen large language models, including open-source and proprietary models, on the Text-to-SQL task in both Brazilian Portuguese and English. Two schema representation strategies were considered: textual descriptions and representations using data definition language. Experimental results on the Spider dataset demonstrated the superior performance of proprietary models, particularly the Gemini-2.5-Flash-preview, as measured by the Execution Accuracy and Exact Match metrics. Among the open-source models, Qwen-2.5-Coder-14B achieved the highest performance. An error analysis of the best-performing model revealed strong proficiency in handling clauses such as SELECT and AND/OR, while considerable challenges persisted in generating more complex constructs, including GROUP BY with HAVING and set operators like UNION and INTERSECT.
- Open Access
- 20 July 2025
- Published by Sociedade Brasileira de Computação
- p. 429-440
Comparação de Modelos de Embeddings e LLMs para Geração Aumentada por Recuperação em Português
Os modelos de linguagem de larga escala (LLMs) representam um avanço para a área de processamento de linguagem natural, impulsionando o desempenho em tarefas como geração de texto e resposta a perguntas. No entanto, eles enfrentam desafios como alucinações e falta de acesso a informações atualizadas. A técnica de geração aumentada por recuperação (RAG) busca mitigar esses problemas ao integrar recuperação de informações externas à geração de texto, melhorando a precisão e a atualidade das respostas. Este trabalho realizou uma investigação de diversos modelos embeddings e LLMs de código aberto e proprietários aplicados à técnica RAG considerando três bases de dados contendo documentos escritos em português do Brasil. Os resultados experimentais demonstraram que os modelos Multilingual E5 large e Gemma 2 9B obtiveram o melhor desempenho dentre os modelos avaliados com base em diferentes medidas de avaliação.
- 20 July 2025
- Published by Sociedade Brasileira de Computação
- p. 429-440
Open AccessComparação de Modelos de Embeddings e LLMs para Geração Aumentada por Recuperação em Português
Os modelos de linguagem de larga escala (LLMs) representam um avanço para a área de processamento de linguagem natural, impulsionando o desempenho em tarefas como geração de texto e resposta a perguntas. No entanto, eles enfrentam desafios como alucinações e falta de acesso a informações atualizadas. A técnica de geração aumentada por recuperação (RAG) busca mitigar esses problemas ao integrar recuperação de informações externas à geração de texto, melhorando a precisão e a atualidade das respostas. Este trabalho realizou uma investigação de diversos modelos embeddings e LLMs de código aberto e proprietários aplicados à técnica RAG considerando três bases de dados contendo documentos escritos em português do Brasil. Os resultados experimentais demonstraram que os modelos Multilingual E5 large e Gemma 2 9B obtiveram o melhor desempenho dentre os modelos avaliados com base em diferentes medidas de avaliação.
- Open Access
- 27 March 2025
- Published by Elsevier in Data in Brief
- Vol. 60, 111526
A benchmark dataset of narrative student essays with multi-competency grades for automatic essay scoring in Brazilian Portuguese
- 27 March 2025
- Published by Elsevier in Data in Brief
- Vol. 60, 111526
Open AccessA benchmark dataset of narrative student essays with multi-competency grades for automatic essay scoring in Brazilian Portuguese