Marco Aurélio Graciotto Silva
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Marco Aurélio Graciotto Silva has a total of 49 co-authors. Here are the top co-authors by number of shared publications:
- Silvia Regina Vergilio
UFPR
6 shared publications André T. Endo
5 shared publications- Bruno Henrique Pachulski Camara5 shared publications
- Igor Wiese
UTFPR
4 shared publications - Ellen Francine Barbosa
Instituto de Ciências Matemáticas e de Computação (ICMC-USP Universidade de São Paulo -Departamento de Sistemas de Computação Caixa Postal 668 -CEP 13560-970 - São Carlos (SP Brasil
2 shared publications Igor Scaliante Wiese
Universidade Tecnológica Federal do Paraná
2 shared publications
Latest Publications
- Open Access
- 3 February 2026
- Published by Elsevier in Journal of Systems and Software
- Vol. 236
Investigating the potential of using worked examples to help resolve issues in a GitHub project
- 3 February 2026
- Published by Elsevier in Journal of Systems and Software
- Vol. 236
Open AccessInvestigating the potential of using worked examples to help resolve issues in a GitHub project
- Open Access
- 14 April 2025
- Published by Springer Nature in Research Square
An Empirical Study of the Comparison of Task Recommendation Techniques and Similar Source Code in Open Source Software Projects
Context: Managing issues in open-source software projects is challenging and costly, as many developers are casual and/or newcomers. On the one hand, maintainers must ensure the quality of issue descriptions and their labels and create mechanisms for recommending and assigning issues. On the other hand, to complete the issue, contributors must understand it and locate the artifacts related to a given functionality or the defect to be fixed. Objectives: This work aimed to conduct a comparative study of different models for recommending similar issues that could help developers with their contributions. Methods: We collected data on issues and pull requests from 35 open-source projects hosted on GitHub. We used the Term Frequency Inverse Document Frequency (TF-IDF), Sentence BERT (SBERT), and Word2Vec techniques to recommend similar issues and source code to assist newcomers' contributions. Results: The models based on the SBERT and TF-IDF techniques yielded better results in the recommendations generated than Word2Vec in the two evaluated scenarios (general issues and those marked as good for newcomers). SBERT was able to recommend past issues where the code used in the solution was approximately 17% similar to the actual solution of the issue used as a query to evaluate the models, reaching results similar to those of GPT 3.5 and GPT 4. Conclusion: Based on the empirical results obtained, we hope to take the next steps in transferring the knowledge gained to software projects and developers, especially by supporting newcomers developers during their first contribution.
- 14 April 2025
- Published by Springer Nature in Research Square
Open AccessAn Empirical Study of the Comparison of Task Recommendation Techniques and Similar Source Code in Open Source Software Projects
Context: Managing issues in open-source software projects is challenging and costly, as many developers are casual and/or newcomers. On the one hand, maintainers must ensure the quality of issue descriptions and their labels and create mechanisms for recommending and assigning issues. On the other hand, to complete the issue, contributors must understand it and locate the artifacts related to a given functionality or the defect to be fixed. Objectives: This work aimed to conduct a comparative study of different models for recommending similar issues that could help developers with their contributions. Methods: We collected data on issues and pull requests from 35 open-source projects hosted on GitHub. We used the Term Frequency Inverse Document Frequency (TF-IDF), Sentence BERT (SBERT), and Word2Vec techniques to recommend similar issues and source code to assist newcomers' contributions. Results: The models based on the SBERT and TF-IDF techniques yielded better results in the recommendations generated than Word2Vec in the two evaluated scenarios (general issues and those marked as good for newcomers). SBERT was able to recommend past issues where the code used in the solution was approximately 17% similar to the actual solution of the issue used as a query to evaluate the models, reaching results similar to those of GPT 3.5 and GPT 4. Conclusion: Based on the empirical results obtained, we hope to take the next steps in transferring the knowledge gained to software projects and developers, especially by supporting newcomers developers during their first contribution.
- Open Access
- 22 April 2024
- Published by Sociedade Brasileira de Computação
- p. 23-24
Análise dos efeitos do idioma na geração automática de respostas por aplicações de LLM
Atualmente os modelos grandes de linguagem (LLM) conseguem resolver com sucesso problemas tipicamente utilizados em disciplinas introdutórias de Computação (CS1). No entanto, de modo geral os estudos consideraram problemas e prompts especificados em inglês. O objetivo deste trabalho é avaliar os efeitos dos idiomas português e inglês utilizados na especificação do problema para a geração automática de respostas em problemas aplicáveis ao contexto de disciplinas de introdução à programação (CS1). Desta forma, observa-se que a taxa de acerto para o ChatGPT e Bard são elevadas, tanto para problemas em português ou inglês, enquanto o HuggingChat não alcançou bons resultados. Quanto à estrutura do prompt, nenhuma das aplicações LLM conseguiu acertar a resposta apenas com o enunciado. No entanto, ao fornecer mais informações, como formatação, dicas e casos de teste, geralmente se observa um desempenho melhor do ChatGPT e Bard.
- 22 April 2024
- Published by Sociedade Brasileira de Computação
- p. 23-24
Open AccessAnálise dos efeitos do idioma na geração automática de respostas por aplicações de LLM
Atualmente os modelos grandes de linguagem (LLM) conseguem resolver com sucesso problemas tipicamente utilizados em disciplinas introdutórias de Computação (CS1). No entanto, de modo geral os estudos consideraram problemas e prompts especificados em inglês. O objetivo deste trabalho é avaliar os efeitos dos idiomas português e inglês utilizados na especificação do problema para a geração automática de respostas em problemas aplicáveis ao contexto de disciplinas de introdução à programação (CS1). Desta forma, observa-se que a taxa de acerto para o ChatGPT e Bard são elevadas, tanto para problemas em português ou inglês, enquanto o HuggingChat não alcançou bons resultados. Quanto à estrutura do prompt, nenhuma das aplicações LLM conseguiu acertar a resposta apenas com o enunciado. No entanto, ao fornecer mais informações, como formatação, dicas e casos de teste, geralmente se observa um desempenho melhor do ChatGPT e Bard.
- Open Access
- 22 April 2024
- Published by Sociedade Brasileira de Computação
- p. 17-18
Abordagem para seleção de exemplos trabalhados para engenharia de software do domínio de sistemas distribuídos
Este estudo aborda a seleção de exemplos trabalhados para Engenharia de Software, com foco na melhoria da qualidade de código no contexto de Sistemas Distribuídos. Propõe-se uma abordagem, que emprega uma heurística baseada em métricas para selecionar exemplos de código que demonstrem melhorias significativas em aspectos como coesão e acoplamento. A análise é realizada em projetos de software livre amplamente reconhecidos, como Apache Kafka e ZooKeeper, utilizando as ferramentas CK, PyDriller e RefactoringMiner. Nossos resultados preliminares sugerem que tal abordagem pode auxiliar na seleção de códigos para a criação de exemplos trabalhados, fornecendo recursos práticos aos educadores, aplicados a domínios complexos como Sistemas Distribuídos. Dessa forma, espera-se contribuir para um aprendizado mais efetivo de Engenharia de Software aplicada naquele domínio.
- 22 April 2024
- Published by Sociedade Brasileira de Computação
- p. 17-18
Open AccessAbordagem para seleção de exemplos trabalhados para engenharia de software do domínio de sistemas distribuídos
Este estudo aborda a seleção de exemplos trabalhados para Engenharia de Software, com foco na melhoria da qualidade de código no contexto de Sistemas Distribuídos. Propõe-se uma abordagem, que emprega uma heurística baseada em métricas para selecionar exemplos de código que demonstrem melhorias significativas em aspectos como coesão e acoplamento. A análise é realizada em projetos de software livre amplamente reconhecidos, como Apache Kafka e ZooKeeper, utilizando as ferramentas CK, PyDriller e RefactoringMiner. Nossos resultados preliminares sugerem que tal abordagem pode auxiliar na seleção de códigos para a criação de exemplos trabalhados, fornecendo recursos práticos aos educadores, aplicados a domínios complexos como Sistemas Distribuídos. Dessa forma, espera-se contribuir para um aprendizado mais efetivo de Engenharia de Software aplicada naquele domínio.
- Open Access
- 6 December 2023
- Published by Sociedade Brasileira de Computação
- p. 100-109
Integração de atividades de programação no ensino de teste de software em um ambiente com elementos de jogos
O objetivo deste trabalho foi avaliar a integração de atividades de programação no ensino de teste de software usando elementos de jogos. Foi executado um estudo sobre implementação de programas e testes de unidade em Java com a ferramenta Code Defenders, avaliando-se o efeito do jogo e a qualidade dos programas. Como resultado, aferiu-se que a qualidade do Code Defender para ensino de teste é boa, destacando-se pelo interesse dos estudantes. Quanto à qualidade dos programas, a maioria dos estudantes conseguiu implementar com êxito os programas especificados.
- 6 December 2023
- Published by Sociedade Brasileira de Computação
- p. 100-109
Open AccessIntegração de atividades de programação no ensino de teste de software em um ambiente com elementos de jogos
O objetivo deste trabalho foi avaliar a integração de atividades de programação no ensino de teste de software usando elementos de jogos. Foi executado um estudo sobre implementação de programas e testes de unidade em Java com a ferramenta Code Defenders, avaliando-se o efeito do jogo e a qualidade dos programas. Como resultado, aferiu-se que a qualidade do Code Defender para ensino de teste é boa, destacando-se pelo interesse dos estudantes. Quanto à qualidade dos programas, a maioria dos estudantes conseguiu implementar com êxito os programas especificados.
- Open Access
- 7 November 2023
- Published by Association for Computing Machinery (ACM)
- p. 168-177
Vocabulary of Flaky Tests in Javascript
- 7 November 2023
- Published by Association for Computing Machinery (ACM)
- p. 168-177
Open AccessVocabulary of Flaky Tests in Javascript
- Open Access
- 3 May 2023
- Published by Editora UNIVALI in Anais Do Computer on the Beach
- Vol. 14, 409-415
Senso de pertencimento das mulheres em projetos de software
Background: Gender diversity is an important feature for softwaredevelopment. Studies show that teams with more diversity are moreproductive, too. Objective: This study is a systematic review thatanalyzes women’s motivations to contribute to software development,focusing on a sense of belonging. Method: A protocol wasestablished and the works retrieved by the applied search string.It was analyzed according to the inclusion and exclusion criteria.Results: The results showed that the main factors that motivatewomen to contribute to software projects are Kinship, Career andLearning. However, the sense of belonging, related to the termKinship, was more important in the analysis of groups composedonly of women, compared to heterogeneous groups. Conclusions:Thus, it was found that there are differences in motivations betweengenders, and the sense of belonging is more relevant forwomen than for men. Therefore, to increase diversity in softwareprojects, an important factor to be improved is the belonging of thecontributors.
- 3 May 2023
- Published by Editora UNIVALI in Anais Do Computer on the Beach
- Vol. 14, 409-415
Open AccessSenso de pertencimento das mulheres em projetos de software
Background: Gender diversity is an important feature for softwaredevelopment. Studies show that teams with more diversity are moreproductive, too. Objective: This study is a systematic review thatanalyzes women’s motivations to contribute to software development,focusing on a sense of belonging. Method: A protocol wasestablished and the works retrieved by the applied search string.It was analyzed according to the inclusion and exclusion criteria.Results: The results showed that the main factors that motivatewomen to contribute to software projects are Kinship, Career andLearning. However, the sense of belonging, related to the termKinship, was more important in the analysis of groups composedonly of women, compared to heterogeneous groups. Conclusions:Thus, it was found that there are differences in motivations betweengenders, and the sense of belonging is more relevant forwomen than for men. Therefore, to increase diversity in softwareprojects, an important factor to be improved is the belonging of thecontributors.
- Open Access
On the use of test smells for prediction of flaky tests
Regression testing is an important phase to deliver software with quality. However, flaky tests hamper the evaluation of test results and can increase costs. This is because a flaky test may pass or fail non-deterministically and to identify properly the flakiness of a test requires rerunning the test suite multiple times. To cope with this challenge, approaches have been proposed based on prediction models and machine learning. Existing approaches based on the use of the test case vocabulary may be context-sensitive and prone to overfitting, presenting low performance when executed in a cross-project scenario. To overcome these limitations, we investigate the use of test smells as predictors of flaky tests. We conducted an empirical study to understand if test smells have good performance as a classifier to predict the flakiness in the cross-project context, and analyzed the information gain of each test smell. We also compared the test smell-based approach with the vocabulary-based one. As a result, we obtained a classifier that had a reasonable performance (Random Forest, 0.83) to predict the flakiness in the testing phase. This classifier presented better performance than vocabulary-based model for cross-project prediction. The Assertion Roulette and Sleepy Test test smell types are the ones associated with the best information gain values.
Open AccessOn the use of test smells for prediction of flaky tests
Regression testing is an important phase to deliver software with quality. However, flaky tests hamper the evaluation of test results and can increase costs. This is because a flaky test may pass or fail non-deterministically and to identify properly the flakiness of a test requires rerunning the test suite multiple times. To cope with this challenge, approaches have been proposed based on prediction models and machine learning. Existing approaches based on the use of the test case vocabulary may be context-sensitive and prone to overfitting, presenting low performance when executed in a cross-project scenario. To overcome these limitations, we investigate the use of test smells as predictors of flaky tests. We conducted an empirical study to understand if test smells have good performance as a classifier to predict the flakiness in the cross-project context, and analyzed the information gain of each test smell. We also compared the test smell-based approach with the vocabulary-based one. As a result, we obtained a classifier that had a reasonable performance (Random Forest, 0.83) to predict the flakiness in the testing phase. This classifier presented better performance than vocabulary-based model for cross-project prediction. The Assertion Roulette and Sleepy Test test smell types are the ones associated with the best information gain values.