Leonardo Marques
Research Subjects
Leonardo Marques has a total of 26 co-authors. Here are the top co-authors by number of shared publications:
- Bruno Gadelha
UFAM
6 shared publications - Tayana Conte
UFAM
6 shared publications - Monalessa Perini Barcellos
UFES
3 shared publications - Walter Takashi Nakamura
UTFPR / UFAM
3 shared publications - Carolina De Freitas Manso
Federal University of Espírito Santo
2 shared publications - Genildo Gomes
Institute of Computing, Federal University of Amazonas, Manaus, AM, Brazil, --- Select a Country --
2 shared publications
Latest Publications
- 4 November 2025
- Published by Sociedade Brasileira de Computação
- p. 1-11
Will AI also replace inspectors? Investigating the potential of generative AIs in usability inspection
Usability inspection is a well-established technique for identifying interaction issues in software interfaces, thereby contributing to improved product quality. However, it is a costly process that requires time and specialized knowledge from inspectors. With advances in Artificial Intelligence (AI), new opportunities have emerged to support this task, particularly through generative models capable of interpreting interfaces and performing inspections more efficiently. This study examines the performance of generative AIs in identifying usability problems, comparing them to those of experienced human inspectors. A software prototype was evaluated by four specialists and two AI models (GPT-4o and Gemini 2.5 Flash), using metrics such as precision, recall, and F1-score. While inspectors achieved the highest levels of precision and overall coverage, the AIs demonstrated high individual performance and discovered many novel defects, but with a higher rate of false positives and redundant reports. The combination of AIs and human inspectors produced the best results, revealing their complementarity. These findings suggest that AI, in its current stage, cannot replace human inspectors but can serve as a valuable augmentation tool to improve efficiency and expand defect coverage. The results provide evidence based on quantitative analysis to inform the discussion on the role of AI in usability inspections, pointing to viable paths for its complementary use in software quality assessment contexts.
- 4 November 2025
- Published by Sociedade Brasileira de Computação
- p. 1-11
Will AI also replace inspectors? Investigating the potential of generative AIs in usability inspection
Usability inspection is a well-established technique for identifying interaction issues in software interfaces, thereby contributing to improved product quality. However, it is a costly process that requires time and specialized knowledge from inspectors. With advances in Artificial Intelligence (AI), new opportunities have emerged to support this task, particularly through generative models capable of interpreting interfaces and performing inspections more efficiently. This study examines the performance of generative AIs in identifying usability problems, comparing them to those of experienced human inspectors. A software prototype was evaluated by four specialists and two AI models (GPT-4o and Gemini 2.5 Flash), using metrics such as precision, recall, and F1-score. While inspectors achieved the highest levels of precision and overall coverage, the AIs demonstrated high individual performance and discovered many novel defects, but with a higher rate of false positives and redundant reports. The combination of AIs and human inspectors produced the best results, revealing their complementarity. These findings suggest that AI, in its current stage, cannot replace human inspectors but can serve as a valuable augmentation tool to improve efficiency and expand defect coverage. The results provide evidence based on quantitative analysis to inform the discussion on the role of AI in usability inspections, pointing to viable paths for its complementary use in software quality assessment contexts.
- Open Access
- 28 May 2025
- Published by Sociedade Brasileira de Computação in Journal of Software Engineering Research and Development
- Vol. 13 (2)
Challenges and Solutions for Organizational Change in the Software Industry: A Tertiary Study
Organizational Change (OC) in the software industry is essential for maintaining competitiveness in dynamic environments. However, OC initiatives often face inefficiencies due to the lack of structured methodologies and reliance on ad hoc practices. This tertiary study analyzes 17 secondary studies related to the OC theme and its instances affecting key organizational pillars, such as technology, processes, and people. The results reveal limited adoption of OC models in software organizations. In response, it synthesizes 41 OC models, 14 critical success factors, and 6 key characteristics, offering a synthesized overview of structured OC frameworks and their relevance to the software industry context, supporting future adaptation efforts by practitioners.
- 28 May 2025
- Published by Sociedade Brasileira de Computação in Journal of Software Engineering Research and Development
- Vol. 13 (2)
Open AccessChallenges and Solutions for Organizational Change in the Software Industry: A Tertiary Study
Organizational Change (OC) in the software industry is essential for maintaining competitiveness in dynamic environments. However, OC initiatives often face inefficiencies due to the lack of structured methodologies and reliance on ad hoc practices. This tertiary study analyzes 17 secondary studies related to the OC theme and its instances affecting key organizational pillars, such as technology, processes, and people. The results reveal limited adoption of OC models in software organizations. In response, it synthesizes 41 OC models, 14 critical success factors, and 6 key characteristics, offering a synthesized overview of structured OC frameworks and their relevance to the software industry context, supporting future adaptation efforts by practitioners.
- Open Access
- 17 January 2025
- Published by Sociedade Brasileira de Computação in Journal of the Brazilian Computer Society
- Vol. 31 (1) , 68-98
Unveiling the Use of Networked Ontologies to Develop a Supporting Tool for UX Evaluation in an Immersive Context
Immersive technologies have emerged as a new type of interactive system that aims to provide users with immersive experiences. They have been adopted in various fields and are gradually becoming part of our lives. UX is a key quality attribute to evaluate or model such experiences. However, when it comes to immersive experiences, evaluating UX is particularly challenging because the user should not be interrupted to provide feedback. Aiming at giving a step to address this issue, we have explored using ontologies from an ontology network to support evaluating immersive experiences. In this work, we adopted the Human-Computer Interaction Ontology Network (HCI-ON) and used an extract containing concepts from some of its networked ontologies to develop the User eXperience evaluation based on Ontology Network (UXON), an ontology-based tool that supports UX experts evaluating immersive experiences based on data recorded in interaction logs. HCI-ON is a framework for organizing knowledge of the HCI domain, offering a general understanding of the field, regardless of specific solutions. UXON was used to evaluate the UX of Compomus, an immersive application that supports collaborative music composition. UXON extracts data from the application interaction logs, calculates UX metrics, and provides consolidated data and information in graphs and tables. We conducted a study and collected feedback from the UXON developer and three UX experts who used the tool. Results showed that using networked ontologies to develop a tool to support UX evaluation is feasible and valuable. In summary, the ontologies helped at the conceptual level by offering a basis to define the system's structural model and at the implementation level by assigning semantics to data to make inferences about UX. Based on the UX experts' perceptions, UXON was considered a promising system, beneficial, helpful, and easy to use. The conceptualization used to develop UXON was evaluated by HCI experts and it was considered adequate and understandable, having the potential to be used by other people to solve HCI evaluation problems.
- 17 January 2025
- Published by Sociedade Brasileira de Computação in Journal of the Brazilian Computer Society
- Vol. 31 (1) , 68-98
Open AccessUnveiling the Use of Networked Ontologies to Develop a Supporting Tool for UX Evaluation in an Immersive Context
Immersive technologies have emerged as a new type of interactive system that aims to provide users with immersive experiences. They have been adopted in various fields and are gradually becoming part of our lives. UX is a key quality attribute to evaluate or model such experiences. However, when it comes to immersive experiences, evaluating UX is particularly challenging because the user should not be interrupted to provide feedback. Aiming at giving a step to address this issue, we have explored using ontologies from an ontology network to support evaluating immersive experiences. In this work, we adopted the Human-Computer Interaction Ontology Network (HCI-ON) and used an extract containing concepts from some of its networked ontologies to develop the User eXperience evaluation based on Ontology Network (UXON), an ontology-based tool that supports UX experts evaluating immersive experiences based on data recorded in interaction logs. HCI-ON is a framework for organizing knowledge of the HCI domain, offering a general understanding of the field, regardless of specific solutions. UXON was used to evaluate the UX of Compomus, an immersive application that supports collaborative music composition. UXON extracts data from the application interaction logs, calculates UX metrics, and provides consolidated data and information in graphs and tables. We conducted a study and collected feedback from the UXON developer and three UX experts who used the tool. Results showed that using networked ontologies to develop a tool to support UX evaluation is feasible and valuable. In summary, the ontologies helped at the conceptual level by offering a basis to define the system's structural model and at the implementation level by assigning semantics to data to make inferences about UX. Based on the UX experts' perceptions, UXON was considered a promising system, beneficial, helpful, and easy to use. The conceptualization used to develop UXON was evaluated by HCI experts and it was considered adequate and understandable, having the potential to be used by other people to solve HCI evaluation problems.
- 19 June 2024
- Published by Taylor & Francis in International Journal of Human–Computer Interaction
- Vol. 41 (2) , 1552-1568
Characterizing UX Assessment in the Context of Immersive Experiences: A Systematic Mapping Study
- 19 June 2024
- Published by Taylor & Francis in International Journal of Human–Computer Interaction
- Vol. 41 (2) , 1552-1568
Characterizing UX Assessment in the Context of Immersive Experiences: A Systematic Mapping Study
- Open Access
- 16 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-12
Using Networked Ontologies to support UX Evaluation in Immersive Context
Over the past few years, new interactive systems such as immersive technologies have gradually permeated our daily lives and found adoption across various fields. Immersive technologies provide users with immersive experiences. Assessing and modeling the quality of such experiences has become a trending topic in HCI, and UX is a key quality attribute in this context. When it comes to immersive experiences, evaluating UX is particularly challenging because the user should not be interrupted to provide feedback. In this paper, we propose using networked ontologies to support evaluating immersive experiences. We have explored using ontologies from an ontology network addressing the HCI domain to develop a tool that supports UX experts evaluating such experiences based on data recorded in interaction logs. We used the ontology-based tool to evaluate the UX of an immersive application that supports collaborative music composition. The tool extracted data from the application interaction logs applied UX metrics, and provided consolidated data and information in graphs and tables. We conducted a study and collected feedback from the tool developer and three UX experts who used the tool. Results showed that using networked ontologies to develop a tool to support UX evaluation is feasible and valuable. In summary, the ontologies helped at the conceptual level by offering a basis to define the system’s structural model and at the implementation level by assigning semantics to data to make inferences about UX. Based on the UX experts’ perceptions, the tool was considered a promising system, beneficial, helpful, and easy to use.
- 16 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-12
Open AccessUsing Networked Ontologies to support UX Evaluation in Immersive Context
Over the past few years, new interactive systems such as immersive technologies have gradually permeated our daily lives and found adoption across various fields. Immersive technologies provide users with immersive experiences. Assessing and modeling the quality of such experiences has become a trending topic in HCI, and UX is a key quality attribute in this context. When it comes to immersive experiences, evaluating UX is particularly challenging because the user should not be interrupted to provide feedback. In this paper, we propose using networked ontologies to support evaluating immersive experiences. We have explored using ontologies from an ontology network addressing the HCI domain to develop a tool that supports UX experts evaluating such experiences based on data recorded in interaction logs. We used the ontology-based tool to evaluate the UX of an immersive application that supports collaborative music composition. The tool extracted data from the application interaction logs applied UX metrics, and provided consolidated data and information in graphs and tables. We conducted a study and collected feedback from the tool developer and three UX experts who used the tool. Results showed that using networked ontologies to develop a tool to support UX evaluation is feasible and valuable. In summary, the ontologies helped at the conceptual level by offering a basis to define the system’s structural model and at the implementation level by assigning semantics to data to make inferences about UX. Based on the UX experts’ perceptions, the tool was considered a promising system, beneficial, helpful, and easy to use.
- Open Access
Understanding UX Better: A New Technique to Go beyond Emotion Assessment
User experience (UX) is a quality aspect that considers the emotions evoked by the system, extending the usability concept beyond effectiveness, efficiency, and satisfaction. Practitioners and researchers are aware of the importance of evaluating UX. Thus, UX evaluation is a growing field with diverse approaches. Despite various approaches, most of them produce a general indication of the experience as a result and do not seek to capture the problem that gave rise to the bad UX. This information makes it difficult to obtain relevant results to improve the application, making it challenging to identify what caused a negative user experience. To address this gap, we developed a UX evaluation technique called UX-Tips. This paper presents UX-Tips and reports two empirical studies performed in an academic and an industrial setting to evaluate it. Our results show that UX-Tips had good performance in terms of efficiency and effectiveness, making it possible to identify the causes that led to a negative user experience, and it was easy to use. In this sense, we present a new technique suitable for use in both academic and industrial settings, allowing UX evaluation and finding the problems that may lead to a negative experience.
Open AccessUnderstanding UX Better: A New Technique to Go beyond Emotion Assessment
User experience (UX) is a quality aspect that considers the emotions evoked by the system, extending the usability concept beyond effectiveness, efficiency, and satisfaction. Practitioners and researchers are aware of the importance of evaluating UX. Thus, UX evaluation is a growing field with diverse approaches. Despite various approaches, most of them produce a general indication of the experience as a result and do not seek to capture the problem that gave rise to the bad UX. This information makes it difficult to obtain relevant results to improve the application, making it challenging to identify what caused a negative user experience. To address this gap, we developed a UX evaluation technique called UX-Tips. This paper presents UX-Tips and reports two empirical studies performed in an academic and an industrial setting to evaluate it. Our results show that UX-Tips had good performance in terms of efficiency and effectiveness, making it possible to identify the causes that led to a negative user experience, and it was easy to use. In this sense, we present a new technique suitable for use in both academic and industrial settings, allowing UX evaluation and finding the problems that may lead to a negative experience.
- Open Access
- 1 March 2021
- Published by Sociedade Brasileira de Computação in Journal on Interactive Systems
- Vol. 12 (1) , 294-307
Bumbometer digital crowd game: collaboration through competition in entertainment events
The use of mobile devices, especially smartphones, is widespread across all social strata and age groups, helping to ensure faster access from anywhere, data collection, and more regular and frequent control to aid urban, environmental, and social management. In this scenario, the entertainment industry has benefited from this powerful individual technological resource in cultural and sporting events. In this way, this work presents a proposal for interaction and engagement in entertainment events in a more prosperous and more technological way, through the development of a collaborative and competitive mobile-web crowd game, intended for enhancing interaction between the crowd and as a unified group, whether physically co-located or online. The application, called Bumbometer, uses motion sensors during an interactive dynamic with the crowd applying concepts from Mobile Crowd Sensing and User eXperience. We conducted two experimental studies to evaluate the proposed technology, the first in a real scenario of a folk cultural festival and the second in a controlled environment, simulating an event considering a scenario in which users were geographically distant. The results indicate that people feel immersed and engaged during the interaction through the proposed game, which reinforces the statement that the game meets an increasingly growing need to use technologies to ensure more significant interaction and audience immersion at crowd entertainment events, a creative and far-reaching form.
- 1 March 2021
- Published by Sociedade Brasileira de Computação in Journal on Interactive Systems
- Vol. 12 (1) , 294-307
Open AccessBumbometer digital crowd game: collaboration through competition in entertainment events
The use of mobile devices, especially smartphones, is widespread across all social strata and age groups, helping to ensure faster access from anywhere, data collection, and more regular and frequent control to aid urban, environmental, and social management. In this scenario, the entertainment industry has benefited from this powerful individual technological resource in cultural and sporting events. In this way, this work presents a proposal for interaction and engagement in entertainment events in a more prosperous and more technological way, through the development of a collaborative and competitive mobile-web crowd game, intended for enhancing interaction between the crowd and as a unified group, whether physically co-located or online. The application, called Bumbometer, uses motion sensors during an interactive dynamic with the crowd applying concepts from Mobile Crowd Sensing and User eXperience. We conducted two experimental studies to evaluate the proposed technology, the first in a real scenario of a folk cultural festival and the second in a controlled environment, simulating an event considering a scenario in which users were geographically distant. The results indicate that people feel immersed and engaged during the interaction through the proposed game, which reinforces the statement that the game meets an increasingly growing need to use technologies to ensure more significant interaction and audience immersion at crowd entertainment events, a creative and far-reaching form.
- Open Access
- 1 January 2021
- Published by INSTICC
- p. 549-556
LogMe: An Application for Generating Logs in Immersive Interactions for UX Evaluation
- 1 January 2021
- Published by INSTICC
- p. 549-556
Open AccessLogMe: An Application for Generating Logs in Immersive Interactions for UX Evaluation
- Open Access
- 1 January 2019
- Published by Sociedade Brasileira de Computação in Revista Brasileira de Informática na Educação
- Vol. 27 (1) , 104-131
Are scale-based techniques enough for learners to convey their UX when using a Learning Management System?
As technology evolves, learning institutions have sought to invest in new learning technologies. Many universities have been adopting platforms designed to support the learning process, called Learning Management Systems (LMSs), to complement face-to-face learning, as well as to support distance learning. This widespread adoption of LMSs raises the need for evaluating them regarding aspects related to quality in use, such as User eXperience (UX). UX is very important in e-learning context, given that it may influence learner’s attitude towards the use of the LMS. Despite its importance, few studies evaluated the UX of LMSs. Moreover, researchers have been using generic techniques to evaluate them. In this context, there is no evidence of studies conducted to identify whether these techniques can fully capture the experience conveyed by these platforms. This paper presents an analysis of two UX evaluation techniques (User Experience Questionnaire, and Integrated Experience Acceptance Model) applied to an LMS called Edmodo. We carried out a study with 34 students, divided into two groups, to evaluate the UX of Edmodo and obtain their perceptions about the technique they used. We also gathered the difficulties faced by the students during the execution of the tasks on the platform, while correlating those difficulties with learning issues. In addition, we performed a qualitative analysis in order to better understand the results. Regarding Edmodo, the results showed that the students perceived its UX as positive. Regarding the techniques, both groups considered them easy to use and useful. However, around 41% of the students in both groups reported that they were not able to fully evaluate their UX using the techniques. The qualitative results allowed the identification of positive and negative aspects that researchers may consider during the improvement or development of new UX evaluation techniques.
- 1 January 2019
- Published by Sociedade Brasileira de Computação in Revista Brasileira de Informática na Educação
- Vol. 27 (1) , 104-131
Open AccessAre scale-based techniques enough for learners to convey their UX when using a Learning Management System?
As technology evolves, learning institutions have sought to invest in new learning technologies. Many universities have been adopting platforms designed to support the learning process, called Learning Management Systems (LMSs), to complement face-to-face learning, as well as to support distance learning. This widespread adoption of LMSs raises the need for evaluating them regarding aspects related to quality in use, such as User eXperience (UX). UX is very important in e-learning context, given that it may influence learner’s attitude towards the use of the LMS. Despite its importance, few studies evaluated the UX of LMSs. Moreover, researchers have been using generic techniques to evaluate them. In this context, there is no evidence of studies conducted to identify whether these techniques can fully capture the experience conveyed by these platforms. This paper presents an analysis of two UX evaluation techniques (User Experience Questionnaire, and Integrated Experience Acceptance Model) applied to an LMS called Edmodo. We carried out a study with 34 students, divided into two groups, to evaluate the UX of Edmodo and obtain their perceptions about the technique they used. We also gathered the difficulties faced by the students during the execution of the tasks on the platform, while correlating those difficulties with learning issues. In addition, we performed a qualitative analysis in order to better understand the results. Regarding Edmodo, the results showed that the students perceived its UX as positive. Regarding the techniques, both groups considered them easy to use and useful. However, around 41% of the students in both groups reported that they were not able to fully evaluate their UX using the techniques. The qualitative results allowed the identification of positive and negative aspects that researchers may consider during the improvement or development of new UX evaluation techniques.