Nadia Boukhelifa
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Nadia Boukhelifa has a total of 43 co-authors. Here are the top co-authors by number of shared publications:
- Anastasia Bezerianos
LISN, Université Paris-Saclay, CNRS, INRIA, Orsay, France
4 shared publications - Alberto Tonda
INRAE, Université Paris-Saclay
2 shared publications - Emilie Crouzat
Univ. Grenoble Alpes, LESSEM, INRAE, France
2 shared publications - Evelyne Lutton
INRAE, Université Paris-Saclay
2 shared publications - Fabien Stark
UMR SELMET, Université de Montpellier, INRAE, CIRAD, Institut Agro
2 shared publications - Jacques Lasseur
SELMET, Univ. Montpellier, CIRAD, Institut Agro Montpellier, INRAE, France
2 shared publications
Latest Publications
- 30 June 2026
- Published by SAGE Publications in Information Visualization
- Vol. 25 (4) , 495-517
Seeing the trade-offs: Evaluating visualizations for multi-criteria comparison of set alternatives-test
Comparisons are central in multi-criteria decision-making, where alternatives must be evaluated across multiple, often conflicting goals. This process becomes especially complex when alternatives are grouped into sets. Based on formative research with domain experts, we first characterize set comparisons in trade-off analysis. In two design workshops, we identify potential visualization solutions to support them. Finally, we conduct a user study with lay participants and collect expert feedback to evaluate the two most promising visualizations that encode trade-offs, alongside a baseline that conveys this information numerically. Our findings show that visual encodings are preferred. The decoupled visual encoding, which separates different trade-off metrics, is favored by the domain expert. For non-experts, this decoupled visualization leads to higher perceived mental load and lower confidence although it may support more varied decision strategies. In contrast, the coupled visualization that integrates these metrics, results in higher confidence but may promote strategies that min-max only the top priorities. Supplementary material are available at https://osf.io/xnbm2/overview?view_only=4b5b940dce0f4ced8b933d9eaceaf3f5 .
- 30 June 2026
- Published by SAGE Publications in Information Visualization
- Vol. 25 (4) , 495-517
Seeing the trade-offs: Evaluating visualizations for multi-criteria comparison of set alternatives-test
Comparisons are central in multi-criteria decision-making, where alternatives must be evaluated across multiple, often conflicting goals. This process becomes especially complex when alternatives are grouped into sets. Based on formative research with domain experts, we first characterize set comparisons in trade-off analysis. In two design workshops, we identify potential visualization solutions to support them. Finally, we conduct a user study with lay participants and collect expert feedback to evaluate the two most promising visualizations that encode trade-offs, alongside a baseline that conveys this information numerically. Our findings show that visual encodings are preferred. The decoupled visual encoding, which separates different trade-off metrics, is favored by the domain expert. For non-experts, this decoupled visualization leads to higher perceived mental load and lower confidence although it may support more varied decision strategies. In contrast, the coupled visualization that integrates these metrics, results in higher confidence but may promote strategies that min-max only the top priorities. Supplementary material are available at https://osf.io/xnbm2/overview?view_only=4b5b940dce0f4ced8b933d9eaceaf3f5 .
- Open Access
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Explaining Complex ML Models to Domain Experts Using LLM & Visualization: An Exploration in the French Breadmaking Industry
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Open AccessExplaining Complex ML Models to Domain Experts Using LLM & Visualization: An Exploration in the French Breadmaking Industry
- Open Access
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Bridging Modeling and Domain Expertise Through Visualization: A Case Study on Bread-Making with Bayesian Networks
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Open AccessBridging Modeling and Domain Expertise Through Visualization: A Case Study on Bread-Making with Bayesian Networks
- 18 February 2025
- Published by Springer Nature
- p. 307-316
Comparison of Machine Learning-Enhanced Dynamic Hybrid Models for a Nanobody Scorpion Antivenom Production with Escherichia Coli
- 18 February 2025
- Published by Springer Nature
- p. 307-316
Comparison of Machine Learning-Enhanced Dynamic Hybrid Models for a Nanobody Scorpion Antivenom Production with Escherichia Coli
- 9 July 2024
- Published by Wiley in European Journal of Soil Science
- Vol. 75 (4)
Using spatial aggregation of soil multifunctionality maps to support uncertainty‐aware planning decisions
To ensure soil preservation, it is essential to incorporate the soil's ability to provide ecosystem services into the spatial planning process. For well‐informed planning decisions, stakeholders need spatially explicit information on the state of the soils and the functions they fulfil, with sufficient spatial resolution and quantified uncertainty. It has been shown that Digital Soil Mapping (DSM) products can provide such information. However, in some cases, fine spatial resolution coupled with high levels of uncertainty may lead stakeholders to overlook the inherent uncertainties in the information. Spatial aggregation of DSM products opens up a promising avenue for obtaining maps that are more tailored to the users' scales of decision making while facilitating uncertainty communication. In this perspective, we propose a new spatial aggregation approach relying on spatially constrained agglomerative clustering (AC). The spatial aggregation approach is applied to a 25‐m‐resolution soil potential multifunctionality index (SPMI) map developed for the coastal plain of the Occitanie Region. This DSM product was increasingly aggregated to obtain SPMI maps of different resolutions displaying two distinct areal metrics: proportions of area above a given threshold of SPMI, and mean SPMI. Each map was evaluated through a set of indicators selected for their potential impact on user decision making: mean spatial resolution, overall predicted uncertainty, quantity of information and mean within‐unit variability. The maps were compared with respect to these indicators to other maps obtained with alternative aggregation methods employed in DSM literature (maps aggregated according to some administrative units and QuadMaps). We show that all the tested aggregation methods produced a substantial decrease of the map uncertainty with moderate loss of spatial resolution. However, only AC preserved the fine spatial pattern of the initial DSM product while enabling fine tuning of the uncertainty displayed to end‐users. We show that AC can simplify the identification of extensive regions characterized by low uncertainty without losing information regarding soil multifunctionality, thereby facilitating and enhancing the efficiency of planning decisions.
- 9 July 2024
- Published by Wiley in European Journal of Soil Science
- Vol. 75 (4)
Using spatial aggregation of soil multifunctionality maps to support uncertainty‐aware planning decisions
To ensure soil preservation, it is essential to incorporate the soil's ability to provide ecosystem services into the spatial planning process. For well‐informed planning decisions, stakeholders need spatially explicit information on the state of the soils and the functions they fulfil, with sufficient spatial resolution and quantified uncertainty. It has been shown that Digital Soil Mapping (DSM) products can provide such information. However, in some cases, fine spatial resolution coupled with high levels of uncertainty may lead stakeholders to overlook the inherent uncertainties in the information. Spatial aggregation of DSM products opens up a promising avenue for obtaining maps that are more tailored to the users' scales of decision making while facilitating uncertainty communication. In this perspective, we propose a new spatial aggregation approach relying on spatially constrained agglomerative clustering (AC). The spatial aggregation approach is applied to a 25‐m‐resolution soil potential multifunctionality index (SPMI) map developed for the coastal plain of the Occitanie Region. This DSM product was increasingly aggregated to obtain SPMI maps of different resolutions displaying two distinct areal metrics: proportions of area above a given threshold of SPMI, and mean SPMI. Each map was evaluated through a set of indicators selected for their potential impact on user decision making: mean spatial resolution, overall predicted uncertainty, quantity of information and mean within‐unit variability. The maps were compared with respect to these indicators to other maps obtained with alternative aggregation methods employed in DSM literature (maps aggregated according to some administrative units and QuadMaps). We show that all the tested aggregation methods produced a substantial decrease of the map uncertainty with moderate loss of spatial resolution. However, only AC preserved the fine spatial pattern of the initial DSM product while enabling fine tuning of the uncertainty displayed to end‐users. We show that AC can simplify the identification of extensive regions characterized by low uncertainty without losing information regarding soil multifunctionality, thereby facilitating and enhancing the efficiency of planning decisions.
- Open Access
- 11 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-8
Supporting Interdisciplinary Research with Cards-based Workshops - A Case Study on Participatory Planning for Mountain Pastoralism
Profound transformations are currently impacting the intricate relationships between human pastoral activities and Alpine mountain ecosystems. In this context, we were invited as human-computer interaction practitioners to join an interdisciplinary team, to reinforce the use of computer simulations in meetings with local stakeholders. However, due to the diverse nature of stakeholders involved and their interactions, the specific format of these meetings and the utilization of model simulations remained unclear. To clarify these uncertainties, we designed a cards-based ideation method to collectively plan participatory workshops and envisage if and how information technology tools could be integrated. In this paper, we present the design of our ideation method Cards4Concertation and two workshops that implemented it. We then reflect on our findings with lessons learnt both for designing cards-based activities for ideation within interdisciplinary teams, as well as visualizations for participatory planning and decision-making.
- 11 May 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-8
Open AccessSupporting Interdisciplinary Research with Cards-based Workshops - A Case Study on Participatory Planning for Mountain Pastoralism
Profound transformations are currently impacting the intricate relationships between human pastoral activities and Alpine mountain ecosystems. In this context, we were invited as human-computer interaction practitioners to join an interdisciplinary team, to reinforce the use of computer simulations in meetings with local stakeholders. However, due to the diverse nature of stakeholders involved and their interactions, the specific format of these meetings and the utilization of model simulations remained unclear. To clarify these uncertainties, we designed a cards-based ideation method to collectively plan participatory workshops and envisage if and how information technology tools could be integrated. In this paper, we present the design of our ideation method Cards4Concertation and two workshops that implemented it. We then reflect on our findings with lessons learnt both for designing cards-based activities for ideation within interdisciplinary teams, as well as visualizations for participatory planning and decision-making.
- 14 September 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Computer Graphics and Applications
- Vol. 43 (5) , 23-25
Visualization and Decision Making Design Under Uncertainty
Uncertainty is an important aspect to data understanding. Without awareness of the variability, error, or reliability of a dataset, the ability to make decisions on that data is limited. However, practices around uncertainty visualization remain domain-specific, rooted in convention, and in many instances, absent entirely. Part of the reason for this may be a lack of established guidelines for navigating difficult choices of when uncertainty should be added, how to visualize uncertainty, and how to evaluate its effectiveness. Unsurprisingly, the inclusion of uncertainty into visualizations is a major challenge to visualization. As work concerned with uncertainty visualization grows, it has become clear that simple visual additions of uncertainty information to traditional visualization methods do not appropriately convey the meaning of the uncertainty, pose many perceptual challenges, and, in the worst case, can lead a viewer to a completely wrong understanding of the data. These challenges are the driving motivator for this special issue.
- 14 September 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Computer Graphics and Applications
- Vol. 43 (5) , 23-25
Visualization and Decision Making Design Under Uncertainty
Uncertainty is an important aspect to data understanding. Without awareness of the variability, error, or reliability of a dataset, the ability to make decisions on that data is limited. However, practices around uncertainty visualization remain domain-specific, rooted in convention, and in many instances, absent entirely. Part of the reason for this may be a lack of established guidelines for navigating difficult choices of when uncertainty should be added, how to visualize uncertainty, and how to evaluate its effectiveness. Unsurprisingly, the inclusion of uncertainty into visualizations is a major challenge to visualization. As work concerned with uncertainty visualization grows, it has become clear that simple visual additions of uncertainty information to traditional visualization methods do not appropriately convey the meaning of the uncertainty, pose many perceptual challenges, and, in the worst case, can lead a viewer to a completely wrong understanding of the data. These challenges are the driving motivator for this special issue.
- Open Access
Biosys-LiDeOGraM: A visual analytics framework for interactive modelling of multiscale biosystems
In this paper, we present a test of an interactive modelling scheme in real conditions. The aim is to use this scheme to identify the physiological responses of microorganisms at different scales in a real industrial application context. The originality of the proposed tool, Biosys-LiDeOGraM, is to generate through a human–machine cooperation a consistent and concise model from molecules to microbial population scales: If multi-omics measurements can be connected relatively easily to the response of the biological system at the molecular scale, connecting them to the macroscopic level of the biosystem remains a difficult task, where human knowledge plays a crucial role. The use-case considered here pertains to an engineering process of freeze-drying and storage of Lactic Acid Bacteria. Producing a satisfying model of this process is a challenge due to (i) the scarcity and variability of the experimental dataset, (ii) the complexity and multi-scale nature of biological phenomena, and (iii) the wide knowledge about the biological mechanisms involved in this process. The Biosys-LiDeOGraM tool has two main components that can have to be utilized in an iterative manner: the Genomic Interactive Clustering (GIC) module and the Interactive Multi-Scale modellIng Exploration (IMSIE) module, both involve users in their learning loops. Applying our approach to a dataset of 2,741 genes, an initial model, as a graph involving 33 variables and 165 equations, was first built. Then the system was able to interactively improve a synthetic version of this model using only 27 variables and 16 equations. The final graph providing a consistent and explainable biological model. This graphical representation allows various user interpretations at local and global scales, an easy confrontation with data, and an exploration of various assumptions. Finally Biosys-LiDeOGraM is easily transferable to other use-cases of multi-scale modelling using ‘functional’ graphs. Author summary: The use of “omics” data for understanding biological systems has become prevalent in several research domains. However, the data generated from diverse macroscopic scales used for this purpose is highly heterogeneous and challenging to integrate. Yet, it is crucial to incorporate this information to gain a comprehensive understanding of the underlying biological system. Although various integrative analysis methods that have been developed provide predictive molecular-scale models, they only offer a mechanistic view of the biological system at the cellular level. In addition, they often focus on specific biological hypotheses through dedicated case studies, making it difficult to apply their results to other scientific problems. To address these issues, we propose an interactive multi-scale modelling approach to integrate cross-scale relationships providing predictive and potentially explanatory models. A proof-of-concept tool has been developed and was validated in the context of the bioproduction of Lactococcus lactis , a bacterial species of high economic interest in the food industry and for which the control of the bioprocess is essential to guarantee its viability and functionality. Our approach can be applied to any biological system that can be defined through a set of variables, constraints and scales.
Open AccessBiosys-LiDeOGraM: A visual analytics framework for interactive modelling of multiscale biosystems
In this paper, we present a test of an interactive modelling scheme in real conditions. The aim is to use this scheme to identify the physiological responses of microorganisms at different scales in a real industrial application context. The originality of the proposed tool, Biosys-LiDeOGraM, is to generate through a human–machine cooperation a consistent and concise model from molecules to microbial population scales: If multi-omics measurements can be connected relatively easily to the response of the biological system at the molecular scale, connecting them to the macroscopic level of the biosystem remains a difficult task, where human knowledge plays a crucial role. The use-case considered here pertains to an engineering process of freeze-drying and storage of Lactic Acid Bacteria. Producing a satisfying model of this process is a challenge due to (i) the scarcity and variability of the experimental dataset, (ii) the complexity and multi-scale nature of biological phenomena, and (iii) the wide knowledge about the biological mechanisms involved in this process. The Biosys-LiDeOGraM tool has two main components that can have to be utilized in an iterative manner: the Genomic Interactive Clustering (GIC) module and the Interactive Multi-Scale modellIng Exploration (IMSIE) module, both involve users in their learning loops. Applying our approach to a dataset of 2,741 genes, an initial model, as a graph involving 33 variables and 165 equations, was first built. Then the system was able to interactively improve a synthetic version of this model using only 27 variables and 16 equations. The final graph providing a consistent and explainable biological model. This graphical representation allows various user interpretations at local and global scales, an easy confrontation with data, and an exploration of various assumptions. Finally Biosys-LiDeOGraM is easily transferable to other use-cases of multi-scale modelling using ‘functional’ graphs. Author summary: The use of “omics” data for understanding biological systems has become prevalent in several research domains. However, the data generated from diverse macroscopic scales used for this purpose is highly heterogeneous and challenging to integrate. Yet, it is crucial to incorporate this information to gain a comprehensive understanding of the underlying biological system. Although various integrative analysis methods that have been developed provide predictive molecular-scale models, they only offer a mechanistic view of the biological system at the cellular level. In addition, they often focus on specific biological hypotheses through dedicated case studies, making it difficult to apply their results to other scientific problems. To address these issues, we propose an interactive multi-scale modelling approach to integrate cross-scale relationships providing predictive and potentially explanatory models. A proof-of-concept tool has been developed and was validated in the context of the bioproduction of Lactococcus lactis , a bacterial species of high economic interest in the food industry and for which the control of the bioprocess is essential to guarantee its viability and functionality. Our approach can be applied to any biological system that can be defined through a set of variables, constraints and scales.
- Open Access
- 3 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-6
Développement d’une interface de simulation multi-agents pour la gestion concertée des territoires pastoraux de moyenne montagne
- 3 April 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-6
Open AccessDéveloppement d’une interface de simulation multi-agents pour la gestion concertée des territoires pastoraux de moyenne montagne
- 4 May 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 29 (9) , 3758-3774
Understanding How In-Visualization Provenance Can Support Trade-Off Analysis
In domains, such as agronomy or manufacturing, experts need to consider trade-offs when making decisions that involve several, often competing, objectives. Such analysis is complex and may be conducted over long periods of time, making it hard to revisit. In this paper, we consider the use of analytic provenance mechanisms to aid experts recall and keep track of trade-off analysis. We implemented VisProm, a web-based trade-off analysis system, that incorporates in-visualization provenance views, designed to help experts keep track of trade-offs and their objectives. We used VisProm as a technology probe to understand user needs and explore the potential role of provenance in this context. Through observation sessions with three groups of experts analyzing their own data, we make the following contributions. We first, identify eight high-level tasks that experts engaged in during trade-off analysis, such as locating and characterizing interest zones in the trade-off space, and show how these tasks can be supported by provenance visualization. Second, we refine findings from previous work on provenance purposes such as recall and reproduce, by identifying specific objects of these purposes related to trade-off analysis, such as interest zones, and exploration structure (e.g., exploration of alternatives and branches). Third, we discuss insights on how the identified provenance objects and our designs support these trade-off analysis tasks, both when revisiting past analysis and while actively exploring. And finally, we identify new opportunities for provenance-driven trade-off analysis, for example related to monitoring the coverage of the trade-off space, and tracking alternative trade-off scenarios.
- 4 May 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 29 (9) , 3758-3774
Understanding How In-Visualization Provenance Can Support Trade-Off Analysis
In domains, such as agronomy or manufacturing, experts need to consider trade-offs when making decisions that involve several, often competing, objectives. Such analysis is complex and may be conducted over long periods of time, making it hard to revisit. In this paper, we consider the use of analytic provenance mechanisms to aid experts recall and keep track of trade-off analysis. We implemented VisProm, a web-based trade-off analysis system, that incorporates in-visualization provenance views, designed to help experts keep track of trade-offs and their objectives. We used VisProm as a technology probe to understand user needs and explore the potential role of provenance in this context. Through observation sessions with three groups of experts analyzing their own data, we make the following contributions. We first, identify eight high-level tasks that experts engaged in during trade-off analysis, such as locating and characterizing interest zones in the trade-off space, and show how these tasks can be supported by provenance visualization. Second, we refine findings from previous work on provenance purposes such as recall and reproduce, by identifying specific objects of these purposes related to trade-off analysis, such as interest zones, and exploration structure (e.g., exploration of alternatives and branches). Third, we discuss insights on how the identified provenance objects and our designs support these trade-off analysis tasks, both when revisiting past analysis and while actively exploring. And finally, we identify new opportunities for provenance-driven trade-off analysis, for example related to monitoring the coverage of the trade-off space, and tracking alternative trade-off scenarios.