PLPierre Lison

Pierre Lison

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Pierre Lison has a total of 33 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Unsupervised utility evaluation of text anonymization methods via neural language models

    by Benet Manzanares-Salor, David Sánchez, Pierre Lison


  • Open Access

    Graph-to-Text Approach to Knowledge-Grounded Response Generation in Human–Robot Interaction

    by Nicholas Thomas Walker, Stefan Ultes, Pierre Lison

    Knowledge graphs are often used to represent structured information in a flexible and efficient manner, but their use in situated dialogue remains under-explored. This paper presents a novel conversational model for human--robot interaction that rests upon a graph-based representation of the dialogue state. The knowledge graph representing the dialogue state is continuously updated with new observations from the robot sensors, including linguistic, situated and multimodal inputs, and is further enriched by other modules, in particular for spatial understanding. The neural conversational model employed to respond to user utterances relies on a simple but effective graph-to-text mechanism that traverses the dialogue state graph and converts the traversals into a natural language form. This conversion of the state graph into text is performed using a set of parameterized functions, and the values for those parameters are optimized based on a small set of Wizard-of-Oz interactions. After this conversion, the text representation of the dialogue state graph is included as part of the prompt of a large language model used to decode the agent response. The proposed approach is empirically evaluated through a user study with a humanoid robot that acts as conversation partner to evaluate the impact of the graph-to-text mechanism on the response generation. After moving a robot along a tour of an indoor environment, participants interacted with the robot using spoken dialogue and evaluated how well the robot was able to answer questions about what the robot observed during the tour. User scores suggest an improvement in the perceived factuality of the robot responses when the graph-to-text approach is employed compared to a baseline using inputs structured as semantic triples.


  • Open Access

    Prior Lessons of Incremental Dialogue and Robot Action Management for the Age of Language Models

    by Casey Kennington, Pierre Lison, David Schlangen

    Efforts towards endowing robots with the ability to speak have benefited from recent advancements in natural language processing, in particular large language models. However, current language models are not fully incremental, as their processing is inherently monotonic and thus lack the ability to revise their interpretations or output in light of newer observations. This monotonicity has important implications for the development of dialogue systems for human–robot interaction. In this paper, we review the literature on interactive systems that operate incrementally (i.e., at the word level or below it). We motivate the need for incremental systems, survey incremental modeling of important aspects of dialogue like speech recognition and language generation. Primary focus is on the part of the system that makes decisions, known as the dialogue manager. We find that there is very little research on incremental dialogue management, offer some requirements for practical incremental dialogue management, and implications of incremental dialogue for embodied, robotic platforms in the age of large language models.


  • Open Access

    Digitising health history: The creation, function and implementation of the Norwegian Health Archives Registry

    by Gina Helstad, Pierre Lison, Elin Tuveng, Kari Nytrøen

    Context: The Norwegian Health Archives Registry (NHAR) is a national initiative dedicated to digitising, centralising, and providing access to historical full-text patient health records (PHRs) for research purposes. Established in 2019, NHAR includes PHRs from the deceased population in Norway’s specialist healthcare services, offering a unique long-term data source for future research. NHAR has now digitised 1.7 million paper-based PHRs, covering medical history dating back to 1875. The registry is now expanding to include digital-born PHRs. Aim: This article describes NHAR’s innovation potential as a health registry, its data management processes, and the integration of artificial intelligence (AI) tools to facilitate data management and research in compliance with strict health data regulations. Practice innovation: NHAR’s data value chain includes structured metadata acquisition, large-scale digitisation and secure data delivery for research. The workflow includes a custom optical character recognition (OCR) tool tailored to Norwegian medical terminology, concept-based search tools for unstructured clinical full text and robust strategies for long-term data management. A novel AI-based de-identification system automatically detects and masks personal identifiers in digitised PHRs. Lessons learned: Despite these innovations, challenges persist in processing handwritten and historical PHRs due to OCR limitations and language-specific complexities. Key challenges include improving data quality, enhancing OCR accuracy and refining AI tools for information retrieval, data extraction and de-identification. Conclusion: NHAR offers significant potential for interdisciplinary research across various medical fields. Implications for health information management practice: NHAR establishes a foundation for secure access to historical health data and introduces advanced data management strategies to facilitate future research.


  • Open Access

    Truthful text sanitization guided by inference attacks

    by Ildikó Pilán, Benet Manzanares-Salor, David Sánchez, Pierre Lison


  • Open Access

    Stronger Re-identification Attacks through Reasoning and Aggregation

    by Lucas Georges Gabriel Charpentier, Pierre Lison

    Text de-identification techniques are often used to mask personally identifiable information (PII) from documents. Their ability to conceal the identity of the individuals mentioned in a text is, however, hard to measure. Recent work has shown how the robustness of de-identification methods could be assessed by attempting the reverse process of _re-identification_, based on an automated adversary using its background knowledge to uncover the PIIs that have been masked. This paper presents two complementary strategies to build stronger re-identification attacks. We first show that (1) the _order_ in which the PII spans are re-identified matters, and that aggregating predictions across multiple orderings leads to improved results. We also find that (2) reasoning models can boost the re-identification performance, especially when the adversary is assumed to have access to extensive background knowledge.

  • Open Access

    Following Route Instructions using Large Vision-Language Models: A Comparison between Low-level and Panoramic Action Spaces

    by Vebjørn Haug Kåsene, Pierre Lison

    Vision-and-Language Navigation (VLN) refers to the task of enabling autonomous robots to navigate unfamiliar environments by following natural language instructions. While recent Large Vision-Language Models (LVLMs) have shown promise in this task, most current VLM systems rely on models specifically designed and optimized for navigation, leaving the potential of off-the-shelf LVLMs underexplored. Furthermore, while older VLN approaches used low-level action spaces with egocentric views and atomic actions (such as "turn left" or "move forward"), newer models tend to favor panoramic action spaces with discrete navigable viewpoints. This paper investigates (1) whether off-the-shelf LVLMs (fine-tuned without architectural modifications or simulator-based training) can effectively support VLN tasks and (2) whether such models can support both low-level and panoramic action paradigms. To this end, we fine-tune the open-source model Qwen2.5-VL-3B-Instruct on the Room-to-Room (R2R) dataset and evaluate its empirical performance across both low-level and panoramic action spaces. The best resulting model achieves a 41% success rate on the R2R test set, demonstrating that while off-the-shelf LVLMs can learn to perform Vision-and-Language Navigation, they still lag behind models specifically designed for this task.

  • Open Access

    Re-identification of De-identified Documents with Autoregressive Infilling

    by Lucas Georges Gabriel Charpentier, Pierre Lison

    Documents revealing sensitive information about individuals must typically be de-identified. This de-identification is often done by masking all mentions of personally identifiable information (PII), thereby making it more difficult to uncover the identity of the person(s) in question. To investigate the robustness of de-identification methods, we present a novel, RAG-inspired approach that attempts the reverse process of re-identification based on a database of documents representing background knowledge. Given a text in which personal identifiers have been masked, the re-identification proceeds in two steps. A retriever first selects from the background knowledge passages deemed relevant for the re-identification. Those passages are then provided to an infilling model which seeks to infer the original content of each text span. This process is repeated until all masked spans are replaced. We evaluate the re-identification on three datasets (Wikipedia biographies, court rulings and clinical notes). Results show that (1) as many as 80% of de-identified text spans can be successfully recovered and (2) the re-identification accuracy increases along with the level of background knowledge.

  • Open Access

    Re-identification of De-identified Documents with Autoregressive Infilling

    by Lucas Georges Gabriel Charpentier, Pierre Lison

    Lucas Georges Gabriel Charpentier, Pierre Lison. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025.


  • Open Access

    Evaluating the disclosure risk of anonymized documents via a machine learning-based re-identification attack

    by Benet Manzanares-Salor, David Sánchez, Pierre Lison

    The availability of textual data depicting human-centered features and behaviors is crucial for many data mining and machine learning tasks. However, data containing personal information should be anonymized prior making them available for secondary use. A variety of text anonymization methods have been proposed in the last years, which are standardly evaluated by comparing their outputs with human-based anonymizations. The residual disclosure risk is estimated with the recall metric, which quantifies the proportion of manually annotated re-identifying terms successfully detected by the anonymization algorithm. Nevertheless, recall is not a risk metric, which leads to several drawbacks. First, it requires a unique ground truth, and this does not hold for text anonymization, where several masking choices could be equally valid to prevent re-identification. Second, it relies on human judgements, which are inherently subjective and prone to errors. Finally, the recall metric weights terms uniformly, thereby ignoring the fact that the influence on the disclosure risk of some missed terms may be much larger than of others. To overcome these drawbacks, in this paper we propose a novel method to evaluate the disclosure risk of anonymized texts by means of an automated re-identification attack. We formalize the attack as a multi-class classification task and leverage state-of-the-art neural language models to aggregate the data sources that attackers may use to build the classifier. We illustrate the effectiveness of our method by assessing the disclosure risk of several methods for text anonymization under different attack configurations. Empirical results show substantial privacy risks for most existing anonymization methods.