Mark Hall
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Mark Hall has a total of 86 co-authors. Here are the top co-authors by number of shared publications:
- David Walsh
Edge Hill University
9 shared publications - Marijn Koolen
Royal Netherlands Academy of Arts and Sciences - Humanities Cluster, Netherlands
9 shared publications Paul Clough
University of Sheffield, Sheffield, United Kingdom
9 shared publications- Paul Clough
University of Sheffield, Sheffield, United Kingdom
7 shared publications - Mette Skov
Department of Communication and Psychology, Aalborg University, Aalborg, Denmark
6 shared publications - Eneko Agirre
HiTZ Center University of the Basque Country (UPV/EHU)
5 shared publications
Latest Publications
- Open Access
- 22 March 2026
- Published by Association for Computing Machinery (ACM)
- p. 162-171
Tip-of-the-Tongue Search in the Wild: Analyzing Human and LLM Performance and Success Factors on Complex Search Requests
Users often turn to online forums when searching for known books, movies, or games that they cannot identify through conventional search engines. These “tip-of-the tongue” requests present a unique challenge, appearing highly variable in formulation, context, and specificity. So far, these could mostly only be solved by other humans answering in forums. Generative AI is believed to help solve these specific questions. In this work, we manually annotated 150 requests each for books, games, and movies in the casual leisure domain to study the differences between solved and unsolved requests and identify factors that influence their difficulty. We compare human responses in forum threads with the performance of a Large Language Model (LLM) under similar conditions. Specifically, we investigate how the formulation of requests affects human and LLM success; how item properties impact LLM retrieval; how interaction and feedback within a thread shape human and LLM performance; and whether increasing the information provided to an LLM improves its chances of solving the request. Our findings offer new insights into what makes these known-item search problems easier or harder to solve. This study contributes to a better understanding of complex search behavior and the role of LLMs in helping with difficult casual-leisure information needs.
- 22 March 2026
- Published by Association for Computing Machinery (ACM)
- p. 162-171
Open AccessTip-of-the-Tongue Search in the Wild: Analyzing Human and LLM Performance and Success Factors on Complex Search Requests
Users often turn to online forums when searching for known books, movies, or games that they cannot identify through conventional search engines. These “tip-of-the tongue” requests present a unique challenge, appearing highly variable in formulation, context, and specificity. So far, these could mostly only be solved by other humans answering in forums. Generative AI is believed to help solve these specific questions. In this work, we manually annotated 150 requests each for books, games, and movies in the casual leisure domain to study the differences between solved and unsolved requests and identify factors that influence their difficulty. We compare human responses in forum threads with the performance of a Large Language Model (LLM) under similar conditions. Specifically, we investigate how the formulation of requests affects human and LLM success; how item properties impact LLM retrieval; how interaction and feedback within a thread shape human and LLM performance; and whether increasing the information provided to an LLM improves its chances of solving the request. Our findings offer new insights into what makes these known-item search problems easier or harder to solve. This study contributes to a better understanding of complex search behavior and the role of LLMs in helping with difficult casual-leisure information needs.
- Open Access
- 13 January 2026
- Published by Oxford University Press (OUP) in Digital Scholarship in the Humanities
- Vol. 41 (1) , 276-287
Topic counts and quality in topic models for historic corpora
Topic modelling methods enable the identification of potential topics within a corpus of historical texts; in particular, they enable the identification of latent topics that are not described just by a single word. Like so many computational methods for the automatic processing of historical text corpora, they come with a number of parameters with which the method can be tuned and adapted. Each change in the settings of any of these parameters will generate a new set of topics that will differ in larger or smaller ways and which may be qualitatively better or worse. One of the main parameters for tuning topic models is setting the number of topics to be generated. In this article, we present an analysis of the impact of the number of topics on the quality of topic models for two historical text corpora. Two manual evaluation approaches are combined with an automated evaluation metric, and based on the results, we propose a formalized process for choosing the final set of parameters for a topic model. The process ensures the quality of the final model, while minimizing the amount of manual evaluation work. The more structured process also allows for better documentation of the parameter choices and in that way enables better replicability of any research using topic models.
- 13 January 2026
- Published by Oxford University Press (OUP) in Digital Scholarship in the Humanities
- Vol. 41 (1) , 276-287
Open AccessTopic counts and quality in topic models for historic corpora
Topic modelling methods enable the identification of potential topics within a corpus of historical texts; in particular, they enable the identification of latent topics that are not described just by a single word. Like so many computational methods for the automatic processing of historical text corpora, they come with a number of parameters with which the method can be tuned and adapted. Each change in the settings of any of these parameters will generate a new set of topics that will differ in larger or smaller ways and which may be qualitatively better or worse. One of the main parameters for tuning topic models is setting the number of topics to be generated. In this article, we present an analysis of the impact of the number of topics on the quality of topic models for two historical text corpora. Two manual evaluation approaches are combined with an automated evaluation metric, and based on the results, we propose a formalized process for choosing the final set of parameters for a topic model. The process ensures the quality of the final model, while minimizing the amount of manual evaluation work. The more structured process also allows for better documentation of the parameter choices and in that way enables better replicability of any research using topic models.
- Open Access
- 24 March 2025
- Published by Association for Computing Machinery (ACM)
- p. 316-325
Exploring the Zero-Shot Known-Item Retrieval Capabilities of LLMs for Casual Leisure Information Needs
- 24 March 2025
- Published by Association for Computing Machinery (ACM)
- p. 316-325
Open AccessExploring the Zero-Shot Known-Item Retrieval Capabilities of LLMs for Casual Leisure Information Needs
- Open Access
- 10 March 2024
- Published by Association for Computing Machinery (ACM)
- p. 34-44
The Impact of CHIIR Publications: A Study of Eight Years of CHIIR
Across all scientific fields, there is an increased focus on the impact of scientific research: what academic and societal benefits does it provide? This question has spurred the development of a variety of different approaches to impact assessment, each appropriate in different circumstances. In this paper, we study the academic impact of the CHIIR community through a comprehensive analysis of the work published in the 2016-2023 CHIIR conference series. We collect citation counts, citing documents, and altmetrics scores for all CHIIR publications to determine their academic impact across a variety of different attributes of the CHIIR publications. In addition, we analyze a subset of citation contexts in the papers that have cited CHIIR publications to analyze how they are being used and what that means for their potential impact. Finally, we attempt to predict which properties of CHIIR publications are most predictive of future impact.
- 10 March 2024
- Published by Association for Computing Machinery (ACM)
- p. 34-44
Open AccessThe Impact of CHIIR Publications: A Study of Eight Years of CHIIR
Across all scientific fields, there is an increased focus on the impact of scientific research: what academic and societal benefits does it provide? This question has spurred the development of a variety of different approaches to impact assessment, each appropriate in different circumstances. In this paper, we study the academic impact of the CHIIR community through a comprehensive analysis of the work published in the 2016-2023 CHIIR conference series. We collect citation counts, citing documents, and altmetrics scores for all CHIIR publications to determine their academic impact across a variety of different attributes of the CHIIR publications. In addition, we analyze a subset of citation contexts in the papers that have cited CHIIR publications to analyze how they are being used and what that means for their potential impact. Finally, we attempt to predict which properties of CHIIR publications are most predictive of future impact.
- Open Access
- 19 March 2023
- Published by Association for Computing Machinery (ACM)
- p. 351-356
How we Work, Share, and Re-use at CHIIR
In this paper, we present the results of an initial study of the research, sharing, and re-use practices at the CHIIR conference through a systematic analysis of all CHIIR papers published from 2016 to 2022. We find that CHIIR is a conference predominantly focused on empirical, multi-methods research that over the years has undergone a focusing in terms of the type of research methods that are being used. A modest number of papers re-use existing data and design resources, but infrastructure component re-use is much more rare. Only a fraction of CHIIR papers actually share their own resources, which suggests that there is much to gain in terms of reproducibility of research presented at CHIIR and could potentially be used to support changes in reviewing practices.
- 19 March 2023
- Published by Association for Computing Machinery (ACM)
- p. 351-356
Open AccessHow we Work, Share, and Re-use at CHIIR
In this paper, we present the results of an initial study of the research, sharing, and re-use practices at the CHIIR conference through a systematic analysis of all CHIIR papers published from 2016 to 2022. We find that CHIIR is a conference predominantly focused on empirical, multi-methods research that over the years has undergone a focusing in terms of the type of research methods that are being used. A modest number of papers re-use existing data and design resources, but infrastructure component re-use is much more rare. Only a fraction of CHIIR papers actually share their own resources, which suggests that there is much to gain in terms of reproducibility of research presented at CHIIR and could potentially be used to support changes in reviewing practices.
- Open Access
- 19 March 2023
- Published by Association for Computing Machinery (ACM)
- p. 313-320
Collaboration Patterns and Impact of Sharing at CHIIR
We studied the collaboration patterns of CHIIR authors, and found that most papers are collaborative. A core of 33% of the CHIIR researchers are directly connected and frequently co-author, and several disconnected clusters also make frequent CHIIR contributions. We also studied citation impact of the CHIIR papers and show that in relation to research design type, theoretical and empirical papers tend to receive more citations than resource papers. With regards to sharing and re-use, papers that share at least one resource tend to have significantly higher citation impact—in particular when sharing data resources and design resources. Re-using resources does not significantly increase citation impact in itself.
- 19 March 2023
- Published by Association for Computing Machinery (ACM)
- p. 313-320
Open AccessCollaboration Patterns and Impact of Sharing at CHIIR
We studied the collaboration patterns of CHIIR authors, and found that most papers are collaborative. A core of 33% of the CHIIR researchers are directly connected and frequently co-author, and several disconnected clusters also make frequent CHIIR contributions. We also studied citation impact of the CHIIR papers and show that in relation to research design type, theoretical and empirical papers tend to receive more citations than resource papers. With regards to sharing and re-use, papers that share at least one resource tend to have significantly higher citation impact—in particular when sharing data resources and design resources. Re-using resources does not significantly increase citation impact in itself.
- 7 September 2021
- Published by Springer Nature
- p. 202-214
Clustering and Classifying Users from the National Museums Liverpool Website
- 7 September 2021
- Published by Springer Nature
- p. 202-214
Clustering and Classifying Users from the National Museums Liverpool Website
- 26 April 2021
- Published by Taylor & Francis in International Journal of Geographical Information Science
- Vol. 36 (1) , 55-85
Generating geographical location descriptions with spatial templates: a salient toponym driven approach
Natural language descriptions of geographical locations are used frequently in daily life and there is a motivation to create systems that generate such descriptions automatically, for purposes such as documentation of where events have taken place, where a person is located, where photos were taken and where plants and animals are located. Typically location descriptions combine references to named geographical features with vague spatial relational terms, such as near, north of and at that relate locations to the features. Here we describe a system for generating location descriptions, that combines spatial templates, that model the applicability of different spatial relations relative to a reference location, with toponyms in the vicinity of the described location that are selected according to aspects of salience. The toponyms are retrieved from a gazetteer service based on OpenStreetMap for which we create a hierarchical feature classification scheme to facilitate selection of toponyms according to distinctiveness of their feature types and other aspects of salience. The advantages of the approach are demonstrated in a user study, relative to an existing state of the art system and to other baseline approaches that include manually created captions and the automated methods of two widely used photo captioning systems.
- 26 April 2021
- Published by Taylor & Francis in International Journal of Geographical Information Science
- Vol. 36 (1) , 55-85
Generating geographical location descriptions with spatial templates: a salient toponym driven approach
Natural language descriptions of geographical locations are used frequently in daily life and there is a motivation to create systems that generate such descriptions automatically, for purposes such as documentation of where events have taken place, where a person is located, where photos were taken and where plants and animals are located. Typically location descriptions combine references to named geographical features with vague spatial relational terms, such as near, north of and at that relate locations to the features. Here we describe a system for generating location descriptions, that combines spatial templates, that model the applicability of different spatial relations relative to a reference location, with toponyms in the vicinity of the described location that are selected according to aspects of salience. The toponyms are retrieved from a gazetteer service based on OpenStreetMap for which we create a hierarchical feature classification scheme to facilitate selection of toponyms according to distinctiveness of their feature types and other aspects of salience. The advantages of the approach are demonstrated in a user study, relative to an existing state of the art system and to other baseline approaches that include manually created captions and the automated methods of two widely used photo captioning systems.
- 7 June 2020
- Published by Vandenhoeck & Ruprecht GmbH & Co, KG
- p. 47-66
Opportunities and Risks in Digital Humanities Research
- 7 June 2020
- Published by Vandenhoeck & Ruprecht GmbH & Co, KG
- p. 47-66
Opportunities and Risks in Digital Humanities Research
- Open Access
- 14 March 2020
- Published by Association for Computing Machinery (ACM)
- p. 457-461
A Standardised Format for Exchanging User Study Instruments
- 14 March 2020
- Published by Association for Computing Machinery (ACM)
- p. 457-461
Open AccessA Standardised Format for Exchanging User Study Instruments