BSBen Scott

Ben Scott

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Ben Scott has a total of 107 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    AI-Driven Solutions for Optimising Drawer Expansion and Storage Management of Entomology Collections

    by Qianqian Gu, Ben Scott, Geoff Martin, Arianna Salili-James, Laurence Livermore, Peter Wing, Vincent S. Smith

    The digitisation of natural history collections at scale raises a range of logistical and curatorial challenges. One concern is the physical expansion of storage infrastructure. As part of the Distributed System of Scientific Collections UK (Smith et al. 2022), the Natural History Museum London (NHM) will rehouse a significant proportion of its 36 million pinned entomological specimens (~130,000 drawers). Digitisation involves imaging every specimen and attaching a physical, unique, human- and machine-readable identifier (a small card label with a Data Matrix barcode). These barcodes must be readable from above, and their addition during digitisation can increase drawer occupancy if they exceed the existing footprint. Manual estimation of the footprint increase is impractical at this scale, given the range of circumstances associated with different specimens and drawers. To address this, the NHM has developed an AI-driven approach to estimate specimen drawer expansion and support resource planning. The deep learning pipeline can automatically detect drawer objects, referred to here as classes, including specimens, labels, barcodes, notes, unit trays, and drawers, from high-resolution images. Our dataset includes 11,090 digitised pinned Coleoptera drawers from the Index Lot collection (Natural History Museum 2014), representative of typical entomological collections. The AI pipeline supports both "pre-" and "post-" digitisation analysis by calculating the specimen bounding areas, handling overlaps, and estimating the net footprint change. Our object detection models achieved high performance under real-world conditions, with a mean average precision (mAP*1) of 85.45% across all classes. Barcode detection reached 86.63% mAP, while the standard unit tray detection and unit tray type classification model achieved 99.5% accuracy. (An example of the detection outputs is shown in Fig. 1) Three different calculation methods were tested and evaluated to estimate the drawer expansion area, corresponding to three specimen expansion rates for specimens with Data Matrix barcodes attached. Rate 1 (Per-Drawer Area via Polygon Masks*2): calculates expansion rates per drawer by measuring the total area occupied by specimens and their labels, ensuring overlaps are counted only once using polygon masks, as shown in Fig. 2. Rate 2 (Total-Based Expansion Rate): calculates expansion rates by averaging the occupancy areas of barcode-attached specimens across the entire dataset. Rate 3 (Per-Specimen Expansion Rate): averages the expansion rate per specimen using only bounding box*3 areas. Every specimen contributes equally, regardless of its size, to the final value. Rate 1 (Per-Drawer Area via Polygon Masks*2): calculates expansion rates per drawer by measuring the total area occupied by specimens and their labels, ensuring overlaps are counted only once using polygon masks, as shown in Fig. 2. Rate 2 (Total-Based Expansion Rate): calculates expansion rates by averaging the occupancy areas of barcode-attached specimens across the entire dataset. Rate 3 (Per-Specimen Expansion Rate): averages the expansion rate per specimen using only bounding box*3 areas. Every specimen contributes equally, regardless of its size, to the final value. Table 1 compares different expansion rates. Both per-drawer Rate 1 and per-specimen Rate 3 have confidence intervals. Fig. 3 and Fig. 4 show their distributions: Rate 1 is right-skewed, indicating modest area increases from overlap, while Rate 3 is bimodal*4, with a small peak near 0 (large specimens unchanged) and another around 0.3 (barcode additions on smaller specimens). The global total-based Rate 2 is the mean of the ratios without confidence intervals, providing a macro-level view. In addition to estimating drawer expansion and supporting budget planning, this tool has been designed in a modular fashion, allowing individual components to be used independently at different stages of the digitisation and curation workflow. For example, specific models can be used to flag missing labels or barcodes during digitisation, assist in tracking specimen relocation, and support downstream re-curation decisions. Importantly, the pipeline is designed to be reusable across other entomological collections, with all code to be made openly available alongside a forthcoming publication, promoting scalability within the community. Our findings demonstrate that automated spatial analysis not only improves accuracy and speed in collection management but also lays the groundwork for predictive infrastructure modelling across large-scale digitisation efforts.

  • Open Access

    Accelerating Pinned Insect Specimen Digitization: A Deep Learning Pipeline for Future Collaborative Robots

    by Naifeng Zhang, Arianna Salili‐James, Sanson T. S. Poon, Jack D. Hollister, Ben Scott

    The Natural History Museum, UK (NHM), is at the forefront of digitizing vast natural history collections, with over six million of its 80 million specimens already digitized. Extensive, high‐quality, digital specimen datasets are crucial for the integration, and analysis of biological information, providing global accessibility and digital preservation. However, at current rates, it could take centuries to digitize entire collections. To accelerate this, researchers at NHM are exploring the use of collaborative robots (cobots) for digitization. Here, the focus is on the development of artificial intelligence (AI) pipelines for the digitization of one of the largest NHM collections: pinned insects. Aa proof‐of‐concept workflow is presented that leverages AI to assist in precise identification, handling, and digitization of insect specimens and labels. The pipeline is designed to be adaptable across different museum specimen datasets, and to one day integrate seamlessly with the newly introduced cobot at NHM. Experimental results achieved accuracies of 0.95 for specimen identification, 0.79 for pinheads, and 0.92 for specimen labels, in independent image and video test sets. These results demonstrate the potential of this workflow in accelerating digitization efforts whilst prototyping novel cobot‐integrated digitization systems and advancing the biodiversity informatics for data creation and accessibility.


  • Open Access

    Cobots at the Museum: The Role of Robotics in Digitisation

    by Ben Scott, Arianna Salili-James, Naifeng Zhang, Sanson Poon, Vincent Smith

    In the last decade, the Natural History Museum, UK (NHM), has been at the forefront of the digitisation of natural history collections, with almost six million of its 80 million specimens digitised. This momentous undertaking has led to numerous innovations on how to optimise digitisation workflows. One avenue that is currently being explored is the use of collaborative robots—cobots. Since acquiring a Techman TM5 900 robotic arm in 2023 (Scott et al. 2023), we have been experimenting with its capabilities. Experiments began with simple pick-and-place tasks, using artificial specimens. Next, we focused on two use-cases, based on the digitisation of shark teeth and pinned-insects. Both shark teeth and pinned insects are in abundance at the NHM, making their manual digitisation a tedious task. Currently, we have trained the cobot to pick up a specimen, move it elsewhere to photograph and scan the specimen, then move it back to its original position or to a new place. Thus far, this has all been coordinate-based. Focusing on pinned insect specimens, we have now begun training deep learning models to perform segmentation, classification, and tracking tasks on images and manually taken videos. Segmentation and classification tasks range from distinguishing specimens from one another within drawers, to classifying different pins, labels, and insects. Meanwhile, object tracking methods are utilised to track labels from videos taken around the specimen. By tracking different labels simultaneously from multiple frames, we can combine the views of the labels in order to obtain a full picture for each label (for example, using tools described in Salili-James et al. 2022). Thus far, our machine learning pipelines have proved successful, for example, with F1 scores of 96–98% to classify and segment insects and to locate pin heads from dorsal views. Soon, we will be establishing workflows that integrate computer vision (CV) and machine learning (ML) techniques directly with the robotic arm, with pipelines that could be applied to different datasets, and that can significantly enhance efficiency. Broadly, these pipelines can be split into four sections: Specimen Identification: CV/ML to locate individual specimens or certain parts of specimens e.g., pinheads within pinned insects. Handling: With custom grippers, the cobot can delicately pick up, move, and place specimens, to and from photography stations for high quality scanning. Imaging & Scanning: The cobot will scan and photograph specimens. As the camera moves around the specimen, ML is used to segment and track the specimen labels to image them from the optimal views. A built-in Optical Character Recognition process can also be integrated to perform automatic transcription from here. Identifiers: This step requires the cobot to attach identifier labels to specimens or drawers, after locating the optimal position to do this, using CV/ML. Specimen Identification: CV/ML to locate individual specimens or certain parts of specimens e.g., pinheads within pinned insects. Handling: With custom grippers, the cobot can delicately pick up, move, and place specimens, to and from photography stations for high quality scanning. Imaging & Scanning: The cobot will scan and photograph specimens. As the camera moves around the specimen, ML is used to segment and track the specimen labels to image them from the optimal views. A built-in Optical Character Recognition process can also be integrated to perform automatic transcription from here. Identifiers: This step requires the cobot to attach identifier labels to specimens or drawers, after locating the optimal position to do this, using CV/ML. In this talk, we will discuss the progress of the NHM’s cobot research and explore the future of robotics for the digitisation of natural history collections.

  • Open Access

    Automatic Detection and Identification of Calcareous Nannofossils in Chalk Using Deep Learning: A Proof-of-Concept Study for Biostratigraphy and Climate Research

    by Sanson Poon, Avellina Leong, Thomas Fogerty, Richard Twitchett, Arianna Salili-James, Stephen Stukins, Ben Scott, Vincent Smith

    Calcareous nannofossils serve as crucial indicators for establishing the biostratigraphic age of chalk macrofossil specimens in natural science collections. Better age control of specimens collected several hundred years ago enables us to uncover the dark data hidden within these collections and incorporate these data into current research projects, examining ecosystem response to past climate change. However, the manual identification of these microscopic organisms is laborious and subjective, and so we are harnessing deep learning techniques for automatic nannofossil detection and identification. This approach required the construction of a robust dataset, currently comprising over 100,000 labelled images, complemented by the development of multiple specialised deep learning models. While some models focus on detecting target species, others are dedicated to species classification. Evaluation on an independent test set showcases the efficacy of our methodology, with the current detection model achieving a balanced accuracy of 93%. Similarly, the classification model demonstrates robust performance, attaining an average balanced accuracy of 96%. Furthermore, as well as assisting with our biostratigraphic studies, the dataset of accurately labelled images has enabled us to test other aspects of ecosystem response. For example, examining morphometric changes in nannofossils over geological time can provide valuable insights into the potential impact of current global warming on modern phytoplankton assemblages (Mancini et al. 2021). This is particularly important for coccolithophores (Young et al. 2005), which play a critical role as primary producers in the global carbon cycle. A decrease in their size could lead to bottom-up ecosystem impacts and reduced carbon sequestration (Poulton et al. 2007, Krumhardt et al. 2017). Using our dataset, we conducted a deep-learning-enhanced automatic morphometric analysis focusing on the nannofossil species, Tranolithus orionatus. Our analysis revealed that two key morphometric parameters, minor axis and area size, showed statistically significant differences between the Cenomanian stage (approximately 100.5 to 93.9 million years ago) and the post-Cenomanian stages of the Late Cretaceous (approximately 93.9 to 66.0 million years ago). Kolmogorov-Smirnov tests (Massey 1951) between the two samples yielded p-values of 0.039 for the minor axis and 0.031 for the area size. Understanding these morphometric changes is crucial due to the close parallels between current climate projections and the warming and greenhouse climate of the Late Cretaceous, particularly the Cenomanian-Turonian boundary event (Arthur et al. 1990). Insights into how organisms changed morphologically during past periods of environmental stress can help us more effectively predict future responses of organisms under similar conditions (Razmjooei et al. 2020). These findings underscore the effectiveness of our approach in automating the identification and recognition of chalk nannofossils, helping to unlock natural science collections and to address key questions related to marine response to past climate change.


  • Open Access

    Unscrambling the Eggs: Automated Data Extraction from Structured Record Cards

    by Arianna Salili-James, Ben Scott, Douglas Russell, Ken Norris, Sanson Poon, Vincent Smith

    The Natural History Museum in the UK (NHM) is home to more than 80 million objects spanning 4.5 billion years of history. Each of these contain a wealth of data, whether on specimen labels, index cards, registers and/or diaries. Transcribing and categorising this information can help unlock crucial research potential. To do this at scale, we turn to computer vision (CV) and Machine Learning (ML) techniques to automate this work. Over a million of the museum’s specimens are ornithological, including one of the largest and most comprehensive egg collections in the world. Representing 52% of known bird species, with over 300,000 clutches (where a clutch defines the total group of eggs laid in a nest), collected over the last 200 years, arguably make this the most important archive of avian environmental change data in existence(Norris et al. 2023). The eggs were historically catalogued using index cards, containing key information such as identification, collection date, locality and clutch size. A proportion of these egg cards have now been imaged and this led to the start of this project, focusing on a sample of 15,000 photographed egg cards (example seen in Fig. 1). Our initial approach used Google Vision to perform Optical Character Recognition (OCR) to transcribe all text with the egg cards. By focusing on textboxes around key terms (e.g., “Collector”), and using CV tools, we approximated boxes around every key category. Finally, each text segment was associated to a category box, followed by minor post-processing in order to extract (i.e., transcribe and categorise) the data. Here we successfully extracted the data within the sample, with a 98.6% average accuracy. Although our methods worked well for our sample, they did rely on consistency within the structures of cards. To expand the project further, and to mitigate the reliance on consistent structures within cards, we turned to Large Language Models (LLMs). This allowed us to explore automatic data extraction from different types of cards and labels, despite variation in the card structure, and even handle unknown categories of text. Consequently, the scope of the data collected was widened, such as adding ornithological specimen data (e.g., skins), as well as external datasets through collaboration with the British Trust for Ornithology, who manage the Nest Record Scheme (Crick et al. 2003), which holds decades of vital information on the progress of monitored nests in the UK. This index-card data-extraction project is just the beginning. As we expand our data extraction capabilities, our aim is to develop a novel pipeline that can be applied not just to avifauna-related cards, but any structured textual data, with the potential to unlock invaluable insights.


  • Open Access

    Accelerating Museum AI Research and Application at the UK Natural History Museum: The NHM AI Lab Programme

    by Sanson Poon, Ben Scott, Arianna Salili-James, Vincent Smith

    The United Kingdom's Natural History Museum (NHM) AI Lab Programme represents a pioneering initiative aimed at harnessing the power of artificial intelligence (AI) to bridge the gap between the museum's extensive collection and cutting-edge AI technologies. Despite its immense potential, the application of AI in museum research remains nascent (e.g., He et al. 2024), with some individual research groups pursuing independent projects without cohesive collaboration with AI experts who know or have experience in similar endeavours. Moreover, differing standards in utilising AI among researchers add complexity to the field. The NHM AI Lab Programme addresses these challenges by co-creating AI pilot projects that bring together the NHM's collection, academic researchers, and AI experts. The NHM AI Lab Programme serves as a nexus for interdisciplinary collaboration, offering expertise in AI, machine learning, data science, and software engineering to support NHM researchers. Through one-to-one consultations and collaborative research projects, the NHM AI Lab Programme facilitates the integration of innovative AI-driven technologies into streamlining digitisation workflows and enhancing Earth and Life Science research at the NHM. In less than a year since its inception, our Programme has achieved several milestones, hosting around 20 diverse projects. These include research projects such as the application of AI for the automatic detection and identification of nannofossils in chalk, the classification of ancient shark and dinosaur teeth, the prediction of mammal disease outbreaks, and the extraction of data from historical bird egg records. Additional projects focus on the automation of mineral analysis and the detection of secondary impact craters on planetary surfaces using AI. Some led to journal publications (e.g., He et al. 2024), while others streamlined NHM researchers' workflows, enhancing their processes of research and digitisation. Moreover, several initiatives have paved the way for new funding streams and collaborative ventures, as well as promising commercial prospects. Certain projects have pioneered the creation or transformation of datasets to meet AI-ready standards, such as data quality, consistency, accessibility, usability, and data governance protocols, helping to embed AI practices into NHM research. This AI Lab Programme can act as a model for other institutions addressing a similar challenge of bridging the gap between AI and their research and collections. This presentation provides insights into the establishment and operation of the NHM AI Lab Programme, shares experiences, highlights successful collaborations, discusses challenges encountered, and outlines future directions.


  • Open Access

    Open Information and Exceptions Policy of the Natural History Museum, London

    by Matt Woodburn, Laurence Livermore, Esme Chapman, Ruth Benny, Nancy Chillingworth, Polly Parry, Ben Scott, Vincent Smith, Helen Hardy

    There have been few, if any, open data and information management policies openly published from natural science collections. This paper contextualises the rationale for publishing the Open Information and Exceptions Policy of the Natural History Museum, London and provides the policy itself. The policy outlines how the Natural History Museum puts the principle of 'open by default' into practice; and includes sections on purpose and scope, relationship to relevant legislation (which always takes precedence over the policy), the categories of possible exceptions to open information release, what happens when exceptions are declared, relations to UK government information security classifications and definition of terms.

  • Open Access

    DiSSCo Transition Abridged Grant Proposal

    by Dimitrios Koureas, Laurence Livermore, Wouter Addink, Eva Alonso, Jose Alonso, Ana Casino, François Dusoulier, Vânia Ferreira, Jonas Grieb, Quentin Groom, et al.

    The Distributed System of Scientific Collections (DiSSCo) is a pan-European Research Infrastructure (RI) initiative. DiSSCo aims to bring together natural science collections from 175 museums, botanical gardens, universities and research institutes across 23 countries in a distributed infrastructure that makes these collections physically and digitally open and accessible for all forms of research and innovation. DiSSCo RI entered the ESFRI roadmap in 2018 and successfully concluded its Preparatory Phase in early 2023. The RI is now transitioning towards the constitution of its legal entity (an ERIC) and the start of its scaled-up construction (implementation) programme. This publication is an abridged version of the successful grant proposal for the DiSSCo Transition Project which has the goal of ensuring the seamless transition of the DiSSCo RI from its Preparatory Phase to the Construction Phase (expected to start in 2025). In this transition period, the Project will address five objectives building on the outcomes of the Preparatory Phase project: 1) Advance the DiSSCo ERIC process and complete its policy framework, ensuring the smooth early-phase Implementation of DISSCo; 2) Engage & support DiSSCo National Nodes to strengthen national commitments; 3) Advance the development of core e-services to avoid the accumulation of technical debt before the start of the Implementation Phase; 4) Continue international collaboration on standards & best practices needed for the DiSSCo service provision; and 5) Continue supporting DiSSCo RI interim governance bodies and transition them to the DiSSCo ERIC formal governance. The Project’s impact will be measured against the increase in the RI's overall Implementation Readiness Level (IRL). More specifically, we will monitor its impact towards reaching the required level of maturity in four of the five dimensions of the IRL that can benefit from further developments. These include the organisational, financial, technological and data readiness levels.


  • Open Access

    Envisaging a global infrastructure to exploit the potential of digitised collections

    by Quentin Groom, Mathias Dillen, Wouter Addink, Arturo H. Ariño, Christian Bölling, Pierre Bonnet, Lorenzo Cecchi, Elizabeth R. Ellwood, Rui Figueira, Pierre-Yves Gagnier, et al.

    Tens of millions of images from biological collections have become available online over the last two decades. In parallel, there has been a dramatic increase in the capabilities of image analysis technologies, especially those involving machine learning and computer vision. While image analysis has become mainstream in consumer applications, it is still used only on an artisanal basis in the biological collections community, largely because the image corpora are dispersed. Yet, there is massive untapped potential for novel applications and research if images of collection objects could be made accessible in a single corpus. In this paper, we make the case for infrastructure that could support image analysis of collection objects. We show that such infrastructure is entirely feasible and well worth investing in.


  • Open Access

    Robot-in-the-loop: Prototyping robotic digitisation at the Natural History Museum

    by Ben Scott, Arianna Salili-James, Vincent Smith

    The Natural History Museum, London (NHM) is home to an impressive collection of over 80 million specimens, of which just 5.5 million have been digitised. Like all similar collections, digitisation of these specimens is very labour intensive, requiring time-consuming manual handling. Each specimen is extracted from its curatorial unit, placed for imaging, labels are manually manipulated, and then returned to storage. Thanks to the NHM’s team of digitisers, workflows are becoming more efficient as they are refined. However, many of these workflows are highly repetitive and ideally suited to automation. The museum is now exploring integrating robots into the digitisation process. The NHM has purchased a Techman TM5 900 robotic arm, equipped with integrated Artificial Intelligence (AI) software and additional features such as custom grippers and a 3D scanner. This robotic arm combines advanced imaging technologies, machine learning algorithms, and robotic manipulation capabilities to capture high-quality specimen data, making it possible to digitise vast collections efficiently (Fig. 1). We showcase the NHM's application of robotics for digitisation, outlining the use cases developed for implementation and the prototypical workflows already in place at the museum. We will explore our invasive and non-invasive digitisation experiments, the many challenges, and the initial results of our early experiments with this transformative technology.