Flexible Metadata Harvesting for Ecology Using Large Language Models
Open Access
- 27 September 2025
- book chapter
- Published by Springer Nature
- p. 338-352
Abstract
Large, open datasets can accelerate ecological research, particularly by enabling researchers to develop new insights by reusing datasets from multiple sources. However, to find the most suitable datasets to combine and integrate, researchers must navigate diverse ecological and environmental data provider platforms with varying metadata availability and standards. To overcome this obstacle, we have developed a large language model (LLM)-based metadata harvester that flexibly extracts metadata from any dataset’s landing page, and converts these to a user-defined, unified format using existing metadata standards. We validate that our tool is able to extract both structured and unstructured metadata with equal accuracy, aided by our LLM post-processing protocol. Furthermore, we utilise LLMs to identify links between datasets, both by calculating embedding similarity and by unifying the formats of extracted metadata to enable rule-based processing. Our tool, which flexibly links the metadata of different datasets, can therefore be used for ontology creation or graph-based queries, for example, to find relevant ecological and environmental datasets in a virtual research environment.Keywords
All Related Versions
This publication has 26 references indexed in Scilit:
- Monitoring protected areas by integrating machine learning, remote sensing and citizen scienceEcological Solutions and Evidence, 2025
- The global human impact on biodiversityNature, 2025
- Generative AI as a tool to accelerate the field of ecologyNature Ecology & Evolution, 2025
- The potential for AI to revolutionize conservation: a horizon scanTrends in Ecology & Evolution, 2024
- Capabilities and Challenges of LLMs in Metadata Extraction from Scholarly Papers2024
- The benefits and struggles of FAIR data: the case of reusing plant phenotyping dataScientific Data, 2023
- Opportunities for big data in conservation and sustainabilityNature Communications, 2020
- Towards global data products of Essential Biodiversity Variables on species traitsNature Ecology & Evolution, 2018
- Navigating the unfolding open data landscape in ecology and evolutionNature Ecology & Evolution, 2018
- Fundamental Principals of Statistical Inference2018