Essential Biodiversity Variables: extracting plant phenological data from specimen labels using machine learning
Authors:
- Maria Mora-CrossMMMaria Mora-Cross
- Adriana Morales-CarmiolAMAdriana Morales-Carmiol
- Te Chen-HuangTCTe Chen-Huang
- María Barquero-PérezMBMaría Barquero-Pérez
Open Access
- 23 August 2022
- journal article
- research article
- Published by Pensoft Publishers in Research Ideas and Outcomes
- Vol. 8, e86012
Abstract
Essential Biodiversity Variables (EBVs) make it possible to evaluate and monitor the state of biodiversity over time at different spatial scales. Its development is led by the Group on Earth Observations Biodiversity Observation Network (GEO BON) to harmonize, consolidate and standardize biodiversity data from varied biodiversity sources. This document presents a mechanism to obtain baseline data to feed the Species Traits Variable Phenology or other biodiversity indicators by extracting species characters and structure names from morphological descriptions of specimens and classifying such descriptions using machine learning (ML). A workflow that performs Named Entity Recognition (NER) and Classification of morphological descriptions using ML algorithms was evaluated with excellent results. It was implemented using Python, Pytorch, Scikit-Learn, Pomegranate, Python-crfsuite, and other libraries applied to 106,804 herbarium records from the National Biodiversity Institute of Costa Rica (INBio). The text classification results were almost excellent (F1 score between 96% and 99%) using three traditional ML methods: Multinomial Naive Bayes (NB), Linear Support Vector Classification (SVC), and Logistic Regression (LR). Furthermore, results extracting names of species morphological structures (e.g., leaves, trichomes, flowers, petals, sepals) and character names (e.g., length, width, pigmentation patterns, and smell) using NER algorithms were competitive (F1 score between 95% and 98%) using Hidden Markov Models (HMM), Conditional Random Fields (CRFs), and Bidirectional Long Short Term Memory Networks with CRF (BI-LSTM-CRF).Keywords
All Related Versions
This publication has 39 references indexed in Scilit:
- Essential Biodiversity VariablesScience, 2013
- NetiNeti: discovery of scientific names from text using machine learning methodsBMC Bioinformatics, 2012
- CharaParser for fine‐grained semantic annotation of organism morphological descriptionsJournal of the American Society for Information Science and Technology, 2012
- Nitin Indurkhya and Fred J. Damerau (eds): Handbook of Natural Language Processing (second edition)Machine Translation, 2011
- Natural Language Processing with Python Steven Bird, Ewan Klein, and Edward Loper (University of Melbourne, University of Edinburgh, and BBN Technologies) Sebastopol, CA: O'Reilly Media, 2009, xx+482 pp; paperbound, ISBN 978-0-596-51649-9, $44.99; on-line free of charge at nltk.org/bookComputational Linguistics, 2010
- LINNAEUS: A species name identification system for biomedical literatureBMC Bioinformatics, 2010
- Manning Christopher, Prabhakar Raghavan, Hinrich Schütze: Introduction to information retrievalInformation Retrieval Journal, 2009
- Text Chunking Using Transformation-Based Learning1999
- On the limited memory BFGS method for large scale optimizationMathematical Programming, 1989
- Statistical Inference for Probabilistic Functions of Finite State Markov ChainsThe Annals of Mathematical Statistics, 1966