Computer Vision for Recognition of Materials and Vessels in Chemistry Lab Settings and the Vector-LabPics Dataset
Preprint
- 20 April 2020
- preprint
- Published by American Chemical Society (ACS) in ChemRxiv
Abstract
This work presents a machine learning approach for computer vision-based recognition of materials inside vessels in a chemistry lab and other settings. In addition, we release a dataset associated with the training of the model for further model development. The task to learn is finding the region, boundaries, and category for each material phase and vessel in an image. Handling materials inside mostly transparent containers is the main activity performed by human and robotic chemists in the laboratory. Visual recognition of vessels and their content is essential for performing this task. Modern machine vision methods learn recognition tasks by using datasets containing a large number of annotated images. This work presents the Vector-LabPics dataset, which consists of 2187 images of materials within mostly transparent vessels in a chemistry lab and other general settings. The images are annotated for both the vessels and the individual material phases inside them, and each instance is assigned one or more classes (liquid, solid, foam, suspension, powder,...). The fill level, labels, corks, and parts of the vessel are also annotated. Several convolutional nets for semantic and instance segmentation were trained on this dataset. The trained neural networks achieved good accuracy in detecting and segmenting vessels and material phases, and in classifying liquids and solids, but relatively low accuracy in segmenting multiphase systems such as phase-separating liquids.Keywords
All Related Versions
- Published version: ACS Central Science, 6 (10), 1743.
This publication has 9 references indexed in Scilit:
- International evaluation of an AI system for breast cancer screeningNature, 2020
- AdaptIS: Adaptive Instance Selection Network2019
- A robotic platform for flow synthesis of organic compounds informed by AI planningScience, 2019
- A Visual Measurement of Water Content of Crude Oil Based on Image Grayscale Accumulated Value DifferenceSensors, 2019
- COCO-Stuff: Thing and Stuff Classes in Context2018
- Accelerated discovery of metallic glasses through iteration of machine learning and high-throughput experimentsScience Advances, 2018
- Perceiving and reasoning about liquids using fully convolutional networksThe International Journal of Robotics Research, 2017
- Microsoft COCO: Common Objects in Context2014
- Liquid-level measurement using a single digital cameraMeasurement, 2009