SparkGIS: Efficient Comparison and Evaluation of Algorithm Results in Tissue Image Analysis Studies
Open Access
- 24 June 2016
- book chapter
- Published by Springer Nature
- Vol. 9579, 134-146
Abstract
Algorithm evaluation provides a means to characterize variability across image analysis algorithms, validate algorithms by comparison of multiple results, and facilitate algorithm sensitivity studies. The sizes of images and analysis results in pathology image analysis pose significant challenges in algorithm evaluation. We present SparkGIS, a distributed, in-memory spatial data processing framework to query, retrieve, and compare large volumes of analytical image result data for algorithm evaluation. Our approach combines the in-memory distributed processing capabilities of Apache Spark and the efficient spatial query processing of Hadoop-GIS. The experimental evaluation of SparkGIS for heatmap computations used to compare nucleus segmentation results from multiple images and analysis runs shows that SparkGIS is efficient and scalable, enabling algorithm evaluation and algorithm sensitivity studies on large datasets.Keywords
This publication has 15 references indexed in Scilit:
- SpatialHadoop2014
- Hadoop GISProceedings of the VLDB Endowment, 2013
- Hadoop-GIS: A High Performance Spatial Data Warehousing System over MapReduce2013
- Quantitative Image Analysis of Cellular Heterogeneity in Breast Tumors Complements Genomic ProfilingScience Translational Medicine, 2012
- Integrated morphologic analysis for the identification and characterization of disease subtypesJournal of the American Medical Informatics Association, 2012
- Systematic Analysis of Breast Cancer Morphology Uncovers Stromal Features Associated with SurvivalScience Translational Medicine, 2011
- Computational pathology: Challenges and promises for tissue analysisComputerized Medical Imaging and Graphics, 2011
- A comprehensive framework for classification of nuclei in digital microscopy imaging: An application to diffuse gliomas2011
- MapReduceCommunications of the ACM, 2008
- Measures of the Amount of Ecologic Association Between SpeciesEcology, 1945