Morphology-Aware Profiling of Highly Multiplexed Tissue Images using Variational Autoencoders
Authors:
- Gregory J BakerGBGregory J Baker
- Edward NovikovENEdward Novikov
- Shannon CoySCShannon Coy
- Yu-An ChenYCYu-An Chen
- Clemens B HugCHClemens B Hug
- Zergham AhmedZAZergham Ahmed
- Sebastián A Cajas OrdóñezSOSebastián A Cajas Ordóñez
- Siyu HuangSHSiyu Huang
- Clarence YappCYClarence Yapp
- Artem SokolovASArtem Sokolov
- Hanspeter PfisterHPHanspeter Pfister
- Sandro SantagataSSSandro Santagata
Preprint
Abstract
Spatial proteomics (highly multiplexed tissue imaging) provides unprecedented insight into the types, states, and spatial organization of cells within preserved tissue environments. To enable single-cell analysis, high-plex images are typically segmented using algorithms that assign marker signals to individual cells. However, conventional segmentation is often imprecise and susceptible to signal spillover between adjacent cells, interfering with accurate cell type identification. Segmentation-based methods also fail to capture the morphological detail that histopathologists rely on for disease diagnosis and staging. Here, we present a method that combines unsupervised, pixel-level machine learning using autoencoders with traditional segmentation to generate single-cell data that captures information on protein abundance, morphology, and local neighborhood in a manner analogous to human experts while overcoming signal spillover. We demonstrate the generality of this approach by applying it to CyCIF, Lunaphore COMET, and CODEX data, and show that it can learn histological features across multiple spatial scales.Keywords
Funding Information
- Ludwig Cancer Research
- The Mark Foundation for Cancer Research (ASPIRE Award)
- The David Liposarcoma Research Initiative
This publication has 46 references indexed in Scilit:
- What cannot be seen correctly in 2D visualizations of single-cell ‘omics data?Cell Systems, 2023
- Robust phenotyping of highly multiplexed tissue imaging data using pixel-level clusteringNature Communications, 2023
- CellSighter: a neural network to classify cells in highly multiplexed imagesNature Communications, 2023
- Multiplexed 3D atlas of state transitions and immune interaction in colorectal cancerCell, 2023
- K-means clustering algorithms: A comprehensive review, variants analysis, and advances in the era of big dataInformation Sciences, 2022
- Artificial intelligence and computational pathologyLaboratory Investigation, 2021
- Compensation of Signal Spillover in Suspension and Imaging Mass CytometryCell Systems, 2018
- Multiobjective evolutionary algorithms to identify highly autocorrelated areas: the case of spatial distribution in financially compromised farmsAnnals of Operations Research, 2011
- Self-organized formation of topologically correct feature mapsBiological Cybernetics, 1982
- A Rationale and Test for the Number of Factors in Factor AnalysisPsychometrika, 1965