TCIA: A Transformer-CNN Model With Illumination Adaptation for Enhancing Cell Image Saliency and Contrast
- 9 January 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 74 (00189456) , 1-15
Abstract
Inconsistent illumination across imaging instruments poses significant challenges for accurate cell detection and analysis. Conventional methods (e.g. histogram equalization and basic filtering) struggle to adapt to complex lighting conditions, resulting in limited image enhancement and inconsistent performance. To address these issues, we propose the Transformer-CNN Illumination Adaptation (TCIA) model, which improves cell image saliency and contrast. By extracting Illumination Invariant Features (IIF) using a locally sensitive histogram as prior knowledge, our model effectively adapts to varying illumination conditions. The TCIA framework employs Hybrid Convolution Blocks (HCB) to extract and preserve essential features from image pairs, followed by a two-branch decomposition-fusion network that separates features into low-frequency and high-frequency components. The Lite-Transformer (LT) captures global context for low-frequency features, while the Circular Difference Invertible (CDI) module focuses on fine-grained textures and edges. These features are then fused and reconstructed to produce high-contrast, salient images. Extensive experiments on three datasets (MoNuSeg, MoNuSAC, and our contributed MTGC) demonstrate that TCIA outperforms existing methods in image fusion and cell detection, achieving an average improvement in detection accuracy 2%. This work provides a robust and innovative solution for enhanced cell imaging, contributing to more precise diagnostics and analysis. The source code will be available at https://github.com/Mrzhans/TCIA.Keywords
Funding Information
- Key Areas Research and Development Program of Guangzhou (2023B01J0029)
- Science and technology research in key areas in Foshan (2020001006832)
- guangdong provincial key laboratory of cyber-physical system (2020B1212060069)
- National Natural Science Foundation of China (U21A20478)
- Guangdong Basic Applied Basic Research Foundation (2023A1515012534)
- Guangdong Basic Applied Basic Research Foundation (2021A1515110503)
- Science and Technology Program of Guangzhou (202201020359)
- China Postdoctoral Science Foundation (2020M682665)
- Science and Technology Development Fund of Macau, SAR (0141/2023/RIA2)
- Science and Technology Development Fund of Macau, SAR (0193/2023/RIA3)
This publication has 54 references indexed in Scilit:
- MedPrompt: Cross-modal Prompting for Multi-task Medical Image Translation2024
- CircleFormer: Circular Nuclei Detection in Whole Slide Images with Circle Queries and Attention2023
- A novel cell image fusion approach based on the collaboration of multilevel latent Low-Rank representation and the convolutional neural networkBiomedical Signal Processing and Control, 2023
- An efficient biomedical cell image fusion method based on the multilevel low rank representationInternational Journal of Information Technology, 2022
- MFIF-GAN: A new generative adversarial network for multi-focus image fusionSignal Processing: Image Communication, 2021
- Low illumination color image enhancement based on Gabor filtering and Retinex theoryMultimedia Tools and Applications, 2021
- MFF-GAN: An unsupervised generative adversarial network with adaptive and gradient joint constraints for multi-focus image fusionInformation Fusion, 2021
- CircleNet: Anchor-Free Glomerulus Detection with Circle Representation2020
- IFCNN: A general image fusion framework based on convolutional neural networkInformation Fusion, 2020
- A new image quality metric for image fusion: The sum of the correlations of differencesAEU - International Journal of Electronics and Communications, 2015