Mundher Al-Shabi
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Mundher Al-Shabi has a total of 14 co-authors. Here are the top co-authors by number of shared publications:
Maxine Tan
Electrical and Computer Systems Engineering Discipline School of Engineering Monash University Malaysia Bandar Sunway 47500 Malaysia
3 shared publications- Kah Ong Michael Goh
Center for Image and Vision Computing, COE for Artificial Intelligence, Faculty of Information Science & Technology, Multimedia University, Melaka, Malaysia
2 shared publications Kelvin Shak
Electrical and Computer Systems Engineering Discipline School of Engineering Monash University Malaysia Bandar Sunway 47500 Malaysia
2 shared publications- Tee Connie
Faculty of Information Science and Technology, Multimedia University, Jalan Ayer Keroh Lama, Melaka 75450, Malaysia
2 shared publications - Ali Afzalian Mand
Multimedia University
1 shared publication Boon Leong Lan
Electrical and Computer Systems Engineering Discipline, School of Engineering, Monash University Malaysia, 47500, Bandar Sunway, Selangor, Malaysia
1 shared publication
Latest Publications
- Open Access
ProCAN: Progressive Growing Channel Attentive Non-Local Network for Lung Nodule Classification
Lung cancer classification in screening computed tomography (CT) scans is one of the most crucial tasks for early detection of this disease. Many lives can be saved if we are able to accurately classify malignant/cancerous lung nodules. Consequently, several deep learning based models have been proposed recently to classify lung nodules as malignant or benign. Nevertheless, the large variation in the size and heterogeneous appearance of the nodules makes this task an extremely challenging one. We propose a new Progressive Growing Channel Attentive Non-Local (ProCAN) network for lung nodule classification. The proposed method addresses this challenge from three different aspects. First, we enrich the Non-Local network by adding channel-wise attention capability to it. Second, we apply Curriculum Learning principles, whereby we first train our model on easy examples before hard ones. Third, as the classification task gets harder during the Curriculum learning, our model is progressively grown to increase its capability of handling the task at hand. We examined our proposed method on two different public datasets and compared its performance with state-of-the-art methods in the literature. The results show that the ProCAN model outperforms state-of-the-art methods and achieves an AUC of 98.05% and an accuracy of 95.28% on the LIDC-IDRI dataset. Moreover, we conducted extensive ablation studies to analyze the contribution and effects of each new component of our proposed method.
Open AccessProCAN: Progressive Growing Channel Attentive Non-Local Network for Lung Nodule Classification
Lung cancer classification in screening computed tomography (CT) scans is one of the most crucial tasks for early detection of this disease. Many lives can be saved if we are able to accurately classify malignant/cancerous lung nodules. Consequently, several deep learning based models have been proposed recently to classify lung nodules as malignant or benign. Nevertheless, the large variation in the size and heterogeneous appearance of the nodules makes this task an extremely challenging one. We propose a new Progressive Growing Channel Attentive Non-Local (ProCAN) network for lung nodule classification. The proposed method addresses this challenge from three different aspects. First, we enrich the Non-Local network by adding channel-wise attention capability to it. Second, we apply Curriculum Learning principles, whereby we first train our model on easy examples before hard ones. Third, as the classification task gets harder during the Curriculum learning, our model is progressively grown to increase its capability of handling the task at hand. We examined our proposed method on two different public datasets and compared its performance with state-of-the-art methods in the literature. The results show that the ProCAN model outperforms state-of-the-art methods and achieves an AUC of 98.05% and an accuracy of 95.28% on the LIDC-IDRI dataset. Moreover, we conducted extensive ablation studies to analyze the contribution and effects of each new component of our proposed method.
- 31 May 2021
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 16 (8) , 1319-1324
3D axial-attention for lung nodule classification
Purpose In recent years, Non-Local-based methods have been successfully applied to lung nodule classification. However, these methods offer 2D attention or limited 3D attention to low-resolution feature maps. Moreover, they still depend on a convenient local filter such as convolution as full 3D attention is expensive to compute and requires a big dataset, which might not be available. Methods We propose to use 3D Axial-Attention, which requires a fraction of the computing power of a regular Non-Local network (i.e., self-attention). Unlike a regular Non-Local network, the 3D Axial-Attention network applies the attention operation to each axis separately. Additionally, we solve the invariant position problem of the Non-Local network by proposing to add 3D positional encoding to shared embeddings. Results We validated the proposed method on 442 benign nodules and 406 malignant nodules, extracted from the public LIDC-IDRI dataset by following a rigorous experimental setup using only nodules annotated by at least three radiologists. Our results show that the 3D Axial-Attention model achieves state-of-the-art performance on all evaluation metrics, including AUC and Accuracy. Conclusions The proposed model provides full 3D attention, whereby every element (i.e., pixel) in the 3D volume space attends to every other element in the nodule effectively. Thus, the 3D Axial-Attention network can be used in all layers without the need for local filters. The experimental results show the importance of full 3D attention for classifying lung nodules.
- 31 May 2021
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 16 (8) , 1319-1324
3D axial-attention for lung nodule classification
Purpose In recent years, Non-Local-based methods have been successfully applied to lung nodule classification. However, these methods offer 2D attention or limited 3D attention to low-resolution feature maps. Moreover, they still depend on a convenient local filter such as convolution as full 3D attention is expensive to compute and requires a big dataset, which might not be available. Methods We propose to use 3D Axial-Attention, which requires a fraction of the computing power of a regular Non-Local network (i.e., self-attention). Unlike a regular Non-Local network, the 3D Axial-Attention network applies the attention operation to each axis separately. Additionally, we solve the invariant position problem of the Non-Local network by proposing to add 3D positional encoding to shared embeddings. Results We validated the proposed method on 442 benign nodules and 406 malignant nodules, extracted from the public LIDC-IDRI dataset by following a rigorous experimental setup using only nodules annotated by at least three radiologists. Our results show that the 3D Axial-Attention model achieves state-of-the-art performance on all evaluation metrics, including AUC and Accuracy. Conclusions The proposed model provides full 3D attention, whereby every element (i.e., pixel) in the 3D volume space attends to every other element in the nodule effectively. Thus, the 3D Axial-Attention network can be used in all layers without the need for local filters. The experimental results show the importance of full 3D attention for classifying lung nodules.
- Open Access
- 10 December 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 7, 178827-178838
Gated-Dilated Networks for Lung Nodule Classification in CT Scans
Different types of Convolutional Neural Networks (CNNs) have been applied to detect cancerous lung nodules from computed tomography (CT) scans. However, the size of a nodule is very diverse and can range anywhere between 3 and 30 millimeters. The high variation of nodule sizes makes classifying them a difficult and challenging task. In this study, we propose a novel CNN architecture called Gated-Dilated (GD) networks to classify nodules as malignant or benign. Unlike previous studies, the GD network uses multiple dilated convolutions instead of max-poolings to capture the scale variations. Moreover, the GD network has a Context-Aware sub-network that analyzes the input features and guides the features to a suitable dilated convolution. We evaluated the proposed network on more than 1,000 CT scans from the LIDC-LDRI dataset. Our proposed network outperforms state-of-the-art baseline models including Multi-Crop, Resnet, and Densenet, with an AUC of >0.95. Compared to the baseline models, the GD network improves the classification accuracies of mid-range sized nodules. Furthermore, we observe a relationship between the size of the nodule and the attention signal generated by the Context-Aware sub-network, which validates our new network architecture.
- 10 December 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 7, 178827-178838
Open AccessGated-Dilated Networks for Lung Nodule Classification in CT Scans
Different types of Convolutional Neural Networks (CNNs) have been applied to detect cancerous lung nodules from computed tomography (CT) scans. However, the size of a nodule is very diverse and can range anywhere between 3 and 30 millimeters. The high variation of nodule sizes makes classifying them a difficult and challenging task. In this study, we propose a novel CNN architecture called Gated-Dilated (GD) networks to classify nodules as malignant or benign. Unlike previous studies, the GD network uses multiple dilated convolutions instead of max-poolings to capture the scale variations. Moreover, the GD network has a Context-Aware sub-network that analyzes the input features and guides the features to a suitable dilated convolution. We evaluated the proposed network on more than 1,000 CT scans from the LIDC-LDRI dataset. Our proposed network outperforms state-of-the-art baseline models including Multi-Crop, Resnet, and Densenet, with an AUC of >0.95. Compared to the baseline models, the GD network improves the classification accuracies of mid-range sized nodules. Furthermore, we observe a relationship between the size of the nodule and the attention signal generated by the Context-Aware sub-network, which validates our new network architecture.
- 24 April 2019
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 14 (10) , 1815-1819
Lung nodule classification using deep Local–Global networks
Purpose Lung nodules have very diverse shapes and sizes, which makes classifying them as benign/malignant a challenging problem. In this paper, we propose a novel method to predict the malignancy of nodules that have the capability to analyze the shape and size of a nodule using a global feature extractor, as well as the density and structure of the nodule using a local feature extractor. Methods We propose to use Residual Blocks with a 3 × 3 kernel size for local feature extraction and Non-Local Blocks to extract the global features. The Non-Local Block has the ability to extract global features without using a huge number of parameters. The key idea behind the Non-Local Block is to apply matrix multiplications between features on the same feature maps. Results We trained and validated the proposed method on the LIDC-IDRI dataset which contains 1018 computed tomography scans. We followed a rigorous procedure for experimental setup, namely tenfold cross-validation, and ignored the nodules that had been annotated by < 3 radiologists. The proposed method achieved state-of-the-art results with AUC = 95.62%, while significantly outperforming other baseline methods. Conclusions Our proposed deep Local–Global network has the capability to accurately extract both local and global features. Our new method outperforms state-of-the-art architecture including Densenet and Resnet with transfer learning.
- 24 April 2019
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 14 (10) , 1815-1819
Lung nodule classification using deep Local–Global networks
Purpose Lung nodules have very diverse shapes and sizes, which makes classifying them as benign/malignant a challenging problem. In this paper, we propose a novel method to predict the malignancy of nodules that have the capability to analyze the shape and size of a nodule using a global feature extractor, as well as the density and structure of the nodule using a local feature extractor. Methods We propose to use Residual Blocks with a 3 × 3 kernel size for local feature extraction and Non-Local Blocks to extract the global features. The Non-Local Block has the ability to extract global features without using a huge number of parameters. The key idea behind the Non-Local Block is to apply matrix multiplications between features on the same feature maps. Results We trained and validated the proposed method on the LIDC-IDRI dataset which contains 1018 computed tomography scans. We followed a rigorous procedure for experimental setup, namely tenfold cross-validation, and ignored the nodules that had been annotated by < 3 radiologists. The proposed method achieved state-of-the-art results with AUC = 95.62%, while significantly outperforming other baseline methods. Conclusions Our proposed deep Local–Global network has the capability to accurately extract both local and global features. Our new method outperforms state-of-the-art architecture including Densenet and Resnet with transfer learning.
- 1 November 2017
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Classification of tuberculosis with SURF spatial pyramid features
Tuberculosis is threatening and hinders the socioeconomic development of countries burdened with TB cases. 75% of TB cases are documented in the productive age group of 15-54 years. The definitive diagnoses methods are timely expensive and lack sensitivity in recognizing all TB cases and in all stages. The development of CAD systems (Computer Aided Detection) will facilitate mass screening. In this work, we experimented the use of spatial pyramid of Speed-up Robust Features (SURF) in diagnosing TB. Though dense information representing the lung anatomy imply substantial generalization, the empirical results suggest otherwise. The SURF descriptors are extracted from a grid windows of several sizes and concatenated together. The SVM classifier with sigmoid kernel achieved AUC score of 89% in grid size of 64 pixels compared to only 73% in the concatenated spatial pyramid features.
- 1 November 2017
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Classification of tuberculosis with SURF spatial pyramid features
Tuberculosis is threatening and hinders the socioeconomic development of countries burdened with TB cases. 75% of TB cases are documented in the productive age group of 15-54 years. The definitive diagnoses methods are timely expensive and lack sensitivity in recognizing all TB cases and in all stages. The development of CAD systems (Computer Aided Detection) will facilitate mass screening. In this work, we experimented the use of spatial pyramid of Speed-up Robust Features (SURF) in diagnosing TB. Though dense information representing the lung anatomy imply substantial generalization, the empirical results suggest otherwise. The SURF descriptors are extracted from a grid windows of several sizes and concatenated together. The SVM classifier with sigmoid kernel achieved AUC score of 89% in grid size of 64 pixels compared to only 73% in the concatenated spatial pyramid features.
- 19 October 2017
- Published by Springer Nature
- p. 139-149
Facial Expression Recognition Using a Hybrid CNN–SIFT Aggregator
- 19 October 2017
- Published by Springer Nature
- p. 139-149
Facial Expression Recognition Using a Hybrid CNN–SIFT Aggregator
- 31 August 2017
- Published by Springer Nature
- p. 11-18
Smart Content Recognition from Images Using a Mixture of Convolutional Neural Networks
- 31 August 2017
- Published by Springer Nature
- p. 11-18
Smart Content Recognition from Images Using a Mixture of Convolutional Neural Networks