Hamad Ahmed
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Hamad Ahmed has a total of 10 co-authors. Here are the top co-authors by number of shared publications:
- Ronnie B. Wilbur
Department of Linguistics, Purdue University, West Lafayette, IN, United States
4 shared publications - Hari M. Bharadwaj
Department of Communication Science and Disorders, University of Pittsburgh, Pittsburgh, PA, USA
3 shared publications - Jeffrey Mark Siskind
Elmore Family School of Electrical and Computer Engineering, Purdue University, West Lafayette, IN, USA
3 shared publications - Jared Sigurd Johansen
Purdue University, School of Electrical and Computer Engineering
2 shared publications - Thomas Victor Ilyevsky
Purdue University, School of Electrical and Computer Engineering
2 shared publications - Hari M Bharadwaj
Purdue University 47907-2035 West Lafayette IN USA
1 shared publication
Latest Publications
- Open Access
- 7 November 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 44 (12) , 9217-9220
Confounds in the Data—Comments on “Decoding Brain Representations by Multimodal Learning of Neural Activity and Visual Features”
Neuroimaging experiments in general, and EEG experiments in particular, must take care to avoid confounds. A recent TPAMI paper uses data that suffers from a serious previously reported confound. We demonstrate that their new model and analysis methods do not remedy this confound, and therefore that their claims of high accuracy and neuroscience relevance are invalid.
- 7 November 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 44 (12) , 9217-9220
Open AccessConfounds in the Data—Comments on “Decoding Brain Representations by Multimodal Learning of Neural Activity and Visual Features”
Neuroimaging experiments in general, and EEG experiments in particular, must take care to avoid confounds. A recent TPAMI paper uses data that suffers from a serious previously reported confound. We demonstrate that their new model and analysis methods do not remedy this confound, and therefore that their claims of high accuracy and neuroscience relevance are invalid.
- Open Access
- 19 November 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. PP (01628828) , 1
The Perils and Pitfalls of Block Design for EEG Classification Experiments
A recent paper [31] claims to classify brain processing evoked in subjects watching ImageNet stimuli as measured with EEG and to employ a representation derived from this processing to construct a novel object classifier. That paper, together with a series of subsequent papers [11, 18, 20, 24, 25, 30, 34], claims to achieve successful results on a wide variety of computer-vision tasks, including object classification, transfer learning, and generation of images depicting human perception and thought using brain-derived representations measured through EEG. Our novel experiments and analyses demonstrate that their results crucially depend on the block design that they employ, where all stimuli of a given class are presented together, and fail with a rapid-event design, where stimuli of different classes are randomly intermixed. The block design leads to classification of arbitrary brain states based on block-level temporal correlations that are known to exist in all EEG data, rather than stimulus-related activity. Because every trial in their test sets comes from the same block as many trials in the corresponding training sets, their block design thus leads to classifying arbitrary temporal artifacts of the data instead of stimulus-related activity. This invalidates all subsequent analyses performed on this data in multiple published papers and calls into question all of the reported results. We further show that a novel object classifier constructed with a random codebook performs as well as or better than a novel object classifier constructed with the representation extracted from EEG data, suggesting that the performance of their classifier constructed with a representation extracted from EEG data does not benefit from the brain-derived representation. Together, our results illustrate the far-reaching implications of the temporal autocorrelations that exist in all neuroimaging data for classification experiments. Further, our results calibrate the underlying difficulty of the tasks involved and caution against overly optimistic, but incorrect, claims to the contrary.
- 19 November 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. PP (01628828) , 1
Open AccessThe Perils and Pitfalls of Block Design for EEG Classification Experiments
A recent paper [31] claims to classify brain processing evoked in subjects watching ImageNet stimuli as measured with EEG and to employ a representation derived from this processing to construct a novel object classifier. That paper, together with a series of subsequent papers [11, 18, 20, 24, 25, 30, 34], claims to achieve successful results on a wide variety of computer-vision tasks, including object classification, transfer learning, and generation of images depicting human perception and thought using brain-derived representations measured through EEG. Our novel experiments and analyses demonstrate that their results crucially depend on the block design that they employ, where all stimuli of a given class are presented together, and fail with a rapid-event design, where stimuli of different classes are randomly intermixed. The block design leads to classification of arbitrary brain states based on block-level temporal correlations that are known to exist in all EEG data, rather than stimulus-related activity. Because every trial in their test sets comes from the same block as many trials in the corresponding training sets, their block design thus leads to classifying arbitrary temporal artifacts of the data instead of stimulus-related activity. This invalidates all subsequent analyses performed on this data in multiple published papers and calls into question all of the reported results. We further show that a novel object classifier constructed with a random codebook performs as well as or better than a novel object classifier constructed with the representation extracted from EEG data, suggesting that the performance of their classifier constructed with a representation extracted from EEG data does not benefit from the brain-derived representation. Together, our results illustrate the far-reaching implications of the temporal autocorrelations that exist in all neuroimaging data for classification experiments. Further, our results calibrate the underlying difficulty of the tasks involved and caution against overly optimistic, but incorrect, claims to the contrary.
- Open Access
Object classification from randomized EEG trials
New results suggest strong limits to the feasibility of classifying human brain activity evoked from image stimuli, as measured through EEG. Considerable prior work suffers from a confound between the stimulus class and the time since the start of the experiment. A prior attempt to avoid this confound using randomized trials was unable to achieve results above chance in a statistically significant fashion when the data sets were of the same size as the original experiments. Here, we again attempt to replicate these experiments with randomized trials on a far larger (20x) dataset of 1,000 stimulus presentations of each of forty classes, all from a single subject. To our knowledge, this is the largest such EEG data collection effort from a single subject and is at the bounds of feasibility. We obtain classification accuracy that is marginally above chance and above chance in a statistically significant fashion, and further assess how accuracy depends on the classifier used, the amount of training data used, and the number of classes. Reaching the limits of data collection without substantial improvement in classification accuracy suggests limits to the feasibility of this enterprise.
Open AccessObject classification from randomized EEG trials
New results suggest strong limits to the feasibility of classifying human brain activity evoked from image stimuli, as measured through EEG. Considerable prior work suffers from a confound between the stimulus class and the time since the start of the experiment. A prior attempt to avoid this confound using randomized trials was unable to achieve results above chance in a statistically significant fashion when the data sets were of the same size as the original experiments. Here, we again attempt to replicate these experiments with randomized trials on a far larger (20x) dataset of 1,000 stimulus presentations of each of forty classes, all from a single subject. To our knowledge, this is the largest such EEG data collection effort from a single subject and is at the bounds of feasibility. We obtain classification accuracy that is marginally above chance and above chance in a statistically significant fashion, and further assess how accuracy depends on the classifier used, the amount of training data used, and the number of classes. Reaching the limits of data collection without substantial improvement in classification accuracy suggests limits to the feasibility of this enterprise.
- Open Access
Training on the test set? An analysis of Spampinato et al. [31]
A recent paper [31] claims to classify brain processing evoked in subjects watching ImageNet stimuli as measured with EEG and to use a representation derived from this processing to create a novel object classifier. That paper, together with a series of subsequent papers [8, 15, 17, 20, 21, 30, 35], claims to revolutionize the field by achieving extremely successful results on several computer-vision tasks, including object classification, transfer learning, and generation of images depicting human perception and thought using brain-derived representations measured through EEG. Our novel experiments and analyses demonstrate that their results crucially depend on the block design that they use, where all stimuli of a given class are presented together, and fail with a rapid-event design, where stimuli of different classes are randomly intermixed. The block design leads to classification of arbitrary brain states based on block-level temporal correlations that tend to exist in all EEG data, rather than stimulus-related activity. Because every trial in their test sets comes from the same block as many trials in the corresponding training sets, their block design thus leads to surreptitiously training on the test set. This invalidates all subsequent analyses performed on this data in multiple published papers and calls into question all of the purported results. We further show that a novel object classifier constructed with a random codebook performs as well as or better than a novel object classifier constructed with the representation extracted from EEG data, suggesting that the performance of their classifier constructed with a representation extracted from EEG data does not benefit at all from the brain-derived representation. Our results calibrate the underlying difficulty of the tasks involved and caution against sensational and overly optimistic, but false, claims to the contrary.
Open AccessTraining on the test set? An analysis of Spampinato et al. [31]
A recent paper [31] claims to classify brain processing evoked in subjects watching ImageNet stimuli as measured with EEG and to use a representation derived from this processing to create a novel object classifier. That paper, together with a series of subsequent papers [8, 15, 17, 20, 21, 30, 35], claims to revolutionize the field by achieving extremely successful results on several computer-vision tasks, including object classification, transfer learning, and generation of images depicting human perception and thought using brain-derived representations measured through EEG. Our novel experiments and analyses demonstrate that their results crucially depend on the block design that they use, where all stimuli of a given class are presented together, and fail with a rapid-event design, where stimuli of different classes are randomly intermixed. The block design leads to classification of arbitrary brain states based on block-level temporal correlations that tend to exist in all EEG data, rather than stimulus-related activity. Because every trial in their test sets comes from the same block as many trials in the corresponding training sets, their block design thus leads to surreptitiously training on the test set. This invalidates all subsequent analyses performed on this data in multiple published papers and calls into question all of the purported results. We further show that a novel object classifier constructed with a random codebook performs as well as or better than a novel object classifier constructed with the representation extracted from EEG data, suggesting that the performance of their classifier constructed with a representation extracted from EEG data does not benefit at all from the brain-derived representation. Our results calibrate the underlying difficulty of the tasks involved and caution against sensational and overly optimistic, but false, claims to the contrary.
- 6 December 2016
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 18 (7) , 1723-1739
Accurate Attitude Estimation of a Moving Land Vehicle Using Low-Cost MEMS IMU Sensors
This paper presents a novel Kalman filter for the accurate determination of a vehicle's attitude (pitch and roll angles) using a low-cost MEMS inertial measurement unit (IMU) sensor, comprising a tri-axial gyroscope and a tri-axial accelerometer. Currently, vehicles deploy expensive gyroscopes for attitude determination. A low-cost MEMS gyro cannot be used because of the drift problem. Typically, an accelerometer is used to correct this drift by measuring the attitude from gravitational acceleration. This is, however, not possible in vehicular applications, because accelerometer measurements are corrupted by external accelerations produced due to vehicle movements. In this paper, we show that vehicle kinematics allow the removal of external accelerations from the lateral and vertical axis accelerometer measurements, thus giving the correct estimate of lateral and vertical axis gravitational accelerations. An estimate of the longitudinal axis gravitational acceleration can then be obtained by using the vector norm property of gravitational acceleration. A Kalman filter is designed, which implements the proposed solution and uses the accelerometer in conjunction with the gyroscope to accurately determine the attitude of a vehicle. Hence, this paper enables the use of extremely low-cost MEMS IMU for accurate attitude determination in vehicular domain for the first time. The proposed filter was tested by both simulations and experiments under various dynamic conditions and results were compared with five existing methods from the literature. The proposed filter was able to maintain sub-degree estimation accuracy even under very severe and prolonged dynamic conditions. To signify the importance of the achieved accuracy in determining accurate attitude, we investigated its use in two vehicular applications: vehicle yaw estimate and vehicle location estimate by dead reckoning and showed the performance improvements obtained by the proposed filter.
- 6 December 2016
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 18 (7) , 1723-1739
Accurate Attitude Estimation of a Moving Land Vehicle Using Low-Cost MEMS IMU Sensors
This paper presents a novel Kalman filter for the accurate determination of a vehicle's attitude (pitch and roll angles) using a low-cost MEMS inertial measurement unit (IMU) sensor, comprising a tri-axial gyroscope and a tri-axial accelerometer. Currently, vehicles deploy expensive gyroscopes for attitude determination. A low-cost MEMS gyro cannot be used because of the drift problem. Typically, an accelerometer is used to correct this drift by measuring the attitude from gravitational acceleration. This is, however, not possible in vehicular applications, because accelerometer measurements are corrupted by external accelerations produced due to vehicle movements. In this paper, we show that vehicle kinematics allow the removal of external accelerations from the lateral and vertical axis accelerometer measurements, thus giving the correct estimate of lateral and vertical axis gravitational accelerations. An estimate of the longitudinal axis gravitational acceleration can then be obtained by using the vector norm property of gravitational acceleration. A Kalman filter is designed, which implements the proposed solution and uses the accelerometer in conjunction with the gyroscope to accurately determine the attitude of a vehicle. Hence, this paper enables the use of extremely low-cost MEMS IMU for accurate attitude determination in vehicular domain for the first time. The proposed filter was tested by both simulations and experiments under various dynamic conditions and results were compared with five existing methods from the literature. The proposed filter was able to maintain sub-degree estimation accuracy even under very severe and prolonged dynamic conditions. To signify the importance of the achieved accuracy in determining accurate attitude, we investigated its use in two vehicular applications: vehicle yaw estimate and vehicle location estimate by dead reckoning and showed the performance improvements obtained by the proposed filter.