Marc Pomplun
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Marc Pomplun has a total of 46 co-authors. Here are the top co-authors by number of shared publications:
- Tyler W. Garaas
Department of Computer Science, University of Massachusetts Boston, 100 Morrissey Boulevard, Boston, MA 02125-3393, USA
3 shared publications - Emily C. Higgins
Department of Computer Science, University of Massachusetts, Boston, MA, USA
2 shared publications - Hsueh-Cheng Wang
Department of Electrical Engineering, National Yang Ming Chiao Tung University, 1001 University Road, Hsinchu 300, Taiwan
2 shared publications - Lap-Fai Yu
George Mason University, Fairfax, USA
2 shared publications - Akram Bayat
University of Massachusetts Boston
1 shared publication - Alex D. Hwang
Schepens Eye Research Institute, Massachusetts Eye and Ear, Department of Ophthalmology, Harvard Medical School, Boston, MA, United States
1 shared publication
Latest Publications
- Open Access
- 15 December 2023
- Published by MDPI AG in Algorithms
- Vol. 16 (12) , 567
Deep Learning-Based Visual Complexity Analysis of Electroencephalography Time-Frequency Images: Can It Localize the Epileptogenic Zone in the Brain?
In drug-resistant epilepsy, a visual inspection of intracranial electroencephalography (iEEG) signals is often needed to localize the epileptogenic zone (EZ) and guide neurosurgery. The visual assessment of iEEG time-frequency (TF) images is an alternative to signal inspection, but subtle variations may escape the human eye. Here, we propose a deep learning-based metric of visual complexity to interpret TF images extracted from iEEG data and aim to assess its ability to identify the EZ in the brain. We analyzed interictal iEEG data from 1928 contacts recorded from 20 children with drug-resistant epilepsy who became seizure-free after neurosurgery. We localized each iEEG contact in the MRI, created TF images (1–70 Hz) for each contact, and used a pre-trained VGG16 network to measure their visual complexity by extracting unsupervised activation energy (UAE) from 13 convolutional layers. We identified points of interest in the brain using the UAE values via patient- and layer-specific thresholds (based on extreme value distribution) and using a support vector machine classifier. Results show that contacts inside the seizure onset zone exhibit lower UAE than outside, with larger differences in deep layers (L10, L12, and L13: p < 0.001). Furthermore, the points of interest identified using the support vector machine, localized the EZ with 7 mm accuracy. In conclusion, we presented a pre-surgical computerized tool that facilitates the EZ localization in the patient’s MRI without requiring long-term iEEG inspection.
- 15 December 2023
- Published by MDPI AG in Algorithms
- Vol. 16 (12) , 567
Open AccessDeep Learning-Based Visual Complexity Analysis of Electroencephalography Time-Frequency Images: Can It Localize the Epileptogenic Zone in the Brain?
In drug-resistant epilepsy, a visual inspection of intracranial electroencephalography (iEEG) signals is often needed to localize the epileptogenic zone (EZ) and guide neurosurgery. The visual assessment of iEEG time-frequency (TF) images is an alternative to signal inspection, but subtle variations may escape the human eye. Here, we propose a deep learning-based metric of visual complexity to interpret TF images extracted from iEEG data and aim to assess its ability to identify the EZ in the brain. We analyzed interictal iEEG data from 1928 contacts recorded from 20 children with drug-resistant epilepsy who became seizure-free after neurosurgery. We localized each iEEG contact in the MRI, created TF images (1–70 Hz) for each contact, and used a pre-trained VGG16 network to measure their visual complexity by extracting unsupervised activation energy (UAE) from 13 convolutional layers. We identified points of interest in the brain using the UAE values via patient- and layer-specific thresholds (based on extreme value distribution) and using a support vector machine classifier. Results show that contacts inside the seizure onset zone exhibit lower UAE than outside, with larger differences in deep layers (L10, L12, and L13: p < 0.001). Furthermore, the points of interest identified using the support vector machine, localized the EZ with 7 mm accuracy. In conclusion, we presented a pre-surgical computerized tool that facilitates the EZ localization in the patient’s MRI without requiring long-term iEEG inspection.
- 15 February 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 28 (5) , 2058-2068
Mood-Driven Colorization of Virtual Indoor Scenes
One of the challenging tasks in virtual scene design for Virtual Reality (VR) is causing it to invoke a particular mood in viewers. The subjective nature of moods brings uncertainty to the purpose. We propose a novel approach to automatic adjustment of the colors of textures for objects in a virtual indoor scene, enabling it to match a target mood. A dataset of 25,000 images, including building/home interiors, was used to train a classifier with the features extracted via deep learning. It contributes to an optimization process that colorizes virtual scenes automatically according to the target mood. Our approach was tested on four different indoor scenes, and we conducted a user study demonstrating its efficacy through statistical analysis with the focus on the impact of the scenes experienced with a VR headset.
- 15 February 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 28 (5) , 2058-2068
Mood-Driven Colorization of Virtual Indoor Scenes
One of the challenging tasks in virtual scene design for Virtual Reality (VR) is causing it to invoke a particular mood in viewers. The subjective nature of moods brings uncertainty to the purpose. We propose a novel approach to automatic adjustment of the colors of textures for objects in a virtual indoor scene, enabling it to match a target mood. A dataset of 25,000 images, including building/home interiors, was used to train a classifier with the features extracted via deep learning. It contributes to an optimization process that colorizes virtual scenes automatically according to the target mood. Our approach was tested on four different indoor scenes, and we conducted a user study demonstrating its efficacy through statistical analysis with the focus on the impact of the scenes experienced with a VR headset.
- 10 October 2017
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 24 (9) , 2516-2530
Automatic Optimization of Wayfinding Design
Wayfinding signs play an important role in guiding users to navigate in a virtual environment and in helping pedestrians to find their ways in a real-world architectural site. Conventionally, the wayfinding design of a virtual environment is created manually, so as the wayfinding design of a real-world architectural site. The many possible navigation scenarios, and the interplay between signs and human navigation, can make the manual design process overwhelming and non-trivial. As a result, creating a wayfinding design for a typical layout can take months to several years. In this paper, we introduce the Way to Go! approach for automatically generating a wayfinding design for a given layout. The designer simply has to specify some navigation scenarios; our approach will automatically generate an optimized wayfinding design with signs properly placed considering human agents' visibility and possibility of making navigation mistakes. We demonstrate the effectiveness of our approach in generating wayfinding designs for different layouts. We evaluate our results by comparing different wayfinding designs and show that our optimized designs can guide pedestrians to their destinations effectively. Our approach can also help the designer visualize the accessibility of a destination from different locations, and correct any “blind zone” with additional signs.
- 10 October 2017
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 24 (9) , 2516-2530
Automatic Optimization of Wayfinding Design
Wayfinding signs play an important role in guiding users to navigate in a virtual environment and in helping pedestrians to find their ways in a real-world architectural site. Conventionally, the wayfinding design of a virtual environment is created manually, so as the wayfinding design of a real-world architectural site. The many possible navigation scenarios, and the interplay between signs and human navigation, can make the manual design process overwhelming and non-trivial. As a result, creating a wayfinding design for a typical layout can take months to several years. In this paper, we introduce the Way to Go! approach for automatically generating a wayfinding design for a given layout. The designer simply has to specify some navigation scenarios; our approach will automatically generate an optimized wayfinding design with signs properly placed considering human agents' visibility and possibility of making navigation mistakes. We demonstrate the effectiveness of our approach in generating wayfinding designs for different layouts. We evaluate our results by comparing different wayfinding designs and show that our optimized designs can guide pedestrians to their destinations effectively. Our approach can also help the designer visualize the accessibility of a destination from different locations, and correct any “blind zone” with additional signs.
- 15 June 2017
- Published by Springer Nature
- p. 478-484
Enhancing User Identification During Reading by Applying Content-Based Text Analysis to Eye-Movement Patterns
- 15 June 2017
- Published by Springer Nature
- p. 478-484
Enhancing User Identification During Reading by Applying Content-Based Text Analysis to Eye-Movement Patterns
- Open Access
- 25 February 2013
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 13 (3) , 24
The effects of task difficulty on visual search strategy in virtual 3D displays
Analyzing the factors that determine our choice of visual search strategy may shed light on visual behavior in everyday situations. Previous results suggest that increasing task difficulty leads to more systematic search paths. Here we analyze observers' eye movements in an "easy" conjunction search task and a "difficult" shape search task to study visual search strategies in stereoscopic search displays with virtual depth induced by binocular disparity. Standard eye-movement variables, such as fixation duration and initial saccade latency, as well as new measures proposed here, such as saccadic step size, relative saccadic selectivity, and x-y target distance, revealed systematic effects on search dynamics in the horizontal-vertical plane throughout the search process. We found that in the "easy" task, observers start with the processing of display items in the display center immediately after stimulus onset and subsequently move their gaze outwards, guided by extrafoveally perceived stimulus color. In contrast, the "difficult" task induced an initial gaze shift to the upper-left display corner, followed by a systematic left-right and top-down search process. The only consistent depth effect was a trend of initial saccades in the easy task with smallest displays to the items closest to the observer. The results demonstrate the utility of eye-movement analysis for understanding search strategies and provide a first step toward studying search strategies in actual 3D scenarios.
- 25 February 2013
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 13 (3) , 24
Open AccessThe effects of task difficulty on visual search strategy in virtual 3D displays
Analyzing the factors that determine our choice of visual search strategy may shed light on visual behavior in everyday situations. Previous results suggest that increasing task difficulty leads to more systematic search paths. Here we analyze observers' eye movements in an "easy" conjunction search task and a "difficult" shape search task to study visual search strategies in stereoscopic search displays with virtual depth induced by binocular disparity. Standard eye-movement variables, such as fixation duration and initial saccade latency, as well as new measures proposed here, such as saccadic step size, relative saccadic selectivity, and x-y target distance, revealed systematic effects on search dynamics in the horizontal-vertical plane throughout the search process. We found that in the "easy" task, observers start with the processing of display items in the display center immediately after stimulus onset and subsequently move their gaze outwards, guided by extrafoveally perceived stimulus color. In contrast, the "difficult" task induced an initial gaze shift to the upper-left display corner, followed by a systematic left-right and top-down search process. The only consistent depth effect was a trend of initial saccades in the easy task with smallest displays to the items closest to the observer. The results demonstrate the utility of eye-movement analysis for understanding search strategies and provide a first step toward studying search strategies in actual 3D scenarios.
- Open Access
- 30 June 2012
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 12 (7) , 14
The effects of circadian phase, time awake, and imposed sleep restriction on performing complex visual tasks: Evidence from comparative visual search
Cognitive performance not only differs between individuals, but also varies within them, influenced by factors that include sleep-wakefulness and biological time of day (circadian phase). Previous studies have shown that both factors influence accuracy rather than the speed of performing a visual search task, which can be hazardous in safety-critical tasks such as air-traffic control or baggage screening. However, prior investigations used simple, brief search tasks requiring little use of working memory. In order to study the effects of circadian phase, time awake, and chronic sleep restriction on the more realistic scenario of longer tasks requiring the sustained interaction of visual working memory and attentional control, the present study employed two comparative visual search tasks. In these tasks, participants had to detect a mismatch between two otherwise identical object distributions, with one of the tasks (mirror task) requiring an additional mental image transformation. Time awake and circadian phase both had significant influences on the speed, but not the accuracy of task performance. Over the course of three weeks of chronic sleep restriction, speed but not accuracy of task performance was impacted. The results suggest measures for safer performance of important tasks and point out the importance of minimizing the impact of circadian phase and sleep-wake history in laboratory vision experiments.
- 30 June 2012
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 12 (7) , 14
Open AccessThe effects of circadian phase, time awake, and imposed sleep restriction on performing complex visual tasks: Evidence from comparative visual search
Cognitive performance not only differs between individuals, but also varies within them, influenced by factors that include sleep-wakefulness and biological time of day (circadian phase). Previous studies have shown that both factors influence accuracy rather than the speed of performing a visual search task, which can be hazardous in safety-critical tasks such as air-traffic control or baggage screening. However, prior investigations used simple, brief search tasks requiring little use of working memory. In order to study the effects of circadian phase, time awake, and chronic sleep restriction on the more realistic scenario of longer tasks requiring the sustained interaction of visual working memory and attentional control, the present study employed two comparative visual search tasks. In these tasks, participants had to detect a mismatch between two otherwise identical object distributions, with one of the tasks (mirror task) requiring an additional mental image transformation. Time awake and circadian phase both had significant influences on the speed, but not the accuracy of task performance. Over the course of three weeks of chronic sleep restriction, speed but not accuracy of task performance was impacted. The results suggest measures for safer performance of important tasks and point out the importance of minimizing the impact of circadian phase and sleep-wake history in laboratory vision experiments.
- Open Access
- 1 June 2012
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 12 (6) , 26
The attraction of visual attention to texts in real-world scenes
When we look at real-world scenes, attention seems disproportionately attracted by texts that are embedded in these scenes, for instance, on signs or billboards. The present study was aimed at verifying the existence of this bias and investigating its underlying factors. For this purpose, data from a previous experiment were reanalyzed and four new experiments measuring eye movements during the viewing of real-world scenes were conducted. By pairing text objects with matching control objects and regions, the following main results were obtained: (a) Greater fixation probability and shorter minimum fixation distance of texts confirmed the higher attractiveness of texts; (b) the locations where texts are typically placed contribute partially to this effect; (c) specific visual features of texts, rather than typically salient features (e.g., color, orientation, and contrast), are the main attractors of attention; (d) the meaningfulness of texts does not add to their attentional capture; and (e) the attraction of attention depends to some extent on the observer's familiarity with the writing system and language of a given text.
- 1 June 2012
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 12 (6) , 26
Open AccessThe attraction of visual attention to texts in real-world scenes
When we look at real-world scenes, attention seems disproportionately attracted by texts that are embedded in these scenes, for instance, on signs or billboards. The present study was aimed at verifying the existence of this bias and investigating its underlying factors. For this purpose, data from a previous experiment were reanalyzed and four new experiments measuring eye movements during the viewing of real-world scenes were conducted. By pairing text objects with matching control objects and regions, the following main results were obtained: (a) Greater fixation probability and shorter minimum fixation distance of texts confirmed the higher attractiveness of texts; (b) the locations where texts are typically placed contribute partially to this effect; (c) specific visual features of texts, rather than typically salient features (e.g., color, orientation, and contrast), are the main attractors of attention; (d) the meaningfulness of texts does not add to their attentional capture; and (e) the attraction of attention depends to some extent on the observer's familiarity with the writing system and language of a given text.
- 1 January 2011
- Published by American Psychological Association (APA)
Saccadic Adaptation To Random Error
- 1 January 2011
- Published by American Psychological Association (APA)
Saccadic Adaptation To Random Error
- Open Access
- 1 October 2010
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 10 (12) , 32
Inconsistency between peri-saccadic mislocalization and compression: Evidence for separate "what" and "where" visual systems
The view of two separate “what” and “where” visual systems is supported by compelling neurophysiological evidence. However, very little direct psychophysical evidence has been presented to suggest that the two functions can be separated in neurologically intact persons. Using a peri-saccadic perception paradigm in which bars of different lengths were flashed around saccade onset, we directly measured the perceived object size (a “what” attribute) and location (a “where” attribute). We found that the perceived object location shifted toward the saccade target to show strongly compressed localization, whereas the perceived object size was not compressed accordingly. This dissociation indicates that the perceived size is not determined by spatial localization of the object boundary, providing direct psychophysical evidence to support that “what” and “where” attributes of objects are indeed processed separately.
- 1 October 2010
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 10 (12) , 32
Open AccessInconsistency between peri-saccadic mislocalization and compression: Evidence for separate "what" and "where" visual systems
The view of two separate “what” and “where” visual systems is supported by compelling neurophysiological evidence. However, very little direct psychophysical evidence has been presented to suggest that the two functions can be separated in neurologically intact persons. Using a peri-saccadic perception paradigm in which bars of different lengths were flashed around saccade onset, we directly measured the perceived object size (a “what” attribute) and location (a “where” attribute). We found that the perceived object location shifted toward the saccade target to show strongly compressed localization, whereas the perceived object size was not compressed accordingly. This dissociation indicates that the perceived size is not determined by spatial localization of the object boundary, providing direct psychophysical evidence to support that “what” and “where” attributes of objects are indeed processed separately.
- Open Access
- 27 May 2009
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 9 (5) , 25
A model of top-down attentional control during visual search in complex scenes
Recently, there has been great interest among vision researchers in developing computational models that predict the distribution of saccadic endpoints in naturalistic scenes. In many of these studies, subjects are instructed to view scenes without any particular task in mind so that stimulus-driven (bottom-up) processes guide visual attention. However, whenever there is a search task, goal-driven (top-down) processes tend to dominate guidance, as indicated by attention being systematically biased toward image features that resemble those of the search target. In the present study, we devise a top-down model of visual attention during search in complex scenes based on similarity between the target and regions of the search scene. Similarity is defined for several feature dimensions such as orientation or spatial frequency using a histogram-matching technique. The amount of attentional guidance across visual feature dimensions is predicted by a previously introduced informativeness measure. We use eye-movement data gathered from participants' search of a set of naturalistic scenes to evaluate the model. The model is found to predict the distribution of saccadic endpoints in search displays nearly as accurately as do other observers' eye-movement data in the same displays.
- 27 May 2009
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 9 (5) , 25
Open AccessA model of top-down attentional control during visual search in complex scenes
Recently, there has been great interest among vision researchers in developing computational models that predict the distribution of saccadic endpoints in naturalistic scenes. In many of these studies, subjects are instructed to view scenes without any particular task in mind so that stimulus-driven (bottom-up) processes guide visual attention. However, whenever there is a search task, goal-driven (top-down) processes tend to dominate guidance, as indicated by attention being systematically biased toward image features that resemble those of the search target. In the present study, we devise a top-down model of visual attention during search in complex scenes based on similarity between the target and regions of the search scene. Similarity is defined for several feature dimensions such as orientation or spatial frequency using a histogram-matching technique. The amount of attentional guidance across visual feature dimensions is predicted by a previously introduced informativeness measure. We use eye-movement data gathered from participants' search of a set of naturalistic scenes to evaluate the model. The model is found to predict the distribution of saccadic endpoints in search displays nearly as accurately as do other observers' eye-movement data in the same displays.