Nicoleta Roman
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Nicoleta Roman has a total of 9 co-authors. Here are the top co-authors by number of shared publications:
- DeLiang Wang
Department of Computer Science and Engineering, The Ohio State University 1 , Columbus, Ohio 43210
3 shared publications DeLiang Wang
The Ohio State University Department of Computer Science and Engineering & Center for Cognitive Science Columbus, Ohio 43210
2 shared publicationsGuoning Hu
2 shared publicationsJohn Woodruff
Department of Computer Science and Engineering, The Ohio State University , Columbus, Ohio 43210
2 shared publicationsSoundar Srinivasan
2 shared publications- Yang Shao
Department of Computer Science and Engineering
2 shared publications
Latest Publications
- 1 March 2013
- Published by Acoustical Society of America (ASA) in The Journal of the Acoustical Society of America
- Vol. 133 (3) , 1707-1717
Speech intelligibility in reverberation with ideal binary masking: Effects of early reflections and signal-to-noise ratio threshold
Ideal binary masking is a signal processing technique that separates a desired signal from a mixture by retaining only the time-frequency units where the signal-to-noise ratio (SNR) exceeds a predetermined threshold. In reverberant conditions there are multiple possible definitions of the ideal binary mask in that one may choose to treat the target early reflections as either desired signal or noise. The ideal binary mask may therefore be parameterized by the reflection boundary, a predetermined division point between early and late reflections. Another important parameter is the local SNR threshold used in labeling the time-frequency units as either target or background. Two experiments were designed to assess the impact of these two parameters on speech intelligibility with ideal binary masking for normal-hearing listeners in reverberant conditions. Experiment 1 shows that in order to achieve intelligibility improvements only the early reflections should be preserved by the binary mask. Moreover, it shows that the effective SNR should be accounted for when deciding the local threshold optimal range. Experiment 2 shows that with long reverberation times, intelligibility improvements are only obtained when the reflection boundary is 100 ms or less. Also, the experiment suggests that binary masking can be used for dereverberation.
- 1 March 2013
- Published by Acoustical Society of America (ASA) in The Journal of the Acoustical Society of America
- Vol. 133 (3) , 1707-1717
Speech intelligibility in reverberation with ideal binary masking: Effects of early reflections and signal-to-noise ratio threshold
Ideal binary masking is a signal processing technique that separates a desired signal from a mixture by retaining only the time-frequency units where the signal-to-noise ratio (SNR) exceeds a predetermined threshold. In reverberant conditions there are multiple possible definitions of the ideal binary mask in that one may choose to treat the target early reflections as either desired signal or noise. The ideal binary mask may therefore be parameterized by the reflection boundary, a predetermined division point between early and late reflections. Another important parameter is the local SNR threshold used in labeling the time-frequency units as either target or background. Two experiments were designed to assess the impact of these two parameters on speech intelligibility with ideal binary masking for normal-hearing listeners in reverberant conditions. Experiment 1 shows that in order to achieve intelligibility improvements only the early reflections should be preserved by the binary mask. Moreover, it shows that the effective SNR should be accounted for when deciding the local threshold optimal range. Experiment 2 shows that with long reverberation times, intelligibility improvements are only obtained when the reflection boundary is 100 ms or less. Also, the experiment suggests that binary masking can be used for dereverberation.
- 1 October 2011
- Published by Acoustical Society of America (ASA) in The Journal of the Acoustical Society of America
- Vol. 130 (4) , 2153-2161
Intelligibility of reverberant noisy speech with ideal binary masking
For a mixture of target speech and noise in anechoic conditions, the ideal binary mask is defined as follows: It selects the time-frequency units where target energy exceeds noise energy by a certain local threshold and cancels the other units. In this study, the definition of the ideal binary mask is extended to reverberant conditions. Given the division between early and late reflections in terms of speech intelligibility, three ideal binary masks can be defined: an ideal binary mask that uses the direct path of the target as the desired signal, an ideal binary mask that uses the direct path and early reflections of the target as the desired signal, and an ideal binary mask that uses the reverberant target as the desired signal. The effects of these ideal binary mask definitions on speech intelligibility are compared across two types of interference: speech shaped noise and concurrent female speech. As suggested by psychoacoustical studies, the ideal binary mask based on the direct path and early reflections of target speech outperforms the other masks as reverberation time increases and produces substantial reductions in terms of speech reception threshold for normal hearing listeners.
- 1 October 2011
- Published by Acoustical Society of America (ASA) in The Journal of the Acoustical Society of America
- Vol. 130 (4) , 2153-2161
Intelligibility of reverberant noisy speech with ideal binary masking
For a mixture of target speech and noise in anechoic conditions, the ideal binary mask is defined as follows: It selects the time-frequency units where target energy exceeds noise energy by a certain local threshold and cancels the other units. In this study, the definition of the ideal binary mask is extended to reverberant conditions. Given the division between early and late reflections in terms of speech intelligibility, three ideal binary masks can be defined: an ideal binary mask that uses the direct path of the target as the desired signal, an ideal binary mask that uses the direct path and early reflections of the target as the desired signal, and an ideal binary mask that uses the reverberant target as the desired signal. The effects of these ideal binary mask definitions on speech intelligibility are compared across two types of interference: speech shaped noise and concurrent female speech. As suggested by psychoacoustical studies, the ideal binary mask based on the direct path and early reflections of target speech outperforms the other masks as reverberation time increases and produces substantial reductions in terms of speech reception threshold for normal hearing listeners.
- Open Access
- 3 February 2008
- Published by Defense Technical Information Center (DTIC)
Monaural Speech Segregation by Integrating Primitive and Schema-Based Analysis
This report presents calculations to explore the use of depolarization of scattered light as a discriminator of biological particles in an aerosol. The discrete dipole approximation was used to model appropriate shapes of several different types of particles. To model an ensemble of spores, we used experimental parameters appropriate to Bacillus cereus. For this case, two different but related assumptions for particle shapes are shown to give different and distinguishable graphs for the depolarization, D, as a function of wavelength and scattering angle. The use of two different length distributions to simulate scattering from two different strains of Escherichia coli gave rise to distinguishable graphs for D for the two strains. Here, the same shape (hemispherically-capped cylinder) as well as the same value for other parameters (i.e., width and refractive index) was assumed for the two strains. In the preceding calculations, we averaged over random orientations and size distributions based on experimental measurements for a real aerosol. The calculated results predict that D would provide some identification of aerosols made up largely of single biological particles. Calculations were also performed for small clusters made up of several spherical spores.
- 3 February 2008
- Published by Defense Technical Information Center (DTIC)
Open AccessMonaural Speech Segregation by Integrating Primitive and Schema-Based Analysis
This report presents calculations to explore the use of depolarization of scattered light as a discriminator of biological particles in an aerosol. The discrete dipole approximation was used to model appropriate shapes of several different types of particles. To model an ensemble of spores, we used experimental parameters appropriate to Bacillus cereus. For this case, two different but related assumptions for particle shapes are shown to give different and distinguishable graphs for the depolarization, D, as a function of wavelength and scattering angle. The use of two different length distributions to simulate scattering from two different strains of Escherichia coli gave rise to distinguishable graphs for D for the two strains. Here, the same shape (hemispherically-capped cylinder) as well as the same value for other parameters (i.e., width and refractive index) was assumed for the two strains. In the preceding calculations, we averaged over random orientations and size distributions based on experimental measurements for a real aerosol. The calculated results predict that D would provide some identification of aerosols made up largely of single biological particles. Calculations were also performed for small clusters made up of several spherical spores.
- Open Access
- 1 May 2007
- Published by Defense Technical Information Center (DTIC)
Simulation of Transient Dynamics of Shock Wave Boundary Layer Interactions Using Hybrid Large-Eddy/Reynolds-Averaged Navier-Stokes Models
The natural auditory environment typically contains multiple simultaneous events. A remarkable feat of auditory perception is the ability to disentangle the acoustic mixture and group the components of the same event into a stream. This aspect of human audition is called auditory scene analysis (ASA), which has a primitive (bottom-up) process and a schema-based (top-down) process. A major task of auditory scene analysis is monaural segregation of speech from interfering sounds. This project seeks to develop an auditory scene analysis approach to monaural speech segregation. Consistent with the stated objectives of the project, the project has made considerable progress along the following four directions. First, we have proposed a schema-based model for phonemic restoration, which refers to the perceptual synthesis of the phonemes that are masked by appropriate replacement sounds by utilizing lexical context. Second, we have developed an approach to address the problem of sequential organization, which is based on trained speaker models. Third, we have proposed an approach for segmentation of auditory scenes based on event detection, in an attempt to address the segregation of unvoiced speech. Fourth, we have developed a comprehensive system for segregating unvoiced speech, a long standing challenge in computational auditory scene analysis (CASA). In addition, encouraging progress has been made on enhancing reverberant speech and modeling of multitalker speech perception. A provisional patent application entitled A method for accurate pitch estimation and voice separation, has been filed as a result of this AFOSR grant. Executive summaries of doctoral dissertations supported can be found at the back of the reports.
- 1 May 2007
- Published by Defense Technical Information Center (DTIC)
Open AccessSimulation of Transient Dynamics of Shock Wave Boundary Layer Interactions Using Hybrid Large-Eddy/Reynolds-Averaged Navier-Stokes Models
The natural auditory environment typically contains multiple simultaneous events. A remarkable feat of auditory perception is the ability to disentangle the acoustic mixture and group the components of the same event into a stream. This aspect of human audition is called auditory scene analysis (ASA), which has a primitive (bottom-up) process and a schema-based (top-down) process. A major task of auditory scene analysis is monaural segregation of speech from interfering sounds. This project seeks to develop an auditory scene analysis approach to monaural speech segregation. Consistent with the stated objectives of the project, the project has made considerable progress along the following four directions. First, we have proposed a schema-based model for phonemic restoration, which refers to the perceptual synthesis of the phonemes that are masked by appropriate replacement sounds by utilizing lexical context. Second, we have developed an approach to address the problem of sequential organization, which is based on trained speaker models. Third, we have proposed an approach for segmentation of auditory scenes based on event detection, in an attempt to address the segregation of unvoiced speech. Fourth, we have developed a comprehensive system for segregating unvoiced speech, a long standing challenge in computational auditory scene analysis (CASA). In addition, encouraging progress has been made on enhancing reverberant speech and modeling of multitalker speech perception. A provisional patent application entitled A method for accurate pitch estimation and voice separation, has been filed as a result of this AFOSR grant. Executive summaries of doctoral dissertations supported can be found at the back of the reports.
- 1 April 2007
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 4 (15206149) , IV-789-789
Exploiting Uncertainties for Binaural Speech Recognition
Recently several algorithms have been proposed to enhance noisy speech by estimating the signal-to-noise ratio (SNR) within a local time-frequency region based on binaural cues of interaural time and intensity differences (ITD and IID). However, the accuracy of the estimated SNR often varies widely across time and frequency, causing uncertainties in the enhanced speech features. We estimate this uncertainty based on statistics of ITD and IID and show that it can be effectively exploited to improve robust speech recognition. Systematic evaluations using the estimated uncertainty show significant improvement in recognition performance compared to the baseline performance.
- 1 April 2007
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 4 (15206149) , IV-789-789
Exploiting Uncertainties for Binaural Speech Recognition
Recently several algorithms have been proposed to enhance noisy speech by estimating the signal-to-noise ratio (SNR) within a local time-frequency region based on binaural cues of interaural time and intensity differences (ITD and IID). However, the accuracy of the estimated SNR often varies widely across time and frequency, causing uncertainties in the enhanced speech features. We estimate this uncertainty based on statistics of ITD and IID and show that it can be effectively exploited to improve robust speech recognition. Systematic evaluations using the estimated uncertainty show significant improvement in recognition performance compared to the baseline performance.
- 1 December 2006
- Published by Acoustical Society of America (ASA) in The Journal of the Acoustical Society of America
- Vol. 120 (6) , 4040-4051
Binaural segregation in multisource reverberant environments
In a natural environment, speech signals are degraded by both reverberation and concurrent noise sources. While human listening is robust under these conditions using only two ears, current two-microphone algorithms perform poorly. The psychological process of figure-ground segregation suggests that the target signal is perceived as a foreground while the remaining stimuli are perceived as a background. Accordingly, the goal is to estimate an ideal time-frequency (T-F) binary mask, which selects the target if it is stronger than the interference in a local T-F unit. In this paper, a binaural segregation system that extracts the reverberant target signal from multisource reverberant mixtures by utilizing only the location information of target source is proposed. The proposed system combines target cancellation through adaptive filtering and a binary decision rule to estimate the ideal T-F binary mask. The main observation in this work is that the target attenuation in a T-F unit resulting from adaptive filtering is correlated with the relative strength of target to mixture. A comprehensive evaluation shows that the proposed system results in large SNR gains. In addition, comparisons using SNR as well as automatic speech recognition measures show that this system outperforms standard two-microphone beamforming approaches and a recent binaural processor.
- 1 December 2006
- Published by Acoustical Society of America (ASA) in The Journal of the Acoustical Society of America
- Vol. 120 (6) , 4040-4051
Binaural segregation in multisource reverberant environments
In a natural environment, speech signals are degraded by both reverberation and concurrent noise sources. While human listening is robust under these conditions using only two ears, current two-microphone algorithms perform poorly. The psychological process of figure-ground segregation suggests that the target signal is perceived as a foreground while the remaining stimuli are perceived as a background. Accordingly, the goal is to estimate an ideal time-frequency (T-F) binary mask, which selects the target if it is stronger than the interference in a local T-F unit. In this paper, a binaural segregation system that extracts the reverberant target signal from multisource reverberant mixtures by utilizing only the location information of target source is proposed. The proposed system combines target cancellation through adaptive filtering and a binary decision rule to estimate the ideal T-F binary mask. The main observation in this work is that the target attenuation in a T-F unit resulting from adaptive filtering is correlated with the relative strength of target to mixture. A comprehensive evaluation shows that the proposed system results in large SNR gains. In addition, comparisons using SNR as well as automatic speech recognition measures show that this system outperforms standard two-microphone beamforming approaches and a recent binaural processor.
- 1 July 2006
- Published by Acoustical Society of America (ASA) in The Journal of the Acoustical Society of America
- Vol. 120 (1) , 458-469
Pitch-based monaural segregation of reverberant speech
In everyday listening, both background noise and reverberation degrade the speech signal. Psychoacoustic evidence suggests that human speech perception under reverberant conditions relies mostly on monaural processing. While speech segregation based on periodicity has achieved considerable progress in handling additive noise, little research in monaural segregation has been devoted to reverberant scenarios. Reverberation smears the harmonic structure of speech signals, and our evaluations using a pitch-based segregation algorithm show that an increase in the room reverberation time causes degraded performance due to weakened periodicity in the target signal. We propose a two-stage monaural separation system that combines the inverse filtering of the room impulse response corresponding to target location and a pitch-based speech segregation method. As a result of the first stage, the harmonicity of a signal arriving from target direction is partially restored while signals arriving from other directions are further smeared, and this leads to improved segregation. A systematic evaluation of the system shows that the proposed system results in considerable signal-to-noise ratio gains across different conditions. Potential applications of this system include robust automatic speech recognition and hearing aid design.
- 1 July 2006
- Published by Acoustical Society of America (ASA) in The Journal of the Acoustical Society of America
- Vol. 120 (1) , 458-469
Pitch-based monaural segregation of reverberant speech
In everyday listening, both background noise and reverberation degrade the speech signal. Psychoacoustic evidence suggests that human speech perception under reverberant conditions relies mostly on monaural processing. While speech segregation based on periodicity has achieved considerable progress in handling additive noise, little research in monaural segregation has been devoted to reverberant scenarios. Reverberation smears the harmonic structure of speech signals, and our evaluations using a pitch-based segregation algorithm show that an increase in the room reverberation time causes degraded performance due to weakened periodicity in the target signal. We propose a two-stage monaural separation system that combines the inverse filtering of the room impulse response corresponding to target location and a pitch-based speech segregation method. As a result of the first stage, the harmonicity of a signal arriving from target direction is partially restored while signals arriving from other directions are further smeared, and this leads to improved segregation. A systematic evaluation of the system shows that the proposed system results in considerable signal-to-noise ratio gains across different conditions. Potential applications of this system include robust automatic speech recognition and hearing aid design.