MWMatthew B. Winn

Matthew B. Winn

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Matthew B. Winn has a total of 43 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Double-check listening effort in adults with cochlear implants, and precise effort timing by listeners with typical hearing

    by Matthew Winn, Lexi Olson, Abbey L. Thomas, Miski Mohamed, Katherine Teece

    ObjectivesEffortful listening can be a persistent source of strain for people who have hearing loss. Previous experiments have mainly described effort as varying from less to more, overlooking how listening goals might call for more effort at specific moments and less effort at other moments. This study tested listeners’ ability to aim listening effort at specific times containing key speech information, and to reduce effort when it is less needed. DesignAdults with typical hearing (TH) or with cochlear implants (CIs) completed a speech perception task where sentences were presented twice in immediate succession. If the sentence were initially presented clearly and in full, its repetition contained no new information. Alternatively, the initial presentation could contain a word masked by noise, demanding the listener seek out that specific word when the sentence was repeated with that word restored. Listening effort was assessed using concurrent measures of pupil dilation, microsaccade rate, and blinks. Each was analyzed using generalized additive mixed-effects modeling to determine when effort increased and decreased. ResultsAdults with TH devoted less effort to speech repeated with no new information, showing less pupil dilation, less microsaccade inhibition, and less blink inhibition, compared to their responses to the first presentation of the sentence. They also showed stronger responses timed precisely to the moment of a restored key word when it became available in the repetition. However, listeners with CIs showed notable deviation from these patterns, including increased rather than a decreased pupil dilation when listening to a repetition of a sentence already heard fully intact. Additionally, their pupil dilations, microsaccades, and blinks were less precisely timed to key words previously missed.ConclusionsListeners with typical hearing can aim their effort at precise moments where information is needed, and reduce effort when listening is not necessary. Listeners with cochlear implants spread their effort across a wider range of time, and exert extra effort of “double-checking” their perceptions. The temporal control of effort is discussed as a dimension of listening that could underlie reports of fatigue and listening strain among people who use cochlear implants.

  • Open Access

    Visual Gestures of the Head and Eyebrows Support Prosody Perception for Individuals with Cochlear Implants

    by Justin T. Fleming, Harley J. Wheeler, Matthew B. Winn

    Visual gestures, especially head movements and eyebrow raises, are time-locked to acoustic cues during the expression of spoken prosody. The present study examined the role these visual cues play in prosody perception, particularly for individuals with cochlear implants (CIs), who often experience challenges understanding prosody due to reduced access to pitch cues. A vocal mimicry paradigm was used to obtain granular, objective measures of prosody perception through acoustic analysis of mimicked sentences. Stimuli consisted of audio-visual recordings from one talker that captured naturally occurring variability in the expression of auditory and visual cues to word focus. Participants mimicked these natural recordings, as well as prosody-transplanted stimuli that allowed us to isolate the influence of auditory or visual prosody cues while holding the other modality at a neutral level (broad focus). Participants converted visual prosody cues into acoustic correlates of prosody in their mimicry, repeating acoustically unfocused words with higher F0 and intensity when those words were paired with video containing head and eyebrow gestures. This visual influence was stronger for participants with CIs than an age-matched group of typical-hearing listeners. CI participants who were less successful at acoustic mimicry tended to be more influenced by visual cues. These results indicate that CI listeners compensate for degraded auditory cues by integrating visual gestures into their perception of spoken prosody, potentially highlighting new targets for multisensory counseling or training.


  • Independence of spectral contrast effects across different frequency regions in speech perception

    by Christian E. Stilp, Matthew B. Winn

    Identification of speech sounds is influenced by spectral contrast effects (SCEs), the perceptual magnification of spectral differences between successive sounds. SCEs result in the categorization of a target sound being biased away from spectral properties in the preceding acoustic context. Given remarkable consistency in the magnitudes of these contrast effects within the same frequency region [Stilp (2019) J. Acoust. Soc. Am. 146(2), 1503–1517], it was hypothesized that they would also show stable relationships across different frequency regions. In this study, normal-hearing listeners' phoneme categorization and contrast effects were assessed where phonetic contrasts were driven by changes in low-frequency F1 (“big”-“beg” continuum), mid-frequency F3 (“dot”-“got”), or high-frequency frication spectrum regions (“sheet”-“seat”). On each trial, listeners heard a precursor sentence that was filtered to emphasize energy in the lower or higher range within one of these frequency regions, followed by a target word that hinged on the frequency region that was filtered. Results showed that SCEs influenced categorization in each frequency region, as expected. However, effect magnitudes were not correlated with each other across frequency regions within or across two participant samples. This clarifies perception-in-context on a broader scale as the influence of spectral contrast is independent across different frequency regions.


  • Spectral cues influence perception of voice onset time when using the /ɑ/ vowel: Pitfalls and solutions

    by Lexi Olson, Matthew B. Winn

    Perception of voice onset time (VOT) has frequently been used to test auditory temporal processing. However, the first formant frequency (F1) of an adjacent vowel systematically covaries with VOT, presenting a confounding spectral cue. The most problematic confound between VOT and F1 would be for a vowel such as /ɑ/, the most commonly used vowel context for VOT studies in the literature. The present study tested the hypotheses that (1) F1 cues influence perception of VOT when followed by the low vowel /ɑ/ but not when followed by the high vowel /i/, and (2) this confounding spectral cue in /ɑ/ is so salient that it is perceptible for cochlear implant users. Stimuli included a /d/-/t/ VOT continuum coupled with /ɑ/ or /i/, where VOT-F1 covariance was controlled through the ratio of VOT duration to the duration of the vowel that was replaced by aspiration (i.e., cutback ratio). For both listener groups, VOT-F1 covariance affected perception of consonants followed by /ɑ/ but not those followed by /i/. Studies pertaining to auditory temporal processing that have used consonant + /ɑ/ stimuli should be reevaluated because of the likely spectral confound. Future work in this area should use the /i/ context to more effectively isolate temporal cues.

  • Development and validation of a procedure to test perception of speech prosody in listeners with cochlear implants

    by Harley J. Wheeler, Matthew B. Winn

    Understanding vocal prosody is essential to successful communication. However, evaluations of speech recognition have relied heavily on word repetition-type tasks where success does not hinge on prosody perception, or where stimuli do not have enough prosodic variation to even test for this ability. Individuals who use cochlear implants (CIs) are at risk for poorer perception of prosody because of their limited access to pitch perception. This study used a multi-slider visual analog interface to measure perception of contrastive focus prosody in sentence-length stimuli by participants with CIs or with typical hearing (TH). Compared to TH listeners, CI users were more likely to misidentify which word had prosodic focus, as well as having weaker perception of prosodic focus, on average. Whereas TH listeners scaled their perceived strength of prosodic focus based on F0 and vowel intensity features, CI users scaled ratings in accordance with vowel intensity and vowel duration, with no relationship to F0. These results suggest that CI users are at risk of complete misperception of a talker's intended message, even in instances where there was no uncertainty about the words that were spoken.


  • Open Access

    Acoustic analysis of Taylor Swift's dialect changes across different eras of her career

    by Miski Mohamed, Matthew B. Winn

    Across different stages of her career, Taylor Swift has moved in and out of communities that have distinct regional or socio-cultural dialects. Her extensive history of media interactions offers a rare opportunity to observe longitudinal dialect change. Here, we show that Swift's conversational speech exhibited notable signatures of Southern accent during her time in Nashville, including a shortened trajectory for /aɪ/ vowels (“ride” becomes similar to “rod”) and exaggerated fronting of the /u/ vowel, even outside of coronal phonetic contexts. These features were lost after her return to Philadelphia, and hypercorrected upon her relocation to New York City, where she expanded the distinction between low-back vowels (in words like “cot” and “caught”). She also lowered her voice pitch (F0) during her time in New York City, coincident with her increased visibility speaking on issues of social change. These results, which would be virtually impossible to observe in a controlled laboratory study, have broad implications for our understanding of the combined influences of place, profession, and leadership goals on an individual's dialect adaptation later in life, suggesting that the ways people use language for conveying identity and community belonging are malleable within specific timeframes and goals.


  • Listening Effort Is Difficult to Detect in a Person's Voice: Implications for Audiology Evaluations and Conversation Partners

    by Matthew B. Winn, Katherine H. Teece

    Purpose: Listening can be effortful for a variety of reasons, including when a person misperceives a word in a sentence and then mentally repairs it using later context. The current study explored whether an external observer (in the role of a tester/clinician) could detect that effort by hearing the listener's voice as they repeat the sentence. Method: Stimuli were audio recordings of 13 adults with cochlear implants repeating sentences that were either intact or with a masked word that could be inferred/repaired using context (the latter of which were previously documented to elicit greater effort). Participants ( n = 171, including 28 audiologists) used a continuous visual analog scale to judge whether the talker heard one type of stimulus or the other. Participants were also surveyed for experiences related to detecting effort or confusion in a talker's voice. Results: Participant judges were unable to discern when the CI users were forced to effortfully infer words from context when repeating a sentence. Ratings indicated a general bias toward assuming the listener heard the original sentence correctly without any need for repair. Acoustic properties of the CI users' voices (hypothesized higher voice pitch and delayed verbal reaction time for stimuli involving repair) did not reliably correlate with ratings of uncertainty. There were also no statistically detectable advantages for audiologists or for people who reported experience or skill in discerning uncertainty in a talker's voice. Conclusions: Despite clear evidence that mental repair incurs extra effort, the process of mental repair gives no reliably perceptible signature in a talker's voice, even for audiologists and others who profess to have experience and skill in conversing with people who have hearing loss. Listening effort is at risk of going unnoticed by conversation partners and by audiologists who might underestimate a patient's effort when listening to speech. Supplemental Material: https://doi.org/10.23641/asha.28688012


  • A preliminary investigation into the acoustic variability of examiners' productions in language assessments

    by Elizabeth Ancel, Benjamin Munson, Matthew B. Winn, Lizbeth H. Finestack

    Speech-language pathologists often use live-voice assessments to identify communication disorders in children. This study investigated the median F0, F0 range, and speaking rate of 12 examiners administering a commonly used sentence repetition assessment to 151 children aged from three to nine years. Results demonstrated that the acoustic characteristics differed between examiners and suggested that variation in these characteristics is associated with the child's age. Further research is needed to understand how variability in examiners' speech characteristics could potentially impact children's performance in language tasks.

  • Advance Contextual Clues Alleviate Listening Effort During Sentence Repair in Listeners With Hearing Aids

    by Steven P. Gianakas, Matthew B. Winn

    Purpose: When words are misperceived, listeners can rely on later context to repair an auditory perception, at the cost of increased effort. The current study examines whether the effort to repair a missing word in a sentence is alleviated when the listener has some advance knowledge of what to expect in the sentence. Method: Sixteen adults with hearing aids and 17 with typical hearing heard sentences with a missing word that was followed by context sufficient to infer what the word was. They repeated the sentences with the missing words repaired. Sentences were preceded by visual text on the screen showing either “XXXX” (unprimed) or a priming word previewing the word that would be masked in the auditory signal. Along with intelligibility measures, pupillometry was used as an index of listening effort over the course of each trial to measure how priming influenced the effort needed to mentally repair a missing word. Results: When listeners were primed for the word that would need to be repaired in an upcoming sentence, listening effort was reduced, as indicated by pupil size returning more quickly toward baseline after the sentence was heard. Priming reduced the lingering cost of mental repair in both listener groups. For the group with hearing loss, priming also reduced the prevalence of errors on target words and words other than the target word in the sentence, suggesting that priming preserves the cognitive resources needed to process the whole sentence. Conclusion: These results suggest that listeners with typical hearing and with hearing loss can benefit from priming (advance cueing) during speech recognition, to accurately repair speech and to process the speech less effortfully.


  • Open Access

    Repairing Misperceptions of Words Early in a Sentence is More Effortful Than Repairing Later Words, Especially for Listeners With Cochlear Implants

    by Michael L. Smith, Matthew B. Winn

    The process of repairing misperceptions has been identified as a contributor to effortful listening in people who use cochlear implants (CIs). The current study was designed to examine the relative cost of repairing misperceptions at earlier or later parts of a sentence that contained contextual information that could be used to infer words both predictively and retroactively. Misperceptions were enforced at specific times by replacing single words with noise. Changes in pupil dilation were analyzed to track differences in the timing and duration of effort, comparing listeners with typical hearing (TH) or with CIs. Increases in pupil dilation were time-locked to the moment of the missing word, with longer-lasting increases when the missing word was earlier in the sentence. Compared to listeners with TH, CI listeners showed elevated pupil dilation for longer periods of time after listening, suggesting a lingering effect of effort after sentence offset. When needing to mentally repair missing words, CI listeners also made more mistakes on words elsewhere in the sentence, even though these words were not masked. Changes in effort based on the position of the missing word were not evident in basic measures like peak pupil dilation and only emerged when the full-time course was analyzed, suggesting the timing analysis adds new information to our understanding of listening effort. These results demonstrate that some mistakes are more costly than others and incur different levels of mental effort to resolve the mistake, underscoring the information lost when characterizing speech perception with simple measures like percent-correct scores.