China
Africa
Explore chapters and articles related to this topic
Chemosensory Disorders and Nutrition
Published in Alan R. Hirsch, Nutrition and Sensation, 2023
Carl M. Wahlstrom, Alan R. Hirsch, Bradley W. Whitman
The McGurk effect, describing the ramifications of visual stimuli on auditory perception, may be extended to the influence of visual stimuli on the chemosensory system (Keil, Muller, Ihssen, and Weisz 2012). While in those with pathological chemosensory functioning, olfactory windows (Hirsch, Li, Kao, Hayes, Choe, and Lu 2007), and dysosmia (Hummel, Landis, and Huttenbrink 2011) have been linked to context, context-dependent phantosmia. This was noted in a patient seen at the Smell & Taste Treatment and Research Foundation.
Speech and its perception
Published in Stanley A. Gelfand, Hearing, 2017
The McGurk (McGurk–MacDonald) effect illustrates the interaction of auditory and visual information in speech perception (McGurk and MacDonald, 1976; MacDonald and McGurk, 1978), and has been proposed as evidence for a specialized speech module and/or the perception of speech gestures for some time (e.g., Liberman and Mattingly, 1985). To understand this effect, remember that real face-to-face conversations involve auditory and visual signals that agree: the listener sees lip and facial manipulations on the talker's face that correspond with what he hears the talker saying. For example, when a talker says /ba/, the listener hears /ba/ and also sees /ba/ on the talker's face; and, as expected, perceives /ba/. In contrast, the McGurk effect is elicited when the listener is presented with competing auditory and visual representations of the speech. For example, the listener might be presented with an audio recording of /ba/ from earphones along with a video recording of a /ga/ on a screen. In this case, the listener perceives another syllable (e.g., /da/) or just one of the two originals, constituting the McGurk effect. This illusion is so strong that the listener experiences it if he knows that two different stimuli were presented. The McGurk effect has been taken as evidence for a specialized speech module and/or the perception of speech gestures for some time (e.g., Liberman and Mattingly, 1985), but other interpretations also have been offered (e.g., Massaro, 1987, 1998). The accumulating physiological findings suggest that the McGurk effect involves mechanisms dealing with phonetic information, involving several cortical auditory areas and have left hemispheric dominance (Sams et al., 1991; Näätänen, 2001; Colin et al., 2002, 2004; Möttönen et al., 2002; Saint-Amour et al., 2007). For informative current findings and insightful discussions of the perceptual processes that appear to be involved in the McGurk effect, as well as the anatomical sites involved, see Nahorna et al. (2012).
Audiovisual speech perception in children: a scoping review
Published in Speech, Language and Hearing, 2022
Carolina Salinas-Marchant, Andrea A. N. MacLeod
Multimodal speech perception has been extensively studied prior to 2000. With the early documentation of what has been named the McGurk effect, researchers described the complexity that underlies the integration of auditory and visual cues. Specifically, the McGurk effect showed that when faced with the same auditory stimulus, people can hear one syllable with their eyes open and a different one with their eyes closed (Fowler, 2004; McGurk & MacDonald, 1976). This effect supports the view that speech perception is a multimodal process: the combination of incongruent sensory information results in a visual illusion. On the other hand, the combination of congruent audiovisual information facilitates speech perception. In contexts of significant ambiguity, such as speech in noise or rapid speech, visual cues are integrated with the auditory information to optimize the listener's speech perception (Teinonen, Aslin, Alku, & Csibra, 2008). Visual information also affects how heard phonemes are categorized, both in children and in adults (Massaro, 1984).
Intact lip-reading but weaker McGurk effect in individuals with high autistic traits
Published in International Journal of Developmental Disabilities, 2022
Research over the past decade has clarified that individuals with diagnosed ASD show atypical processing in audiovisual speech perception, especially in the McGurk effect (McGurk and MacDonald 1976). The McGurk effect is a well-known illusion demonstrating the strength of our automatic use of facial information when recognizing speech perception. For instance, when an observer is presented with the movie of a person speaking a given phoneme dubbed with a voice speaking an incongruent phoneme, they will perceive an intermediate phoneme. The McGurk effect is relatively weaker in individuals with autism spectrum disorder (ASD) than with typical developments (TD), although no difference is observed in the ability to hear voices between the two populations (e.g. De Gelder et al. 1991, Iarocci et al. 2010, Saalasti et al. 2012 (Saalasti et al., 2011), Williams et al. 2004). This means that individuals with diagnosed ASD rely less on facial speech, or may not rely on facial speech at all, during audiovisual speech perception, thereby showing a weaker McGurk effect. Recently, a meta-analysis pooled nine clinical studies of McGurk effect and revealed that individuals with diagnosed ASD show weaker McGurk effect than TD controls (Zhang et al. 2019).
Development of audiovisual integration in children with cochlear implant within 18 months of implantation
Published in Hearing, Balance and Communication, 2021
In everyday situations, speech understanding is achieved in an audiovisual mode that equates the congruent movement of the lips matched with the auditory speech signals. Speech perception is an auditory-visual event not only when auditory information is degraded or absent but whenever the visual information is available [1]. While perceiving speech from infancy, children use the information available from the auditory modality (heard speech) and the visual modality (mouth movements) [2,3]. This integration of auditory and visual speech streams can be demonstrated by a remarkable illusion known as the McGurk effect [4]: an auditory “ba” dubbed with the lip movements of “ga” is perceived by the listener as a entirely different syllable, “da” (the McGurk perception).