Article
Audiovisual Cross-modal Correspondences and Their Influence on Perceptual Decision Making (en)
* Presenting author
Abstract:
Audiovisual cross-modal correspondences refer to the consistent and often subconscious associations that our brain establishes between acoustic and visual modalities. For example, a high-pitched sound might be naturally linked to a small visual object, while a low-pitched sound might be linked to a larger visual object. These cross-modal correspondences reveal the underlying ways in which our brain harmonizes and interprets sensory information from multiple sources. Previously, behavioral performance improvements, such as faster reaction time and accuracy, have been demonstrated for congruent cross-modally associated stimuli. However, different types of cross-modal correspondences—statistical, structural, and semantically mediated—may have different consequences for human information processing and decision-making and might have different neural origins. This study expands on the Implicit Association Test and employs concurrent EEG measurements to investigate neural activity elicited by different instances of cross-modal correspondences. Utilizing concurrent EEG measurements, we gain insights into the level of processing at which congruency effects between acoustical and visual stimuli occur and how they influence perceptual decision-making.