Flexibility and Stability in Sensory Processing Revealed Using Visual-to-Auditory Sensory Substitution

Uri Hertz, Amir Amedi

Research output: Contribution to journalArticlepeer-review


The classical view of sensory processing involves independent processing in sensory cortices and multisensory integration in associative areas. This hierarchical structure has been challenged by evidence of multisensory responses in sensory areas, and dynamic weighting of sensory inputs in associative areas, thus far reported independently. Here, we used a visual-to-auditory sensory substitution algorithm (SSA) to manipulate the information conveyed by sensory inputs while keeping the stimuli intact. During scan sessions before and after SSA learning, subjects were presented with visual images and auditory soundscapes. The findings reveal 2 dynamic processes. First, crossmodal attenuation of sensory cortices changed direction after SSA learning from visual attenuations of the auditory cortex to auditory attenuations of the visual cortex. Secondly, associative areas changed their sensory response profile from strongest response for visual to that for auditory. The interaction between these phenomena may play an important role in multisensory processing. Consistent features were also found in the sensory dominance in sensory areas and audiovisual convergence in associative area Middle Temporal Gyrus. These 2 factors allow for both stability and a fast, dynamic tuning of the system when required.

Original languageEnglish
Pages (from-to)2049-2064
Number of pages16
JournalCerebral Cortex
Issue number8
StatePublished - 1 Aug 2015
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2014 The Author.


  • audiovisual integration
  • crossmodal effects
  • fMRI
  • multisensory processing
  • sensory cortices

ASJC Scopus subject areas

  • Cognitive Neuroscience
  • Cellular and Molecular Neuroscience


Dive into the research topics of 'Flexibility and Stability in Sensory Processing Revealed Using Visual-to-Auditory Sensory Substitution'. Together they form a unique fingerprint.

Cite this