Neural Encoding of Auditory Features during Music Perception and Imagery: Insight into the Brain of a Piano Player Auditory Features and Music Imagery

Abstract It remains unclear how the human cortex represents spectrotemporal sound features during auditory imagery, and how this representation compares to auditory perception. To assess this, we recorded electrocorticographic signals from an epileptic patient with proficient music ability in two conditions. First, the participant played two piano pieces on an electronic piano with the sound volume of the digital keyboard on. Second, the participant replayed the same piano pieces, but without auditory feedback, and the participant was asked to imagine hearing the music in his mind. In both conditions, the sound output of the keyboard was recorded, thus allowing precise time-locking between the neural activity and the spectrotemporal content of the music imagery. For both conditions, we built encoding models to predict high gamma neural activity (70-150Hz) from the spectrogram representation of the recorded sound. We found robust similarities between perception and imagery – in frequency and temporal tuning properties in auditory areas. Abbreviations ECoG: electrocorticography HG: high gamma IFG: inferior frontal gyrus MTG: middle temporal gyrus Post-CG: post-central gyrus Pre-CG: pre-central gyrus SMG: supramarginal gyrus STG: superior temporal gyrus STRF: spectrotemporal receptive field