Multisensory Perception and Synesthesia

Synesthesia means the capability of the perceptual system to induce perception within one sensual modality by stimulation of a different sensual area. Similar phenomena are pronounced at relatively few individuals, but show a characteristic permanence. Often the phenomenon of visual perception caused by auditory stimulation is described (as color(ed) hearing). In principle, synesthesia can occur between all senses. Such connections are also observed within one sensory space. In that manner, numbers and letters can get an additional color during a process of visual perception or imagination. 

Applications in the Arts and Design

My papers and artwork mentioned of reproduces on this website illuminate phenomena of synesthesia, but also consider the widespread capabilities of cross-sensory connections via correspondences, associations/iconicity, multi-sensory symbolism and conscious generation of rules (e.g. with reference to physical parameters or algorithms). This enables development of numerous fields of application, like sound design and perception of soundscapes, multi-sensory design of products and interfaces, virtual environments, correlation of music and the fine arts, and many others. 

Adjustment of soft sounds in cars for multisensory harmony 

49th International Congress on Noise Control Engineering, Seoul 

e-Congress 

August 23-26, 2020

Keynote: Impetus and challenge of synesthetic music painting

Portrait: Synesthete Visual Artists - Personal Insights

Moderation of evening event with Johannes Deutsch (Vienna): Visualising Classical Music

Conference: Music and Synesthesia. Universität Wien, Hörsaal 1/2, July 3-5, 2020, Vienna, Austria

Cancelled in 2020, hopefully postponed to Summer 2021

Book of abstracts will be published soon (in 2020)

Vision Mahler (Screenshot),

Johannes Deutsch

2006

Light, Color and Motion as Crossmodal Elements of Baroque Music

Soft sounds within Quiet Cars – Design with Respect to Subjective Intensity of Sounds

Forum Acusticum 2020, Lyon, France

postponed to Dec 7-11, 2020    

Auditive Wahrnehmung und die subjektive Repräsentation der Zeit

46. Jahrestagung für Akustik, March 16-19, 2020, Hannover Congress Centrum HCC 

Conference has been cancelled - proceedings are available.

download paper 

Visual Aspects incorporated into the Music of the 18th Century

3rd International Academic Conference Polylogue and synthesis of arts: history and modernity, theory and practice. March 5-6, 2020, Rimsky-Korsakov State Conservatory, St. Petersburg, Russia