Exploring 3D audio for brain sonification

Brain activity data, measured by functional Magnetic Resonance Imaging (fMRI), produces extremely high dimensional, sparse and noisy signals which are difficult to visualize, monitor and analyze. The use of spatial music can be particularly appropriate to represent its contained patterns. The literature describes several research done on sonifying neuroimaging data as well as different techniques to use spatialization as a musical language. In this paper, we discuss an artistic approach to fMRI sonification exploiting new compositional paradigms in spatial music. There fore, we have consider the brain activity as audio base material of a the spatial musical composition. Our approach attempts to explore the aesthetic potential of brain sonification not by transforming the data beyond the recognizable, and presenting the data as direct as possible.
Schmele, Timothy ; Gomez, Imanol
http://hdl.handle.net/1853/44442

PDF: EXPLORING 3D AUDIO FOR BRAIN SONIFICATION
PDF: fMRI Soni cation & Brain Activity Prediction








 
Exploring 3D Audio as a New Musical Language
This thesis explores the artistic potential to make use of three dimensional, physical space
as a new musical language. It does so in three ways: It rst investigates the greater history
of spatialization and traces its epitaxy as an emancipated musical parameter up to recent
developments since the new millennium. The second part then brings these historic ideas
together into a contemporary context, in the e ort to further establish space a prime vessel
able to carry a musical message of expression. Several approaches to spatial composition are
elaborated, keeping previously mentioned psychoacoustic limitations in mind. Finally, in the
practical part of the thesis, two di erent three-dimensional spatial sound synthesis methods
are presented, followed by a qualitative evaluation of their use. Based on the insights { and
especially the complications encountered relating to the success of this approach, the thesis
concludes by arguing the necessary conditions under which space as a musical parameter might
hopefully be established.
Timothy Schmele
pdf


Timothy Schmele is a team member of Barcelona Media.

Barcelona Media is a centre for advanced technology dedicated to applied research and the transfer of knowledge and technology as a means to boost the competitiveness of the media and communications sector.
We research in different aspects of sound and audio:

• New paradigms like 3D audio, offering the possibility to place a sound in any position of the space independently of the exhibition system.
• New applications of audio beyond the media sector, for diverse fields like industrial quality control, security and improvement of the quality of life with people with disabilities. 
• New extensions into the ultrasonic domain, exploring the possibilities that ultrasounds offers in traditional and nontraditional audio applications.
• New ways to create, analyze, process and exhibit audio, exploring both the technical tools needed and the creative possibilities open.

http://barcelonamedia.org/section/bm-r-d/audio