Sound & Interaction
Introduction
ZHdK, BA Interaction Desgin | Bits & Atoms III
Contents of the Sessions
Introduction to Sound and Interaction
Qualities of Sound : Discrete & Continuous / Natural & Artificial
Modes of Sonic Interaction
Triggering and Mapping Sound
OSC communication
Live Ableton
Sound Sythesis and Sampling
Introduction to Sound and Interaction
Introduction to Sound and Interaction
Sonic interaction design is the study and exploitation of sound as one of the principal channels conveying information, meaning, and aesthetic/emotional qualities in interactive contexts.
Introduction to Sound and Interaction
Sound is everywhere in our daily lives. However we filter out most of it from our conscious hearing.
As sound is embedded everywhere naturally, sound engineering is a science/practice that exists prior to sound design or sonic interaction design.
Introduction to Sound and Interaction
While sound engineering or acoustic engineering is concerned with the acoustic properties of materials and spaces, how sound is produced in material interactions or how sound propagates through materials and in certain environments ...
Introduction to Sound and Interaction
... Sound Design is concerned with extending augmenting or reducing (altering) acoustic properties and acoustic nature of things in ways that also meaning or information can be carried along or can be transormed.
Introduction to Sound and Interaction
Sound Design is perhaps born with the introducition of electronic means for recording and manipulating sound, as well as generate it.
Introduction to Sound and Interaction
As soon as people started recording sound they also started manipulating in diverse ways recorded sounds and these were mainly transfered within a small niche of sound practitioners and contemporary musicians. - musique concrete , elektronische Musik and musique electroacoustique and acousmatique
Sound Designers / Artists Practitioners
Pierre Schaeffer at Work, 1940's - 1990's
Delia Derbyshire, Electronic Music pioneer, 1960's - ...
Wendy Carlos, Synth Pioneer, 1960's - ...'s Wendy Carlos, The Shining Single
Hirokazu Tanaka & Yukio Kaneoka, Donkey Kong, 1981
more examples
installation and body
Affection Stations: Quadraphonic Whispering Station
SoundThimble - a high resolution gesture sonification framework
orientation systems
more examples
gestures and sounds
interacting with others
Handmade Beat. Interaction with sound
sound based interactions
more examples
immersion, VR and augmented realities
Qualities of Sound
Time based: Discrete & Continuous
A discrete sound differs from a continuous in that of duration.
Continuous sounds, as the word describes, have almost no clear identifiable beginning or end but are rather constant
Discrete sounds tend to have an identifiable duration.
Qualities of Sound
Time based: Discrete & Continuous
Qualities of Sound
Time based: Discrete & Continuous
Qualities of Sound
Origin or source: Natural & Artificial/Abstract
Natural sounds are the ones we hear in the material reality
Artificial or Abstract sounds are either sounds generated through synthesis, or by manipulating recorded sounds.
(More on sound generation and synthesis next week)
Modes or Models for Interaction
- conducting - gesture triggers sound
- manipulating - action controls acoustic parameters
- substituting - body movements substitute the original sound source
- reacting - action in reaction to a sound
- notification - letting you know something specific through specific auditory queue
- error - pointing at something that has gone wrong
- speech