Introduction to the Transformation of Sound by Computer
Although direct synthesis of sound is an important area of computer music, it can often be equally interesting (or more so!) to take existing sounds (recorded or synthesized), and transform, mutate, deconstruct, and in general, mess around with them. There are as many basic sound transformation techniques as there are synthesis techniques, and in this chapter, we’ll describe a few important ones. For the sake of convenience, we will separate them into time domain and frequency domain techniques.
applet: Make a piece with samples.
Tape Music/Cut and Paste
The most obvious way to transform a sound is to chop it up, edit it, turn it around, and collage it. These kinds of procedures, which have been used in electronic music since the early days of tape recorders and razor blades (well, not the early days of razor blades...), are done in the time domain. There are a number of sophisticated software tools for manipulating sounds in this way, called digital sound editors. These editors allow for the most minute, sample-by-sample changes of a sound. These kinds of techniques are used in almost all fields of audio, from avant-garde music to Hollywood soundtracks, from radio station advertising spots to rap.
Jon Appleton: Chef d'Oeuvre. This classic of analog electronic music was composed using only tape recorders, filters, and other pre-computer devices, and was based on a recording of an old television commercial.
Soundfile .x
Soundfile .x
BS Variation 061801 by Huk Don Phun was created using Phun's experimental "bleeding eyes" filtering technique. He used only free software and sounds he downloaded from the web.
Time Domain Restructuring
Composers have experimented a lot with unusual time domain restructuring of sound. By chopping up waveforms into very small segments, and radically reordering them, some noisy and unusual effects can be created. As in collage visual art, the ironic and interesting juxtaposition of very familiar materials can be used to create new works that are perhaps greater than the sum of their constituent parts. Jane Dowe Beck deconstruction piece. Playing with the perception of the listener Puzzels & Pagans takes the first 2 minutes and 26 seconds of "Jackass" (from Odelay) and cuts it up into 2500 pieces. These pieces are then reshuffled taking into account probability functions (that change over the length of the track) that determine if pieces remain in their original position or if they don't sound at all. This was realized using James McCartney's SuperCollider computer music programming language.
Soundfile .x
A unique, experimental and rather strange program for deonstructing and reconstructing sounds in the time domain is Agaraphones Lyre, written by the enigmatic Akira Rabelais. It provides a number of techniques for radical de/recomposition of sounds, techniques that often preclude the user from making specific decisions in favor of larger, more probabilistic decisions.
There is no permission for this photo.
Figure .x Sample GUI from Agaraphones Lyre, for sound deconstruction. This is Time Domain Mutation.
Sound example using Agaraphones Lyre (random cut-up). The original piano piece Aposiopesi' was written by Vincent Carté in 1999. This recording was made by Akira Rabelais at Wave Equation Studios in Hollywood California. The piece was filtered with Argeïphontes Lyre 2.0b1.
Soundfile .x
Sampling
Sampling, a popular concept, refers to taking small bits of sound, often recognizable ones, and recontextualizing them via digital techniques. By digitally sampling, we can easily manipulate the pitch and time characteristics of ordinary sounds, and use them in any number of ways.
We’ve talked a lot about samples and sampling in the proceeding chapters. In popular music (especially electronic dance and beat oriented music), the term "sampling" has acquired a specialized meaning. In this context, a sample refers to a (usually) short excerpt from some previously recorded source, such as a drum loop from a song or some dialog from a film soundtrack, which is used as an element in a new work. A "sampler" refers to the hardware used to record, store, manipulate and play back samples. Originally most samplers where stand-alone pieces of gear. Today sampling tends to be integrated into a studio’s computer based digital audio system.
Sampling was pioneered by rap artists in the mid-1980’s, and by the early 1990’s had become a standard studio technique used in all types of music. Issues of copyright violation have plagued many artists working with sample-based music, notably John Oswald of Plunderphonics fame and the band Negativland, although the motives of the "offended" parties (generally large record companies) have tended to be more financial than artistic. One result of this is that the phrase "contains a sample from xxx, used by permission" has become ubiquitous on CD cases and in liner notes.
Although the idea of using excerpts from various sources in a new work is not a new one (many composers, from Bartok's use of Balkan folk songs to Ives' use of American popular music folk songs, have dealt with similar ideas), digital technology has radically changed the possibilities.
Herbert Brün Photo and graphic used with permission from Susan Parenti.
"The computer program which I called SAWDUST allows me to work with the smallest parts of waveforms, to link them and to mingle or merge them with one another. Once composed, the links and mixtures are treated, by repetition, as periods, or by various degrees of continuous change, as passing moments of orientation in a process of transformations."
Herbert Brün's composition Dustiny (1978) is a good example of his SAWDUST Computer Music Project.
Drum machines Some drum machine sounds.
Drum machines and samplers are close cousins. Many drum machines are just specialized samplers — their samples happen to be all percussion/drum-oriented. Other drum machines feature electronic or digitally synthesized drum sounds. As with sampling, drum machines started out as stand-alone pieces of hardware, but now have largely been integrated into computer-based systems.
Soundfile .x
installed
Drum Machine Applet
DAW Systems
Digital Audio Workstations (DAWs) in the 1990s and 2000s have had the same effect on digital sound creation as desktop publishing software had on the publishing industry in the 1980s: they’ve brought it out of the highly specialized and expensive environments in which it grew up, and into people’s homes. A DAW usually consists of a computer with some sort of sound card or other hardware for analog and digital input/output, sound recording/editing/playback/multi-track software and a mixer, amplifier and other sound equipment traditionally found in a home studio. Even the most modest of DAW systems can provide from eight to sixteen tracks of CD quality sound capabilities, making it possible for many artists to self-produce and release their work for much less than it has traditionally cost. This ability, in conjunction with similar marketing and publicizing possibilities opened up by the spread of the Internet, has contributed to the explosion of tiny record labels and independently released CDs we’ve seen in the late 1990s.
In 1989 Digidesign came out with Sound Tools, the first professional tape-less recording system. With the popularization of personal computers numerous software and hardware manufactures have cornered the market for computer-based digital audio. Starting in the mid-1980s personal computer-based production systems have allowed individuals and institutions to make the highest quality recordings DAW systems and have also revolutionized the professional music, broadcast, multimedia and film industries with audio systems that are more flexible, more accessible, and more creatively oriented than ever before.
Today DAWS come in all shapes and sizes and interface with most computer operating systems from Mac to Windows to LINUX. Many DAW systems involve a "breakout box" — a piece of hardware that usually provides four to eight channels of digital audio I/O (inputs and outputs). As we write this, the introduction of FireWire to the computer industry looks like a revolutionary way to hook up the breakout boxes to personal computers. Nowadays many DAW systems have "control surfaces" —pieces of hardware that look like a standard mixer but are really controllers for parameters in the digital audio system.
Thanks to MOTU.com for their permission to use this graphic.
The Mark of the Unicorn (MOTU) 828 breakout box, part of a DAW system with FireWire interface.
Thanks to Sentech Electronics, Inc. for this graphic
Motor Mix(tm) stands alone as the only DAW mixer control surface to offer 8 bank switchable Motorized faders. It also features 8 rotary pots, a rotary encoder, 68 switches and a 40 by 2 LCD.