Tuesday, May 12, 2009

Making Music Expressive with MIDI

What makes a musical performance expressive?

Before I discuss what makes a musical performance expressive, I think the words “expression” and “expressive” need to be clearly defined. “Expression” is the process of representing in a medium, such as words, music, or body language. For example, a facial aspect or vocal intonation indicative of feeling is an expression. To be “expressive” is to effectively convey meaning or feeling.

Although MIDI only allows us to transmit two very specific pieces of information about a note, namely the note number and velocity, some sequenced and live performances using MIDI are more expressive than others. Following are my thoughts on what performers do to make music expressive and how these techniques can be represented in a MIDI sequence.

Are some instruments more expressive than others?

I don’t believe that one instrument is more expressive than another. For instance, one may not think that a bagpipe is a very expressive instrument, but if the emotion I’m trying to convey is a longing for the green fields of Ireland, I’d be hard-pressed to find a more expressive instrument for that purpose.

I do believe, however, that some instruments are able to convey a wider range of emotions. What made the piano, or pianoforte, such a hit when it first arrived on the scene was its ability to be played softly and loudly. Its dynamics gave it a wider range of expression than its predecessor the harpsichord. There is also a broader range of material or literature available for the piano. I’ve heard classical music, jazz, and every style in between played on the piano. Each style conjures up different emotions and imagery. Musical styles have their own languages and rules that give them their musical identities. Each style is a musical expression. What it really comes down to is personal experience. Why? Because a sound has to be associated with a memory to spark an emotive thought in the listener.

What performance characteristics are specific to particular instruments?

This is too broad a topic to cover here, but instruments are generally categorized by their performance characteristics, or family.

  • Brass: including trumpets, french horns, trombones, tubas, are usually metal and are played by vibrating one’s lips on a metal mouthpiece. The tones produced can be long or short, depending on the amount of air blown into the instrument, and the tonguing techniques used in performance.

  • Woodwind: including flutes, clarinets, oboes, English horns, bassoons, and saxophones, are or were once made of wood, and are played by blowing across a reed, in some cases a double-reed, to produce sound. The exception being the flute, which produces sound by having air blown across an edge.

  • Percussion: my principal instrument, can generally be broken down into two categories, non-pitched and pitched.

Non-pitched percussion would include snare drums, bass drums, toms, bongos, congas, timbales, shakers, tambourines, cymbals. Most drums have a membrane stretched over a hollow cylinder, that is struck either with the hand, a stick, or a mallet. Some drums can produce long and short sounds and have wide ranges of expression, like the Brazilian surdo. Cymbals come in many shapes and sizes, and are generally made of a bronze alloy. They can also be very expressive in dynamic range, and in note value.

Pitched percussion would include tubular bells, kalimba, marimbas, crotales, timpani, steel drums, and glockenspiel. These instruments are struck to produce a pitch which can vary in dynamic range and duration as well.

  • String: including violins, violas, cellos, double basses, guitars, guqin, dobro, steel guitar, erhu, and oud. These instruments produce sound by being bowed, plucked, or strummed to cause the strings to vibrate. They can produce legato and staccato sound in a wide range of dynamics.

  • Keyboard: including harpsichord, piano, and organ, are instruments that are played using a musical keyboard. The harpsichord has strings that are plucked when a key is pressed. It has very limited dynamic range and is most closely associated with the music of the Baroque period. The piano has hammers that strike the strings when a key is pressed. As mentioned above, the piano has a wide dynamic range and the use of pedals further enhances its expressive properties. Organs are keyboards played with the hands or feet to move air through pipes or reeds of various lengths to produce sound. Electric organs generate electrical signals and produce sound through loudspeakers. Organs are diverse and can be used to express a wide range of emotion, from the majesty of high church hymns of old, to the bounce of the jazz organ trios,

  • Electronic: include theremins, analog synthesizers, digital synthesizers, electronic drum sets, and virtual instruments, these instruments produced sound by the use of electronics. These instruments are very expressive in that they can be edited to produce an almost infinite variety of sounds.

Are there some parts of an expressive performance that just can’t be represented using MIDI?

There are many parameters that effect how expressive a performance is. Besides the actual characteristics of the sound used (attack, decay, sustain, and release), there are velocity, pitch bends, channel after-touch, and modulations that can add to the effectiveness of a performance.

Quantization and step-editing allow for very precise sequencing of notes. Not quantizing a solo will allow the part to “breathe” and prevent it from sounding too mechanical. Another technique that may be used is the “humanize” function, which takes a quantized performance, and through the use of algorithms, varies the velocities and timing among other parameters to approximate the feeling of a live performance.

Velocity, not to be confused with volume (which is amplitude), is the rate of attack and can alter the sound of a given instrument. For example, I can program a keyboard to produce a bass guitar that sounds plucked when played softly, and “slapped” when played with increased velocity.

Other than the human voice, I think that nearly every part of an expressive performance can be represented using MIDI. We have very powerful tools at our disposal, and we are only limited by our imaginations and ingenuity.

- John Anthony Martinez

1 comment:

Electric Muse said...

I concur with John on this and would like to share a few extras ideas to help "express" a more broadminded view on the topic.

(1) When I was a student at the Elder Conservatorium, I had on occasion in my first year, to feel out of place. My contemporaries; even the smallest Asian girl, could floor the audience with their devastating showmanship up and down the many octaves, and sight read at lightning speed. Such was the skill of my kinsmen.
I on the other hand, was fortunate to have been given the gift of playing by ear. For with this, I made the extra money needed to fund my education.
On a side note, there was an Australian band by the name of "Wedding, Parties, Anything", an apt title to describe the situation many bands/musicians find themselves in!

Anyway, I was under the impression that the ability to play by ear was the norm. Then one day, I discovered otherwise.
But, who was the more equipped to be expressive? Someone with the gift of improvisation (to make this assessment more ‘equal’, by improvisation I mean perform meaningfully by ear at a very high standard because of proper knowledge) or someone who had the intense training in interpretation and delivery but not the means to just "play something, anything?" without a score.
We all played from our hearts? We all managed to described that memory?
Can expressiveness be assessed? Can it be quantified and qualified?

(2) While writing for Singapore's premier Arts Magazine a few years ago, I had the honor of interviewing American Laurie Anderson, known as a pioneer in experimental performance who created such items as the tape-bow violin, the talking stick and some 'bizarre' multimedia performances.
"I love it when people experiment...what matters is not what it is made of, but how that musician is expressing himself/herself. An instrument can be a pencil, or a cell phone. If you have learnt to regurgitate rules you are not a musician but a technician. "
Here is a link to this article
http://electricmuse.com/reviews/artsmag_jan2002.jpg

Years after Ms Anderson mentioned music made by a cellphone, my intellect was tickled by news of the construction (2008) of an iPhone Orchestra by Stanford University Professor of Music, Ge Wang.
http://www.youtube.com/watch?v=ADEHmkL3HBg

(3) What is beauty expressed?
As we understand, every culture has its music steep in history, philosophy and function. We should hesitate placing our method of assessment on these lest we stumble upon our own inadequacies.
The oldest Chinese instrument, the GuQin, demands that its practitioner study in solitude to master such qualities as only the self could know; a philosophical journey to self-improvement and enlightenment. The sound that the GuQin gives out is extremely low in volume (I’ve tried piezo pickups to no avail), but the repertoire of inflections and the such, arms the player with expressive probabilities that do not require a mini skirt and stilettos to bedazzle.

(4) Extended Synth/KB techniques.
I spent a good part of the '90s in the IT industry promoting technology as a means to making your child "the next mozart" but, only quicker! You can even play music on your computer keyboard!
We were in danger of our kids having bad technique and missing out on a relationship with the real thing (much like our current situation with kids who have never seen bones on chicken nor fish with scales.)
We did produce a line of Music Edutainment CDs that provided a clever alternative by inserting subliminal teachings and having intelligent instruments/algorithms disguised as a game for kids.

As a final thought, I wanted to share an area of research I have pursued for years and which I incorporate in my live performance and studio work. It is known as Extended Synth/KB Techniques. It puts the power back into the hands of the performer and has ‘expressive’ capabilities that could blow your mind. A little light reading can be found here.
http://electricmuse.com/extkbtech_thesis_08.htm

Thank you John for allowing me to occupy your forum. We both agree that it is the man that maketh the music, not the tool. I could never coax music out of that leaf like my grandfather could when he blew on it.

John, you are a great musician and the best drummer in the WWW ; - ) It has been an honor to have you as the other half of Xenovibes! Looking forward to seeing the 3rd CD "Xing Paths" in our hands.