Laptop Music Performance And Art Installation System
Developed by The Knobs, Division of C505 and NTET Music

 

For performances and installations, The Knobs have developed a custom software system called “Casket” which allows us to control video, 3-d environments, and motion graphics being run on one computer, from an advanced audio signal processing program on another computer.

 

 

SAMPLE LIVE PERFORMANCE SETUP DIAGRAM

PERFORMER A:
LEAD AUDIO INSTRUMENT
/REMOTE CONTROL

Custom software written in SuperCollider synthesizes audio and manipulates prepared samples based on input from a Wacom tablet. The software is able to determine a number of parameters describing the state of the tablet, which are used to control the synthesis of the sound, and are also passed along to the VISUAL SERVER using a new network protocol for music systems called Open Sound Control (OSC).

*Click here to read more about this software.*

VISUAL SERVER

The video playback system on the VISUAL SERVER was written in Macromedia Flash. This Flash movie listens for incoming XML-formatted data on port 3000 from PERFORMER A, parses it into a basic object structure using FLOSC (a Java server that communicates with Flash) and performs a series of actions within a Flash movie based on the incoming parameters.

PERFORMER B:
SUB AUDIO INSTRUME
NT

Audio OUTPUTS generated by an audio/sequencer program is analyzed by PERFORMER A’s custom software for a few simple properties. Then the result of this analysis is sent to the VISUAL SERVER to control selected elements of the video OUTPUTS.

 

To communicate between PERFORMER A and VISUAL SERVER, Casket uses a new network protocol for music systems called Open Sound Control (OSC). Developed at UC Berkeley, OSC is much more powerful than the aging MIDI protocol. It allows a musical instrument to send customizable control information of any type (string, number, Boolean, array, etc) to a computer at a pre-defined IP address and port. In Casket, a custom program written in Supercollider running on PERFORMER A’s computer OUTPUTSs OSC-formatted data to the IP Address of the VISUAL SERVER at a certain port. The VISUAL SERVER runs a very lightweight java application that listens for all incoming messages on the OSC port (port 1250 in this case) and re-formats them as XML before OUTPUTSting them to an open network socket on a different port (in Casket, port 3000). Our flash movie (also running on VISUAL SERVER) listens for incoming XML-formatted data on port 3000, parses it into a basic object structure and performs a series of actions based on the incoming parameters.

What sets Casket apart from other audio and visual live presentation systems is that this is a very flexible and expandable system which takes advantage of a rich new network protocol to create dynamic audio and video that has a relationship that transcends the audio visualization norms.

Casket also makes it possible to develop distanced remote systems. For example, though this system was originally developed for live performance situations, we are planning to automate some tasks by replacing the human performance aspect of the system with live internet traffic monitoring engine which was used in our Prototype #38 for Whitney Arport. In another words, traffic on the internet controls the system, and creates a spontaneous live audio and visual presentation on its own. Once configured, the system will require very little maintenance, making it perfect for art installation applications.


Live in Sapporo, Nov 2003
QUICKTIME 240x180 - 3.2MB

Sample Movie
[Quicktime, 320x240, 17.5MB]

In this 2 minute and 18 second sample, video loops are triggered by wacom tablet input to create this sequence. This video is comprised of two layers. The pressure of the pen controls the opacity of layer one. The angle of the pen controls the opacity of layer two. The position of the pen determines which video loop is played.

 

We are available to perform or create an installation with this system. Email us.

 

Concept: Sean Rooney, Yoshi Sodeoka
SuperCollider Programming: Sean Rooney
FLOSC Programming: Ben Chun
Video and Graphic: Yoshi Sodeoka, Matthew McGregor Mento

 

©2003: C505 and NTET Music