concept: physically and functionality modular, multi-input controllers with visual feedback and dynamic sensor data output. Manipulating video, sound, or anything digital is possible with LightBox, and when using more than one simultaneously, group interaction and collaboration is possible, as the controllers themselves are wirelessly networked. project post-mortem paper here.
Here is a not-so-revealing video of one mothercube and one daughtercube (all i had the time and money to build), being run through a theremin-emulator max patch. I have written a sampler patch and video controller in jitter, I will document these soon enough (making sure you can see my hands) and then post the patches.
***I apologize that you cannot see my hands, however they are controlling the pitch of the sound based on how close they are to the cubes — very similar to how a theremin works***
Essentially, frosted plexi-glass cubes with IR range finders and one single button (capacitance [touch] sensor). The sensors are being powered and read by an arduino, and then processed in Max/MSP/Jitter. I used the PDuino firmware for that connection. What I was hoping to acheive also, was one array of LEDs sensitive to the IR (you’ll see in this video, only the touch changes the color). I worked on using a TLC5940 LED driver run by a PIC16F88 microcontroller, but was never completely successful. In fact it was quite frustrating, to the point that i gave up on it for the moment.
Here are some images of the process:
Left to do now is finish the wireless aspect, between the two cubes. Then more patching.