Programming for Artists, Term 1, Eleanor Dare
Motion-Responsive Melodic Improviser (Phase 1)
I was already familiar with the programming concepts taught in this module, so I decided to spend the time working on the creative side. I built a 'video-motion-capture music-improvising system'... (if you like).
What that means is that you walk in front of a camera, the system watches and interprets your movements somehow as sound, specifically as midi notes.
I hadn't done anything remotely like this before and as much as anything was just looking forward to the chance to see what motion-capture was all about. Another big motivation is it would mean I have to 'teach' a computer about music, which would force me to go through in detail what can be quite a dry subject when considered theoretically.
Here, you can find documentation / files relating to the project:
- Proposal (opens in new window) - What I wanted to do and why
- Timetable (opens in new window) - When I intended to reach given milestones
- Blog (opens in new window) - An informal record of what actually happened
- Source Code / Files - It, itself (please see the readme)
And ofcourse, the video demo below, which gives you a quick idea of where the project is at:
The video isn't a fantastic performance (!), but it gets over the idea of where things are at. Movement in the high areas are interpreted as firsts, fourths and fifths, and in the low area as seconds, thirds and fourths.
It uses a kind of weighted randomisation at the moment, so it is always possible to get unexpected notes. I think that is something I am going to change.
The system is in it's early stages, and i'm getting ready in the second term to make more of this project. I have plans to refine the system's approach to interpreting movement to make it more consistent with human behaviour. And, more importantly, to hook it up to software synths and tweak the output. As well as to teach the system more about music, and different methods of playing.