Sonic Gesture prototype uno
Below is a screen capture of my first prototype for translating gestures into sound. Left hand controls pitch, right hand controls Frequency Modulation. Note that this is real time, and without prior knowledge about skin color. Skin color is extracted from my frace. Want to know more? Check out the source code from the project site
Translating Gestures into Sound
This month I'm starting my graduation project for my Master. I will research the possibilities of translating sign language into sound, and implement this. I made a Google Code project for this, where you can keep track of my progress.
here you can see a preview of the first step of the project:
Ubuntu Karmic packages for OpenCV 2.0
OpenCV 2.0 has been unexpectedly released not so long ago, but it wasn't included in Ubuntu Karmic. Luckily it is already included in Debian sid and 'porting' packages from Debian to Ubuntu is quite trivial.
I've ported these packages to Ubuntu and uploaded them to a Ubuntu Personal Package Archive. Instructions on how to use these packages are supplied on the PPA page, but in short you should add ppa:gijzelaar/opencv2-karmic to your system's Software Sources.
have fun!
Bike
I'm doing the course Electronic Music Composition II at CREA for more than 2 months now. I really enjoy taking this course. Also it is a boost for my productivity. I actually finished a song! Well actually, I still think it needs a little bit of work so maybe I'll improve it this week. But you can listen to it already.
Getting video i/o working with opencv and Ubuntu Jaunty (9.04)
I was disappointed, crying, screaming, running around angry and banging my head against the wall when the video i/o functionality stopped working when I updated to the latest Ubuntu release (Jaunty). But since this is a open source world, I fixed this problem myself. Gentoo actually fixed this bug 1.5 year ago, so I used that patch and did some modifications.
If you are as frustrated as I am, don't seek any further. I made a Launchpad PPA for this new OpenCV package. I changed the includes to the new location and replaced the img_convert() function with the gentoo code as example. To install my packages open a console and run:
sudo apt-key adv --recv-keys --keyserver keyserver.ubuntu.com cafc44ee7f39098ce6ec229cca70e6a9087475a0
after that add the following line to your /etc/apt/sources.list:
deb http://ppa.launchpad.net/gijzelaar/opencv/ubuntu jaunty main
After running a apt-get update you can install all the opencv packages, and they actually work.
By the way, if you use Python and OpenCV I advise you to check out the ctypes version of the python bindings. You can install them from my opencv repository by installing the python-opencv-ctypes package.
If you have any tips, comments or whatever please let me know in the comments.
Webcam and OpenCV
I already did some stuff with Open CV, but now my university gave me the opportunity to play some more with it by giving me some new home exercises for Advanced Multimedia Computing. One of the exercises is to make a webcam piano. here is my not yet 100% finished (and probably it will never be) result, but still it is nice to show.
made on my new fancy MacBook. I'm such a fanboy now. By the way, I use OpenCV + Python (ofcourse). The standard python modules supplied with OpenCV quite suck big time, the ctypes opencv python modules is much better. I made Ubuntu packages for it and put them in a launchpad PPA. Feel free to try them out and let me know if you encounter something strange.
long time no see
It has been a while that I wrote something here, and that has multiple reasons. First of all I'm just very busy. I started the master Artificial Intelligence at the University of Amsterdam in September, and this is taking a lot of my time. I even didn't create any new music anymore since September. But I'm doing a lot of cool AI things now, so it is worth it. I did some object tracking in video using mean shift. Here are some results:
I've removed the history of blog posts from my website, but since most of them where not read anymore I don't think anybody would mind. So if you are redirected to this post because you where searching for something, sorry.