As Inti Einhorn mentioned in his presentation (which was great, man--I've had several conversations based on it in just the past couple of days,) getting the Wii to work requires training. That'll be true of anything we build, too, especially w/r/t anything gestural.

With that in mind, I would strongly recommend that we look into neural networks as a way to train the machines. It sounds a little intimidating, but it really isn't. In fact, it ties in very closely to the reading about logic gates we've been doing so far.

IBM has a pretty good introduction to NN. In particular, read Threshold logic units (TLUs) and How a TLU Learns. The rest is pretty math heavy--though it's still good reading, if you're up for it. You can recreate AND, OR, XOR, etc. gates using neural networks pretty easily.