Play Fruit Ninja PC version with Kinect

Since we are very closed to finish the final project, I spent a little time to write a mouse control program to play the Fruit Ninja, the cursor runs pretty good. I use right hand push movement to simulate pushing the mouse's left button, and use left arm lift movement to simulate releasing the mouse's left button, here is a video I made tonight. Enjoy!

http://www.youtube.com/watch?v=zd7dl1Ko0s4&feature=youtu.be

Success!

Tonight we had our first successful run of the Kinect teloperation of our manipulator! We passed direction data of the human user into Matlab, then opened up the M2 microcontroller as a serial device. Then we could easily control the arm with the timer outputs. Here's a video of the first voyage of the Kinect Teleoperator.

Communications

To send wireless signals from the Kinect processing unit to the manipulator we decided to use an M2 MaEvArM.  These are very compact microcontrollers with wireless add-ons that have a 16 MHz processor, multiple timer outputs, ADC inputs, and GPIO pins among a number of other nice features.

We chose this microcontroller so we could control the 5 servo motors of our manipulator with five independent timer output signals.  The wireless communication is also very simple because this microcontroller was meant for use in many MEAM classes at UPenn.