Tip:
Highlight text to annotate it
X
Step 1: Excute "3DBetaGame.exe".
This is main screen of "Pirates of the Caribbean" game.
Step 2: Run the "Gesture Recognition" Module. This module is developed using Matlab.
Call "Main" here for initing the "Gesture recognition" module
This is main screen of the "Gesture Recogntion" module
So let's start new game now.
Demo blue ship controls using mouse. NOTE: this game does not support controlling ship movements or attacking state using keyboards.
Click and .. run ^_^
Next: Demo game controls using "Hand gesture recognition". Press V for enabling this option.
Selection screen: Press ENTER.
Next: Demo using mouse control is now no more available. ^_^
Click, click and ... Nothing happens!!!
To control game, we must use gesture recognition. So go to the next step!
Step 3: Click SAMPLING for selecting the Region of Interest (ROI)
Next, click CLASSIFY for building a classifier from the selected region.
Finally, click "START" for beginning "Gesture recognition" progress.
Let's go. The first action is turn our ship to attacking state. This is done by "Five finger - left hand" and "Verticle right hand".
As you can see, the ship is now attacking its opponents!
Note that:The mouse cursor will not move since I don't use it. This also means that I'm controlling the ship using gesture recognition. ^_^
Next gesture: "Vertical left hand" combine with "Horizontal right hand - and moving left" for navigating our ship to the left.
Next: I try to navigate it to the left.
However, it seems I fail this time. :(
Let's try again. This time, navigate the ship to go DOWN.
This time I'll control the ship to the right by using "vertical left hand" and "horizontal right hand - moving right".
As you see, this is a little bug in our code, as well as, I've also just realized it since this test demo.
This bug does not happen when we use mouse for ship controls. So let's just skip it, since it's still a little bug ^_^.
Next, I'd like the ship to go down from its side. So let's start.
Now, I continue use "vertical left hand" together with "horizontal right hand - moving down" for this navigation.
As you see, this might be a mistake, since the ship turn right instead of go down as my gestures.
Futhermore, it turns to attacking state although I didn't plan to do that!
Maybe these are some bugs that we can't control when the ship moves outside the game board.
Game over. So I lose the game.
And this is also the end of our demo: Combining "Gesture Recognition" with "Game Applications".
In the future, we'll try to develop and optimize this gesture framework to increase its speed, accuracy and potential of applications.
Thank you for your attention! ^_^