Teach-a-Robot
Show the robot a thumbs-up. Show it a fist. Then watch it guess, and play a game with your hands.
Waking up the robot's eyes (downloads once, about 1 MB)…
Step 1 · Show it examples
Name each thing. Then hold the button while you show it to the camera. Move a little so it sees many angles. About 20 pictures each is good.
Step 2 · What does it think?
Show the camera one of your things. The robot compares it with every picture you taught it and picks the closest.
Was the robot right?
0 of 5 right
The robot is not sure (under 60%). Did you show it enough examples? Try more, in different light, from different angles.
Step 3 · Your hands are the controller
Help Coco dodge. Show Thumbs up to jump over rocks and Fist to duck under branches. Dodge 5 to earn your badge.
- nothing yet0
The robot never sees a "thumb". It only stores these pictures and compares.
Each camera frame is squeezed into a list of … numbers by a small pre-trained network called MobileNet. Big robots use 1024 or more. Similar pictures make similar bars.
It finds the 5 stored fingerprints closest to this one and lets them vote. That is called k-nearest neighbours.