Skip to content
Book a Call → mycocoon.life
👀Level 1 · Caterpillar

Sight & Sound Lab

Computers have no eyes and no ears. They have numbers. Let's see what that looks like.

⭐ Level 1 of 12🏅 Eye & Ear🧠 How computers see
⭐ Level 1
💡
You'll learn: a computer sees numbers, not pictures. And it hears numbers, not words.
⬜ 1 drawing guess⬜ 1 sound capture

Draw something

A cat, a house, a sun. Big and simple works best. Then ask the computer what it sees.

🪙 Drawing costs 0 coins, it runs on YOUR computer
🤖 the computer saysDraw first, then tap "What did I draw?"

The computer never sees your drawing. It sees this. Every picture becomes a grid of numbers first.

1 · Numbers (28 × 28)

Your drawing squeezed to 28 by 28 squares. 0 = white, 9 = black. That is 784 numbers.

2 · Edges

The computer looks for places where the numbers change fast. Those are edges. Shapes are made of edges.

3 · What it keeps

Same 784 numbers, coloured. Dark blocks matter, light blocks are ignored. This is all it has to guess from.

0 🪙 · runs on your computer

…or point the camera

A small robot brain called MobileNet lives inside this page. It knows 1000 kinds of things. Show it a cup, a shoe, a banana.

🪙 0 coins · stays on your device
Camera is off
Top 3 guesses
start the camera to see guesses

Make a sound

Tap the microphone and talk, clap or hum. The wobbly line is your sound turned into numbers, thousands every second.

🪙 0 coins · nothing is recorded or sent
checking…
Words the computer hears will appear here.

How sound becomes words

〰️
1 · WaveThe microphone measures air pressure 44,100 times a second. Just numbers.
→
▮▮▮
2 · ChunksThe wave is cut into tiny slices, 20 ms each, and each slice becomes a pattern of sound colours.
→
💬
3 · WordsA model that heard millions of voices guesses which sounds make which words.

Some of the numbers right now (the first 40 of 2048 in this slice, … samples a second):

start listening to see them

The word guesser is your browser's own. Language set to en-GB. It works better when you speak clearly and close to the mic.

⭐ You will discover…

💡A computer sees numbers, not pictures.
🏅The Eye & Ear badge
🧠How computers see
🐱 Try this in Scratch →
Ready for the next challenge?Teach-a-Robot →
Copied ✓