OmniLearn — be the hero of your own story, literally

OmniLearn is a body-controlled learning game for kids aged 4–7. A child stands in front of any webcam, gets scanned, and becomes a soft-voxel 3D avatar of themselves that they control with their body — no controller, no keyboard. They solve educational challenges by MOVING: catching falling leaves to count (the golden ones worth three), and crossing "Vowel River" by grabbing the animals whose names say the long-A sound.

THE PROBLEM Kids this age learn by moving, not by reading — but most educational software sits them down to tap a screen. OmniLearn flips that, and it speaks to the child so they can play before they can read. It runs on what's already at home: a laptop webcam, no special hardware.

BUILT ENTIRELY IN FIGMA

The app lives inside Figma Make — screens, flow, and game logic.

Every soft-voxel creature, world, and the avatar were designed in Figma Weave as a reusable asset workflow.

The engine — MediaPipe pose tracking (33 body landmarks, in a web worker) and a three.js avatar that mirrors the child in real time — I wrote and wired into the Make project's code by hand. Soft-voxel was a deliberate choice: rigid rounded chunks make the rig trivial and never deform.

Voice lines are pre-generated TTS; everything else is synthesized SFX.

THE VISION This demo is one polished journey — but OmniLearn is built to teach ANY subject. The same body-as-controller engine works for math, language, history, science, logic. In the full product, worlds and challenges are generated ON DEMAND and adapted to the exact age and level requested — today's worlds are hand-built, tomorrow's are infinite. Every child gets a curriculum that meets them where they are.

PRIVACY 100% on-device. The child's camera feed never leaves the browser — nothing uploaded, nothing stored.

LINKS Live demo: https://meta-rover-70928932.figma.site/ Community file: https://www.figma.com/community/file/1649688792758544694/omnilearn-body-controlled-learning-game Social post: https://x.com/astroph0s/status/2067859955781128419

#ConfigMakeathon