🎵 Play Musical Notes with Hand Gestures (Sound ON!) Check out the project: 👉 Builder.io Entry (...

🎵 Play Musical Notes with Hand Gestures (Sound ON!) Check out the project: 👉 Builder.io Entry (...🎵 Play Musical Notes with Hand Gestures (Sound ON!) Check out the project: 👉 Builder.io Entry (...

The network for creativity

Join 1.25M professional creatives like you

Connect with clients, get discovered, and run your business 100% commission-free

Creatives on Contra have earned over $150M and we are just getting started

Back to feedPost

Kirill Pronin

• Nov 19

🎵 Play Musical Notes with Hand Gestures (Sound ON!)

Check out the project: 👉 Builder.io Entry (Mouse & Touch experience — don't forget to click the pads!) 🚀 Live Demo on Vercel (Full Camera + Audio experience)

Hi! 👋 I’m Kirill from Berlin. Video processing seemed hard, so I asked AI to help, and built this in just two prompts! It generated the functional prototype, letting me focus on the design.

How: 100% local (MediaPipe + Web Audio). Zero latency & privacy.

Note: Builder.io iframes block cameras. Use the Vercel link for the full experience!

builderchallenge builtwithfusion

Stanislav Pogorskii

• Nov 19

For me, as someone who has no musical education, it was surprisingly to get caught up in the process. I even made something catchy (no proofs will be provided haha). Tracking accuracy is pretty spot on!

Christina A. Reed

• Nov 19

This makes me think of the movie, Minority Report from 'back in the day' and you made the technology come to life in 2025. Well-done! :)

Kirill Pronin

• Nov 20

Thanks a ton for the awesome comment <3 ! Old movie aesthetic 🔥 – interfaces were just blank canvases back then, before all the standard corporate computer interactions. Definitely rewatching it this weekend! :)

Christina A. Reed

• Nov 20

Yeah, I remember how antiquated computers were back then. Lol However, I think I was more specifically thinking of when Tom Cruise in the movie does some interactive hand gestures in the air to interact with some sort of government computer system. Here is clip from what I was...

Christina A. Reed

• Nov 20

Oh & you are very welcome!! .. Super cool project! :)

Rizki Arsyad

• Nov 19

Pretty good!

Rita Digore

pro

• Nov 21

this is the coolest thing ever, i love lightning mode, so much fun

Kirill Pronin

• Nov 21

Thanks! It's always really nice to do something just for fun, even if it's not very useful. Although I'm already thinking it would be cool to implement such a navigation feature on one of the projects.