Exploring AI-Driven Audiovisual Art with TouchDesigner Mastery

Exploring AI-Driven Audiovisual Art with TouchDesigner MasteryExploring AI-Driven Audiovisual Art with TouchDesigner Mastery

The network for creativity

Join 1.25M professional creatives like you

Connect with clients, get discovered, and run your business 100% commission-free

Creatives on Contra have earned over $150M and we are just getting started

Back to feedPost

Mariano Zhao

• 1d

Generative Audiovisual Experiment | AI + TouchDesigner

Hey guys! I’m excited to share my latest project where I explored the synergy between Generative AI and real-time visual programming.

I used AceStep1.5 and ComfyUI to generate the initial AI music and video assets, then integrated them into TouchDesigner for the final production. Technically, I leveraged the NVIDIA Background TOP and Face Track TOP for seamless real-time matting and tracking.

The visual distortion is entirely driven by the music’s DNA—splitting the audio into bands (Kick, Snare, and spectral ranges) to modulate the intensity of the displacement. This project is a testament to how AI-generated content can be "re-conducted" through real-time creative coding.

🔊 Sound on for the full experience!

ComfyUI TouchDesigner Art Direction Art Creative Strategist DaVinci Resolve

Paula Gibert

• Mar 2

I’ve always been fascinated by synesthesia and how some people can actually see sound as color.

I wanted to explore that idea through interaction design, so I built Chroma, a piano that paints while you play 🎹 🎨

Each note is mapped to a color based on its frequency, gradually generating a living artwork in real time and turning music into visual composition.

The intention was to make generative art approachable, exploring synesthesia through play.

This was my first time experimenting with vibe coding using Figma Make, and honestly I had a lot of fun making it!

Would love to hear your thoughts if you try it: https://shove-drone-97143790.figma.site/

figmamakeathon

Rezmaeee

• Mar 3

i love this

Iñigo Hernández

pro

• Mar 2

What if drawing WAS music? I built FORMLESS, a gestural drone synthesizer where every stroke you draw on a canvas becomes a living sound. No keyboards, no sequencers, just your fingers and a blank screen. Try it: https://formlessound.figma.site/

It runs 8 synthesis engines (sine, sub, saw, crystal, grain, noise, flutter, metal) with up to 24 simultaneous voices, real-time filter/reverb/LFO modulation, scale & root selection, and WAV loop recording, all pure Web Audio API, zero audio libraries. Works on desktop, tablet, and mobile with full multitouch. Figma Community: https://www.figma.com/community/file/1610276245620519159/formless-drone-designer X link: https://x.com/sequencist/status/2028440554275528925

figmamakeathon