from Hacker News

Designing a shader using voice and hand gestures

by getToTheChopin on 6/19/25, 12:51 AM with 1 comments

  • by getToTheChopin on 6/19/25, 12:51 AM

    This is a computer vision experiment, using voice + hand gestures to control a shader animation.

    This uses a liquid Chladni pattern, with controls for color and wave frequency / amplitude.

    Created using threejs, mediapipe computer vision, and web speech API.