from Hacker News

Controlling a 3D graph with hand and voice commands

by getToTheChopin on 5/26/25, 4:54 PM with 1 comments

• by getToTheChopin on 5/26/25, 4:54 PM

  Using speech recognition to toggle between drag / rotate / zoom interactions, and hand gestures to move the nodes of the graph

  Created with threejs, rosebud AI, mediapipe computer vision, web speech API, and Vasco Asturiano's 3D-force-graph library

  Runs in real-time in the browser using a regular laptop + webcam

  Live demo (works best on chrome desktop): https://rosebud.ai/p/557dbe2b-b037-42df-a137-249f8a57341d