from Hacker News

Using hand gestures and voice commands to control a 3D data visualization

by getToTheChopin on 5/29/25, 6:47 PM with 2 comments

  • by sargstuff on 5/30/25, 1:51 AM

    4d sudoku!

    ?? side list of selectable group colors

    ?? verbal "set operators" (intersection, difference, union,symetric difference) based on verbally selected item tag names vs. "hand pick" color group/group items to perform set operation.

    "blinking" objects/object connectors involved in set operation. Results forming new "color group" of copy of originals vs. moving originals into group per set result. ??

    Associate color/group with "gravity well" spot.

  • by getToTheChopin on 5/29/25, 6:47 PM

    Created using threejs, mediapipe computer vision, web speech API, and Vasco Asturiano's 3D-force-graph library