from Hacker News

The Visual Microphone: Passive Recovery of Sound from Video

by csom on 3/24/15, 2:57 AM with 38 comments

  • by jsprogrammer on 3/24/15, 6:06 AM

    Patent pending? The approach should be trivially obvious for anyone familiar with the basics.

    What happened to the MIT License and liberating knowledge, does MIT not do that anymore?

  • by kaoD on 3/24/15, 3:14 AM

  • by downandout on 3/24/15, 12:01 PM

    Well that's pretty scary. I can see one application of this already: casinos in the US are legally prohibited from recording audio on their floors, but have perfectly positioned cameras everywhere. Beyond that, I'm guessing every spy agency on earth will be buying solutions based on this.

    It would be interesting to know what the genesis of this project was - for example if the NSA or CIA was involved in suggesting to a professor that MIT take a look at this area. This is a very mission-specific technology.

  • by catshirt on 3/24/15, 6:53 AM

    could you do it the other way around?

    how accurately can we recreate a 3d space from sound? what assumptions/information would you need to make it more accurate?

  • by blt on 3/24/15, 3:32 PM

    William T. Freeman is an outstanding vision researcher. His list of publications (http://billf.mit.edu/publications/all) is full of these simple, clever solutions for problems slightly outside the mainstream. I really admire his work.
  • by yshalabi on 3/24/15, 1:04 PM

    Rubinstein was also behind the work on using pixel intensity variations to visualize... stuff. They used it to extract heart rates. I am guessing sillier methods used, but now to recover induced vibrations due to sound. Interesting work.
  • by baldfat on 3/24/15, 3:04 PM

    Someone give this to the writers of crappy TV that uses the enhanced photo line I am sure they will flip out at the whole new story lines created by this.

    CSI has forever been changed. Bet you it is on next season on multiple of TV crime shows.

  • by sjtrny on 3/24/15, 4:20 AM

    This is an interesting extension of the ideas from this paper by the same author/s http://people.csail.mit.edu/mrub/vidmag/.
  • by Animats on 3/24/15, 3:53 AM

    They're making progress. At 5000 FPS, it's not surprising that they can recover audio. But from 60 FPS, that's striking. That works because some imagers don't take the whole frame at once.
  • by yummybear on 3/24/15, 2:04 PM

    I wonder how this would perform on iPhone 6's (or others) high speed camera.
  • by Naushad on 3/24/15, 3:46 PM

    Slowly, the creative imaginations coming to life. Eagle Eye....