Creative Communities of the World Forums

The peer to peer support community for media production professionals.

Activity Forums Creative Community Conversations Will your microphone be a bag of potato chips someday? Maybe….

  • Will your microphone be a bag of potato chips someday? Maybe….

    Posted by Bill Davis on August 5, 2014 at 2:02 am

    MIT (the school) is doing some interesting research on recovering audio from VIDEO files of objects.

    They’re researching reading the microscopic sympathetic vibrations on surfaces of objects like chip bags with an eye to someday recovering the audio sounds from the video files.

    Sounds like Science Fiction?

    Maybe not.

    https://www.youtube.com/watch?v=FKXOucXB4a8

    Know someone who teaches video editing in elementary school, high school or college? Tell them to check out http://www.StartEditingNow.com – video editing curriculum complete with licensed practice content.

    Some contents or functionalities here are not available due to your cookie preferences!

    This happens because the functionality/content marked as “Google Youtube” uses cookies that you choosed to keep disabled. In order to view this content or use this functionality, please enable cookies: click here to open your cookie preferences.

    Scott Thomas replied 11 years, 9 months ago 9 Members · 13 Replies
  • 13 Replies
  • Walter Soyka

    August 5, 2014 at 3:11 am

    Great! Now I understand why we need 8K video!

    Walter Soyka
    Designer & Mad Scientist at Keen Live [link]
    Motion Graphics, Widescreen Events, Presentation Design, and Consulting
    @keenlive   |   RenderBreak [blog]   |   Profile [LinkedIn]

  • Dennis Radeke

    August 5, 2014 at 10:16 am

    Adobe was involved in this research as well. I posted the article link to my twitter feed yesterday

    https://twitter.com/dradadobe/status/496402301578674177

  • Jeremy Garchow

    August 5, 2014 at 12:27 pm

    So, is it safe to say that the technology is all that, AND a bag of chips?

  • Ronny Courtens

    August 5, 2014 at 12:58 pm

    So you need a 80,000 dollar high-speed cam to be able to recover audio that you could simply have recorded with a cheap microphone? Now that’s what I call progress!

    – Ronny

  • Bret Williams

    August 5, 2014 at 1:10 pm

    New meaning to we’ll fix it in post.

  • Walter Soyka

    August 5, 2014 at 1:32 pm

    All kidding aside, it’s cool research.

    I wonder how much spatial and temporal resolution you’d need to measure the differences in vibrations across objects in different locations in space to get visual sonar-assisted roto or keying.

    Walter Soyka
    Designer & Mad Scientist at Keen Live [link]
    Motion Graphics, Widescreen Events, Presentation Design, and Consulting
    @keenlive   |   RenderBreak [blog]   |   Profile [LinkedIn]

  • Jason Porthouse

    August 5, 2014 at 5:00 pm

    Interesting ramifications for the surveillance state there – high speed high-res cameras able to convert any object into a microphone… *gets tinfoil hat*

    Seriously bloody clever though.

    _________________________________

    Before you criticise a man, walk a mile in his shoes.
    Then when you do criticise him, you’ll be a mile away. And have his shoes.

  • Bret Williams

    August 5, 2014 at 6:11 pm

    Coming to an episode of CSI in the near future no doubt. After they first zoom in and “enhance” the image to see how many freckles a particular person in a crowd has they’ll convert the visual sound waves vibrating off their nose hairs to see if it matches a voiceprint from an enhanced background conversation over a cell phone.

  • Bill Davis

    August 5, 2014 at 7:50 pm

    [Bret Williams] “they’ll convert the visual sound waves vibrating off their nose hairs to see if it matches a voiceprint from an enhanced background conversation over a cell phone.”

    New audio technical term ahead: Signal to nose ratio.

    Know someone who teaches video editing in elementary school, high school or college? Tell them to check out http://www.StartEditingNow.com – video editing curriculum complete with licensed practice content.

  • Mark Suszko

    August 5, 2014 at 8:16 pm

    “I wonder how much spatial and temporal resolution you’d need to measure the differences in vibrations across objects in different locations in space to get visual sonar-assisted roto or keying.”

    -Walter Soyka

    I think we’ll be seeing something like that pretty soon,based on the same technology used in the Lytro variable-post-focus still cameras, and/or IR beams picked up by the camera lens and the same sensor that images the visible light.

    You won’t need green or blue screens any more: just a foot or so of separation distance between discrete elements in your composition, and you will be able to key out independent elements based on their distance from the screen. Eventually, it will also work in realtime, not just post. The computational power to achieve this is rapidly approaching.

Page 1 of 2

We use anonymous cookies to give you the best experience we can.
Our Privacy policy | GDPR Policy