Creative Communities of the World Forums

The peer to peer support community for media production professionals.

Activity › Forums › Adobe After Effects › Looking for a program to RT Lip sync

  • Looking for a program to RT Lip sync

    Posted by Jesse Combs on February 12, 2009 at 6:40 pm

    I’ve seen and heard of a RT process of lip syncing or animating using video input information and a 2d animated charecter and having the person through video effect the charecters animation. Ex. The Real life model Raises his eyebrow in Real life and in Real time this information on a computer moniter has it so it moves the chrecters eye brow as well. It was not a motion capture suit or procedure. Any clues?

    Mark Suszko replied 17 years, 7 months ago 2 Members · 1 Reply
  • 1 Reply
  • Mark Suszko

    February 13, 2009 at 10:01 pm

    It is machine vision and real-time motion capture. I have seen software that uses a camera shot closeup on your lips or face to recognize changes and drive a model face in real time, but I can’t remember a name off the top of my head. Try looking for a link to this stuff on turbosquid. They probably advertise there.

    There are also systems that use puppeteering techniques. These are all pretty spendy.

    On the lower end, what some folks do is use a MIDI keyboard or keybad with assignable functions, like those for WOW or CAC video games, or even custom apps for wii controllers, and assign a key or motion to each “muscle” of the model, to “play” it in real time.

We use anonymous cookies to give you the best experience we can.
Our Privacy policy | GDPR Policy