Creative Communities of the World Forums

The peer to peer support community for media production professionals.

Activity Forums Adobe After Effects Is there an AE lip-sync plug-in yet?

  • Is there an AE lip-sync plug-in yet?

    Posted by Stewart Goldstein on November 13, 2013 at 4:48 am

    It takes forever to manually lip sync to eight or nine phoneme pictures. I have been doing the pre-compose/time remapping thing, but if there is a way to do this automatically based on the audio track, I’m open to suggestions!

    Joachim Holler replied 11 years, 6 months ago 5 Members · 7 Replies
  • 7 Replies
  • Todd Kopriva

    November 13, 2013 at 5:15 am

    many ways:
    https://provideocoalition.com/ryoung/story/lip_sync_in_after_effects/

    ———————————————————————————————————
    Todd Kopriva, Adobe Systems Incorporated
    After Effects quality engineering
    After Effects team blog
    ———————————————————————————————————

  • Erik Waluska

    November 13, 2013 at 5:11 pm

    There’s also an “auto lip sync” tool on aescripts that might be useful. I can’t personally vouch for it but it looks promising.

    Erik Waluska
    EAWmedia

  • Jim Wilcox

    November 13, 2013 at 5:11 pm

    Great script from Mamoworld at:

    https://mamoworld.com/tools/auto-lip-sync

  • Stewart Goldstein

    November 13, 2013 at 8:27 pm

    I have seen most of these techniques, but it looks like the only only that will suit what I have in mind is Papagayo. Unfortunately, Papagayo won’t work on Mac OS 10.8.

    Is there anything else out there where I can create a handful of phoneme mouth images have have them play according to the audio track?

  • Erik Waluska

    November 13, 2013 at 8:39 pm

    There are a few Cow tutorials on lip sync

    This tutorial from Aharon Rabinowitz might be just what you’re looking for.

    BTW, have you checked out ToonBoom? I’ve not used it but it looks really easy.

    Erik Waluska
    EAWmedia

  • Stewart Goldstein

    November 13, 2013 at 10:07 pm

    Yes, I am familiar with this tutorial. I have been using this very technique for quite some time, but I was hoping there was a way to automatically display the phoneme images based on the audio track.

  • Joachim Holler

    October 16, 2014 at 4:59 pm

    I know this one is a little old, but,

    yes, finally there is! It’s called ‘lipsyncr’ and it does exactly what you described. (I am one of the developers.) In contrast to the other script mentioned, it does actual speech analysis to create viseme–based animations, just like you would with the manual method.

    I don’t want it to look like I am mounting the cow for advertising, so if you are interested, you will find all the infos you need on the web!

We use anonymous cookies to give you the best experience we can.
Our Privacy policy | GDPR Policy