Activity › Forums › Adobe After Effects › Is there an AE lip-sync plug-in yet?
-
Is there an AE lip-sync plug-in yet?
Posted by Stewart Goldstein on November 13, 2013 at 4:48 amIt takes forever to manually lip sync to eight or nine phoneme pictures. I have been doing the pre-compose/time remapping thing, but if there is a way to do this automatically based on the audio track, I’m open to suggestions!
Joachim Holler replied 11 years, 6 months ago 5 Members · 7 Replies -
7 Replies
-
Todd Kopriva
November 13, 2013 at 5:15 ammany ways:
https://provideocoalition.com/ryoung/story/lip_sync_in_after_effects/———————————————————————————————————
Todd Kopriva, Adobe Systems Incorporated
After Effects quality engineering
After Effects team blog
——————————————————————————————————— -
Erik Waluska
November 13, 2013 at 5:11 pmThere’s also an “auto lip sync” tool on aescripts that might be useful. I can’t personally vouch for it but it looks promising.
Erik Waluska
EAWmedia -
Jim Wilcox
November 13, 2013 at 5:11 pm -
Stewart Goldstein
November 13, 2013 at 8:27 pmI have seen most of these techniques, but it looks like the only only that will suit what I have in mind is Papagayo. Unfortunately, Papagayo won’t work on Mac OS 10.8.
Is there anything else out there where I can create a handful of phoneme mouth images have have them play according to the audio track?
-
Erik Waluska
November 13, 2013 at 8:39 pmThere are a few Cow tutorials on lip sync
This tutorial from Aharon Rabinowitz might be just what you’re looking for.
BTW, have you checked out ToonBoom? I’ve not used it but it looks really easy.
Erik Waluska
EAWmedia -
Stewart Goldstein
November 13, 2013 at 10:07 pmYes, I am familiar with this tutorial. I have been using this very technique for quite some time, but I was hoping there was a way to automatically display the phoneme images based on the audio track.
-
Joachim Holler
October 16, 2014 at 4:59 pmI know this one is a little old, but,
yes, finally there is! It’s called ‘lipsyncr’ and it does exactly what you described. (I am one of the developers.) In contrast to the other script mentioned, it does actual speech analysis to create viseme–based animations, just like you would with the manual method.
I don’t want it to look like I am mounting the cow for advertising, so if you are interested, you will find all the infos you need on the web!
Reply to this Discussion! Login or Sign Up