-
Lip Synch in AE
Hi, Guys,
Right now I am teaching a class in animation in which we are using AE to create cardboard cutout style animations (think South Park). I need a means of lip synching the vocal tracks with moving “lip layers” for the characters that isn’t as rigorous as synching individual syllables. I sense that the solution involves using expressions linked to a waveform and/or the Trapcode Sound Keys Plug-In (which I am not very familiar with). Can anyone help with a solution?
Thanks,
Jabbar Thomas -
4 Replies
-
i use sebi talker : i do a loop with 4-5 mouth positions, and after that, i manually put the silences where it’s needed, and some visible sounds too ( a long “o”, an expressive “i”)… i really did it a lot of time, and it works good. You really don’t need to be perfectly synchronous with each phoneme …
-
Click on Aharon Rabinowitz’s head and watch his Lip Synch tutorial. It may help you (a lot).
Good luck!
Justin Productions
Tangerin01@hotmail.com
Adobe After Effects 6.5 Professional -
Have you seen Aharon’s tut, Lip-Synching Characters in AE? Click his head and scroll down to near the bottom. He matches mouth shapes with phonemes.
To get a transform or an effect to be driven by an audio layer, select the audio layer then Animation>Keyframes Assistant>Convert Audio to Keyframes. A new layer, Audio Amplitude appears. “E” reveals the left, right and Both channels, twirl down one of then we’ll pickwhip to this later.
Audio Drives Scale
To have audio drive Scale, Alt Click the Scale stop watch lips layer and pickwhip (looks like an @) to the slide for the left channel (audio amplitude layer) you opened before. Now audio drives the scale, if it’s not enough you can “*4” to the end of the expression and it is 4 times larger, “/4” divides by four and the scale will be 1/4 what it was. Adjust to taste: Here is an Adobe tut that walks you through it:
Using Music to Animate Texthttps://studio.adobe.com/us/tips/tip.jsp?p=1&id=396&xml=aft6audio
Audio Drives Split Amount of lips layer
For talking characters, a corny (hey, one persons corny is another persons charming) but quick method is to , then tie it with an expression (Alt Click the CC Split 2>Split 2 stopwatch, then pickwhip to the Audio Amplitude Layers Effect, (pick a channel) say left channel. Now the audio drives the split amount.) Actually you apply it to both Amounts, with the lower lip getting a *4 (means times four), so it will be 4 times larger than the upper lip. Oh, yeah, position the corners so their at the corner of the mouth, and you need a interior mouth layer underneath because Split rips open the layer, exposing what’s underneath. You can also use CC Split 1, it opens both lips equally.You can also use audio to offset the low lip layer as the character speaks (to Y only) ala Monty Python.
Here is an expression from pickwhipping the Y position, then a little modification:
temp = thisComp.layer(“Audio Amplitude”).effect(“Left Channel”)(“Slider”);
[position [0], position [1] + temp]It’s just telling it to use the x and y+temp.
Here is a post on how to Interpolate the parameter (Scale here) to the amount of audio (if times “*” and division”/” isn’t easy):
https://forums.creativecow.net/cgi-bin/new_read_post.cgi?forumid=2&postid=892100
Also, Crazy Talk by reallusion is a good basic lip-synch Program to speech (easy).
https://www.reallusion.com/crazytalk/
-
Just wanted to mentioned as well a product I stumbled across, CrazyTalk – right now they seem to be marketing it for schools, but as a cheap-ish bit of kit, it’s really useful.
Graham
https://www.quinceweb.com – web design
——–
https://www.shiveringcactus.bravehost.com – Free FX for amateur films
Reply to this Discussion! Login or Sign Up