Special Auto Lip Sync

[Ángel Molina lópez]

I want that effect while they are just talking. It’s not something specific. Some syllables will match with an open mouth and streched body and others with a closed mouth and normal body.

[Kalleheikki Kannisto]

You can use audio to keyframes result with a simple piece of expression code that sets the threshold of when to stretch the pixels.

Kalleheikki Kannisto
Senior Graphic Designer

[Ángel Molina lópez]

Thank you for your replies. Kalleheikki, the technique you have spoken of is the one I’m using now, but I was looking for something more automated. I’ve been searching and I think I’ve found a way. Lars is a genius (https://vimeo.com/220359572) and has made an expression that allows the transfer of keyframes from CA (Character Animator) to AF and it works perfectly well. It saves you a lot of time.

Now, the scale problem. I’ve assigned a null that responds to the values adopted by the mouth so I tasked it when the mouth is open, the puppet stretches. To do this, I’ve used the following expression:

x=thisComp.layer(“SIDE MOUTH GREEN”).effect(“LJ – visemes – MSD”)(“viseme nr.”)
if(x==1)[148,199];
else if (x==3) [148,199];
else if (x==7) [148,199];
else if (x==10) [148,199];
else if (x==11) [148,199];
else [148,189];

The problem is as follows. When there are two consecutive sounds that are equivalent to an open mouth (FOR – GO – tten), the puppet doesn’t move and that’s a pretty dull stuff. What should be said to AF is: if after an open mouth value goes another open mouth value, on the changed value disable the stretching for X time. What’d be the expression that would be needed to achieve that? I know I could do it manually but I want to broaden my skills.

Thank you in advance.

PS: Is there any way to shorten the expression I have written?

Some contents or functionalities here are not available due to your cookie preferences!

This happens because the functionality/content marked as “Vimeo framework” uses cookies that you choosed to keep disabled. In order to view this content or use this functionality, please enable cookies: click here to open your cookie preferences.