Creative Communities of the World Forums

The peer to peer support community for media production professionals.

Activity Forums Adobe After Effects Expressions Syncing animated text with song lyrics

  • Syncing animated text with song lyrics

    Posted by Elorah on May 10, 2005 at 10:38 am

    I’m working on a specific project and need some specific instruction. I’m fairly new to After Effects so I don’t know what all it’s capable of, but, basically, I’m needing to create compositions with audio where I can animate the text so that the animated text corresponds to the lyrics being sung in the song (a la karaoke, but better looking and more sophisticated). Until now, it’s been a tedious project where I import a backgroud graphic…type in each line of text…then preview and time the song phrase in Premiere…then manually set keyframes for that phrase in the composition….and then do it again and again…usually 20+ times per song. And I’ve just been using the opacity to signify when to sing the phrase….but I would like to use size to signify when to sing each word or syllable. Obviously doing this by hand would be very labor intensive. I’m looking for something that would help me establish the keyframes more easily. I read over the tutorial on this site about syncing animation with audio for the drummer, but I was *completely* lost. Half of the stuff I didn’t even know what he was talking about. Is this something I would be able to do in AE more easily than I’ve been doing it? And, if not, is there some plugin or other software that will work with Adobe’s software that I could use to do this? I would appreciate someone pointing me in the right direction….thanks

    Pamela Kaadou replied 10 years, 11 months ago 6 Members · 10 Replies
  • 10 Replies
  • Al

    May 10, 2005 at 11:28 am

    have you experimented with Animation>Keyframe Assistant>Convert Audio to Keyframes?

  • Elorah

    May 10, 2005 at 2:04 pm

    From what I’ve read about that it only sets keyframes where the amplitude changes…. that really doesn’t help me….

  • Filip Vandueren

    May 10, 2005 at 4:01 pm

    Hi,

    I made a litlle project file you can alter:

    • Type in your text.
    • set up the text-animation with the desired effect (I used fill brightness +100% and (110%,120%) scaling)
    • in the advanced setting of the range selector: units=index / Based on = Words / Shape = Smooth
    • Range selector: start=0 / end=1 / offset gets an expression:

      transitionTime = 0.5 ; // try to smooth the effect in 0.5 seconds (won't happen if the markers are too closely spaced)
      t=time + transitionTime/2; // lookahead

      if (thisLayer.marker.numKeys) { // catch the error if there are no markers
      nearestMark=thisLayer.marker.nearestKey(t);

      ind=(nearestMark.index - (nearestMark.time>t)); // ind is the index of the last marker we've passed in the timeline, or 0
      tim=thisLayer.marker.key (ind>1 ? ind : 1).time ; // tim is the time of the last marker

      ease(time,tim-transitionTime/2,tim+transitionTime/2,ind-2,ind-1); // a little interpolation to smooth it out

      } else {
      -1
      }

    just record markers to your text-layer, the script in the offset-parameter makes the animation-offset jump to the next word with every marker.
    Now all you have to do is finetune the marker-positions
    You can duplicate that text layer as often as you need it (one per sentence)

    The project-file should speak for itself.

    Right/control-click ont his movie and choose play to see a sample:

    here’s the project-file:
    karaoke.aep

  • Elorah

    May 10, 2005 at 4:09 pm

    wow – ok, that’s exactly what I need….except that it looks like it’s written in Greek! lol j/k But I’ll follow your directions as best I can. Do you think you could repost the AE file saved for version 6.0? I wasn’t able to open the one you posted because it was done it 6.5….thanks! :>

  • Filip Vandueren

    May 10, 2005 at 4:41 pm

    Sorry, I don’t have v6 installed anymore, but it’s quite simple to recreate the effect:

    1. just create a text-layer with mulitple words. fex. “I
  • Elorah

    May 10, 2005 at 5:39 pm

    Filip – you’re my hero! lol That’s *exactly* what I’ve been wanting to do. I still have some specific questions and was wondering if I could correspond with you privately. If you don’t want to post your email here, I’ll post mine and then hope to hear from you…..:>
    elorahd@yahoo.com

  • Emiliano Grimaldi

    September 17, 2009 at 3:22 pm

    Hello Filip,

    I was reading your post, and got very interested, but I tried to download the project file, but the link is not working anymore 🙁 could you post it back again?

    Thank you,

    Emiliano

    http://www.emilianogrimaldi.it
    https://emilianogrimaldi.blogspot.com

  • Scott Green

    November 26, 2012 at 11:08 am

    Hi, you couldn’t open and save this project file a newer version of AE for me to take a look at could you please? It won’t open in CS6 🙁

    Creative Multimedia Design Manchester | S©tt Green | Splurj

  • Scott Green

    November 26, 2012 at 1:13 pm

    I’ve managed to open the file, how can you make the words so that stay the colour that they are spoken? ie. make then stay white when they move on to the next word?

    Creative Multimedia Design Manchester | S©tt Green | Splurj

  • Pamela Kaadou

    May 30, 2015 at 2:25 pm

    hello… I have a similar project to the Karaoke project file you posted but the link isnt working anymore and i need to download it can you please resend it. Thank youu

We use anonymous cookies to give you the best experience we can.
Our Privacy policy | GDPR Policy