Okay. Thanks to everyone for the suggestions. I have been trying the “Keying” solution with mixed results.
Turns out that I have 36 episodes like this, so the “roto-ing” solution just won’t be practical in the amount of time I have available.
Here are some examples of my results:
Here, the keyed out mask looks pretty good –

It’s not too bad in this shot –

I am getting a lot of noisiness in the key, which is pretty distracting while the video is playing. Here, you can see an example of dark speckling over the 69 –

And the worst part is the times when the darker parts of the head drift into the number –

If anyone has any suggestions on how I might improve these results, it would be greatly appreciated. This project is killing me…. slowly…. and painfully…
Thanks