Hey Jacob,
Sorry, I stored this away in a tab amongst 1000s on FireFox, and today as destiny would have it, it was presented to me.
You make some interesting points, and raise good questions.
It is only in scripted productions (mainly drama) that you get a script. Some larger organisations create scripts from their unscripted shows at the end of the Post production. But to match it to the spoken word might be difficult – although, I’m sure someone could write a plug-in for that.
Although I have not worked with it, yet (have got the licence), Avid Scriptsync might do what you are looking for:
https://www.avid.com/products/media-composer-scriptsync-option
On a wider note about speech to subtitles, I am not sure that A.I. is the right wording to use in the context of what is effectively “Machine Learning”?
However, if you want to “reverse” the process. Where the SOT (Sound On Tape) is transcribed, then fixed for errors, and turned into a “new” voice that is inserted into the right places on the edit. And, spaced out to match lips. Then, you’ll get rid of the original speaker, but use A.I. to mimic their voice. Then you are looking at something very different, that might not be received well by the person with the actual voice.
Only a week ago Epic games, with their new A.I. voice bots, walked into controversy on the subject of replacing the original voice actor with A.I. (Although some might argue that it will take a shovel and some amount of raising the ead from the Grave, to get Darth Vader’s original voice.
https://www.bbc.co.uk/news/articles/cn844l3eznqo
Just an opinion.
Atb
Mads
PS: Love your AninagiN trailer, will watch the movie!