rotoscoping is using masks to create an alpha…
Say if you’ve shot some green screen stuff that you can get a proper key for….so instead of keying the footage…you have to roto it.. meaning use masks to mask out the character and get an alpha channel for the footage.
I’d search more about it on Google.com