Your Vimeo link appears to be broken.
I am trying to understand whats going on here. it sounds as if the masks are not effected by time remapping and so when you remap everything else it’s animation is off a bit. If the masks ON the composition you are trying to remap and not inside of it then that makes sense. you would need to precompose it and remap that but if it’s not then I’m not really sure.
if you can fix the link I’m might be more help 🙁