I doubt if you have similar issues if you used a Shape Layer.
You may want to look at Paravent – https://www.motionboutique.com/paravent/. The caveat is that I think it only works with rectangular shapes.
HTH
– Roland
TypeGEMs – the Definitive Type Gizmo for AE
https://broadcastgems.com/typegems/
Intensive mocha & AE Training in Singapore and Other Dangerous Locations
Adobe After Effects CC ACE/ACI
Imagineer Systems (mocha) Certified Instructor
https://www.broadcastgems.com/mographintensity_shapestext/