Is AE your only tracker available to you? Cause it can be done in AE with lots of patiences.
But personally I would use a planar tracker like Monet to track this and not a point tracker.
But Monet is VERY expensive, so i wouldn’t expect many to have access to it.