Andrew Kramer posted a tutorial for VCP where I recall him enabling a tracker to track a tracker.
It’s the set extension tutorial he does where he composites a few old stone castles into the background.
The camera moves from a shot of the ground, way way way off horizontally and then ends up on its target. He just parents one tracker to the other in some fashion and it seems to work.
You would probably have to daisy-chain a bunch of trackers in this way, but as long as you give your trackers something good to grip to, you should be alright.
You could also look into 3D matchmoving such as Boujou / Syntheyes as, though they are primarily 3D trackers, they can do 2D functions such as stabilization.