If you track rotation you can’t change your tracking positions as you have. A different spot on the same circle is traveling in a different vector (direction) than any other spot on that circle, even if sooner or later they move through the same points in space it happens at a different time.
The sample clips show a chimney. The left and right sides of that object would be the best bet.
Good Luck
TonyTony