sometimes the record button comes in handy so don’t right it off so soon.
But what you explained was right except for the final step. Set your starting keyframe> move the play head on the mini timeline to where you want the animation to stop>set ending keyframes> then move object to its ending position.
so basically set the keyframes first then move the object
hope this helps