Unfortunately, as far as I know, you can’t get around it – the quickest way is to pull the object from the solver, Clear the solver, change the object’s animation, move to the final frame of animation for the object (if not there) and drop it back in the solver.