Regular keys represent a specific value — X position for example — at a particular time. If you adjust an fcurve point up or down you are setting a different position at the same time. If you move a point right or left you are changing the time that the object arrives at the same position.
If you want to keep the same motion and only adjust the timing, then the time track is what you want. Time tracks are very powerful.