Take out the keyframes and add a quick expression by alt clicking on the stopwatch next to the paramiter that you want to be random, being the horizontal, verical, or height.
wiggle(.25,50)
by adding this, every .25 sec the generate a variable of 50. These numbers can be changed of course depending on the speed/amount you want this to move.