If it’s the one with the pistol grip then it very well could be from hand shakes, or even the head it self. Ideally you’d want a fluid head and a panning handle so the vibrations would be minimal and the longer lever would give you smooth motion. Is this is the pistol grip model, try fashioning a handle, probably easiest with a metal tube