I have the same problem.
In my case an EX1 that has been updated to the latest firmware.
The unit is just over 1year old and originally had this problem but slight and not all the time.
It has recently got considerably worse making a slow zoom impossible.
The lens on my Z1 (much older) does not suffer this “feature” but then a totally different manufacturer makes it.
Hawke.