I was searching on google and found this in an other thread
“With respect to the Position and Anchor Point properties, AE resamples an image when (a)a layer is animated and it is set to Best Quality and (b) a layer is static and the difference between the Anchor Point and Position is not an integer. “
So maybe the problem lies there? I still have no idea how to solve it =/