Hey Jacob,
I guess moving objects in your shot are throwing off the stabilizer. Precompose your shot. In the precomp, add a color matte ctrl+Y above your footage and disable its visibilty. Roughly mask out moving objects like foreground trees and sky/clouds, then feather the mask. Now turn on visibility. Go back to main comp and warp stabilize your precomp. After stabilizing, go into precomp and turn of the visibility of the color matte, then render.
This works in most cases if theres enough to source footage visible to track. With the sky masked, there may not be enough image to track, in that case leave stabilize mode set to “position, scale, rotation”, “warp” probably wont work.