I actually figured it out. In the “Visibility” setting I had to increase how far I had my fog going. Apparently if you have mountains outside of your fog range they will pop up as you animate your camera in z space. Wish it would be more of a fade instead of just an abrupt appearance. Oh well.