Wow, I just had this for days.
I had my 24GB of memory set up for single core rendering because it was faster in rendering time as I had low cpu intensive renders.
Bottom line was my GUI was not getting enough CPU love. So I turned on the multiprocessing. I needed to make the Actual CPUs part get to max by adjusting Zero for other apps and lowering the RAM allocation per background CPU until the Actual got to max.
I goes much better now.