if you want to just track on one channel you can precomp your footage and set it to that channel only.
noise is your enemy so you dont want to push the footage to far.
careful with removing noise as well as too much will affect your track as well.
anyway to track part of the foreground images (you dont mention what th shot is so….)
who is that masked man…