[Craig Hood]

I found out how to do this by either using a track matte as you suggested or by pre composing the layer and having the unsharp mask applied inside that pre composed layer.

Then, back in the main composition, a mask can be applied to the pre composed layer.

I had to do this with three layers and I found the pre composing to be a bit quicker.