Depending how long your matted clip is going to be, you could always (egad!) go frame by frame and clean it that way, but yes it would have to be very valuable work to be worth it if its more than a few seconds..
Regards,
Joe Springer
Certified Adobe After Effects Training and Premiere Training Instructor