Could be a number of things:
1. When you digitize you get the cleanest key by bringing it in “component” instead of “composite”
2. There are a number of check boxes on the lower right of the interface—after you select your background make sure to activate “clean” and “Roto”
3. Ultimatte also has excellant tech support and have found them very helpful.
Good Luck