-
An especially cool feature in the new Adobe release today
Not to be stirring anything up, but I know that many folks here are working with tools that include ones from Adobe, as well as talking more generally about technology, and I gotta tell ya, this particular feature looks mighty slick to me: Content-Aware Fill. Originally introduced in Photoshop last fall, it’s lit on fire in After Effects, using artificial intelligence to create new pixels for advanced roto-style fill more or less out of thin air.
I’ve posted Adobe’s press release here, and will be posting some more personal thoughts in just a bit, including some details on speed increases. As one example:
I’ll also add the overall pitch video below, but seriously, that Content-Aware Fill? Slick.
-
14 Replies
-
Wowser!
-
It’s like the Mocha’s Remove module, but built in. I’d be curious to see how it stacks up because Mocha’s remove tool is pretty great!
-
[Jeremy Garchow] “It’s like the Mocha’s Remove module, but built in. I’d be curious to see how it stacks up because Mocha’s remove tool is pretty great!”
I have the same question. I’ve been using Mocha Pro for roto and object removal for years… but an AI assisted object removal tool… WHAT?!?! I can’t wait to try it for myself.
Shawn
-
I tested it on a few clips this morning. Overall, it’s been really impressive.
I had an interview shot outside with shifting daylight and a textured shirt with a logo embroidered on it. I set it up to remove the logo, and it got about 90% of the way there. The issues was mostly subtle color shifts as the talent moved and as the sunlight changed.
Then I tested it on an ideal shot – talent shot on white cyc, wearing a dark solid color shirt with a name tag. I removed the name tag and it took about 10 minutes to set up, analyze, and remove, and it was about 99% of the way there.
First impressions – it will be super useful for quick, simple logo/blemish removal, and possibly for bigger stuff (or at least getting it most of the way there with the bigger stuff). Looking forward to using it in a real project.
—————-
Michael Hancock
Editor -
[Michael Hancock] “I tested it on a few clips this morning. Overall, it’s been really impressive.
I had an interview shot outside with shifting daylight and a textured shirt with a logo embroidered on it. I set it up to remove the logo, and it got about 90% of the way there. The issues was mostly subtle color shifts as the talent moved and as the sunlight changed.
Then I tested it on an ideal shot – talent shot on white cyc, wearing a dark solid color shirt with a name tag. I removed the name tag and it took about 10 minutes to set up, analyze, and remove, and it was about 99% of the way there.
First impressions – it will be super useful for quick, simple logo/blemish removal, and possibly for bigger stuff (or at least getting it most of the way there with the bigger stuff). Looking forward to using it in a real project.”
Do you feel like you have a fair bit of control of the effect after the removal process? How much tweaking can you do after the solve?
Shawn
-
It looks like it creates a png sequence, and in the Content Aware Fill settings you can have it export a Photoshop sequence, so you can go in to each individual frame in Photoshop and tweak them if need be. Kind of neat how it does it.
In addition, it creates the png sequence and places it above the layer you’ve masked out, so you can always drop it below the layer and adjust the feathering of your original mask to blend it a little better. So there are a lot of options. That said, I’m an editor and not a compositor so it’s enough control for me, but for someone who actually knows what they’re doing they would probably want more!
—————-
Michael Hancock
Editor -
That’s good to know, thanks Michael! I’m in the middle of a project at the moment, so I probably won’t get a chance to try it this week. I’m really curious though.
Shawn
-
They’ve been teasing this for, what, 3 years now, but I’m excited it’s coming out. This is the first tool in AE that would make me prefer it over Motion. I’m already thinking of creative ways to apply it, besides just repairing shots and backgrounds.
How well do you think it can do to add crowds to a stadium shot? Anybody try that yet?
-
I did some prelim testing last night, and it doesn’t track on a mask. So you’d have to do some tracking (or keyframe a mask(s)) and then it works from there.
I don’t know, it seems like a v1 product, it works OK, but I do think that on object removal unless it’s super simple, some paint and roto will still be necessary and Mocha can do a better (and easier in the sense that it is more controllable) job. You also have to paint a cleanplate, as the Ae version is waning you to do with Photoshop. If that is necessary, I’d much rather use Mocha’s superior tracking and roto, and then just plug all that in to Ae. The only thing it has going for it is the A.I. fill, but even that, in my little tests, needs to be super simple. Mocha has tools for lighting fluctuations and pixel rebuild as well, and it works amazingly well.
I am a huge Mocha proponent, and I think Mocha is a great program to learn, with admittedly a steeper learning curve, but it’s well worth it.
-
I’m trying to test it out right now, filling in the sides of a scene where I want to roto out the lights and stands and grips, etc. I’m not sure what the steps are, but I drew out a mask, asked it to fill, it sent me to photoshop to define a base image from which it will extrapolate, I saved that and hit “apply”, and it’s now chugging away at “something”, but the progress bar is super-slow, don’t know if I’ll see a result before COB today.
I could use a plain step-by-step Dummie’s guide to this, but my stumbling thru the Adobe Help gave me no hits. Hope someone here makes a tutorial on using it soon. (Hint, Hint)
Reply to this Discussion! Login or Sign Up