If you want to maintain textures and scratches. I would do this by creating each brick in a separate precomp. This way you can have a finished brick per layer.
Create a composition and call it Brick 001. Add your brick wall. Make sure the brick wall layer is selected, now use the square shape tool(it’s the mask tool, when you don’t have a layer selected). and make a brick shape over the first brick you want to show up.
Now go to your project panel and duplicate this composition for as many individual bricks you need. Go back to comp Brick 001, select the Brick Wall layer and change it’s TrkMat mode to Alpha Matte(If you don’t see the TrkMat, press the “Toggle Switches/Modes” button below the layers). Now you have your first brick placed. Open up the all the other brick layers, move the shape layer over each new brick as you want them to appear and change the TRkMat. If you have odd shape bricks like I did in my example project, just double click the shape layer and rescale.
When you are finished, create a new composition called Brick Composite. Bring all your numbered brick layers into and just offset them in time by 1 frame(There are free scripts you can download that will automatically do this, I think video-copilot has one). Once all the bricks are displayed, you may see some holes between them. You will need to go back to your individual brick layers and adjust the shape layer to remove the hole. See “Brick 010” in my example about holes.
Now you can bring the “Brick Composite” into your final comp as one layer and add any effects.
Attached is a quick example project that should help, if anything above was confusing.